Aug 11 04:31:52 devstack cinder-volume[83400]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 11 04:31:52 devstack cinder-volume[83400]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 11 04:31:52 devstack cinder-volume[83400]: we strongly recommend against using it for new projects. Aug 11 04:31:52 devstack cinder-volume[83400]: If you are already using Eventlet, we recommend migrating to a different Aug 11 04:31:52 devstack cinder-volume[83400]: framework. For more detail see Aug 11 04:31:52 devstack cinder-volume[83400]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 11 04:31:52 devstack cinder-volume[83400]: import eventlet # noqa Aug 11 04:31:54 devstack cinder-volume[83400]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83400) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 11 04:31:54 devstack cinder-volume[83400]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83400) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 11 04:31:54 devstack cinder-volume[83400]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83400) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 11 04:31:55 devstack cinder-volume[83400]: INFO dbcounter [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] Registered counter for database cinder Aug 11 04:31:55 devstack cinder-volume[83400]: DEBUG oslo_db.sqlalchemy.engines [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83400) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 11 04:31:56 devstack cinder-volume[83400]: DEBUG dbcounter [-] [83400] Writer thread running {{(pid=83400) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 11 04:31:56 devstack cinder-volume[83400]: INFO cinder.rpc [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 11 04:31:56 devstack cinder-volume[83400]: INFO cinder.rpc [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 11 04:31:56 devstack cinder-volume[83400]: DEBUG oslo_db.sqlalchemy.engines [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83400) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 11 04:31:56 devstack cinder-volume[83400]: INFO cinder.volume.manager [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] Determined volume DB was empty at startup. Aug 11 04:31:56 devstack cinder-volume[83400]: DEBUG cinder.volume.manager [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83400) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 11 04:31:56 devstack cinder-volume[83400]: INFO cinder.volume.manager [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 11 04:31:56 devstack cinder-volume[83400]: WARNING stevedore.named [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 11 04:31:56 devstack cinder-volume[83400]: WARNING castellan.key_manager [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 11 04:31:56 devstack cinder-volume[83400]: WARNING cinder.keymgr.conf_key_mgr [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 11 04:31:56 devstack cinder-volume[83400]: DEBUG cinder.volume.drivers.lvm [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=83400) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Aug 11 04:31:56 devstack cinder-volume[83400]: DEBUG oslo_concurrency.processutils [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=83400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:31:56 devstack cinder-volume[83400]: DEBUG oslo_concurrency.processutils [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] CMD "cinder-rtstool verify" returned: 0 in 0.434s {{(pid=83400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:31:56 devstack cinder-volume[83400]: DEBUG oslo_db.sqlalchemy.engines [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83400) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 11 04:31:56 devstack cinder-volume[83400]: INFO cinder.rpc [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Aug 11 04:31:56 devstack cinder-volume[83400]: INFO cinder.rpc [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Aug 11 04:31:56 devstack cinder-volume[83400]: WARNING stevedore.named [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 11 04:31:56 devstack cinder-volume[83400]: WARNING castellan.key_manager [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 11 04:31:56 devstack cinder-volume[83400]: INFO cinder.volume.manager [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] Image-volume cache enabled for host devstack@lvmdriver-1. Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_db.sqlalchemy.engines [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83400) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 11 04:31:57 devstack cinder-volume[83400]: INFO oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] Starting 1 workers Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] Started child 83555 {{(pid=83400) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] Full set of CONF: {{(pid=83400) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 11 04:31:57 devstack cinder-volume[83555]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] ******************************************************************************** {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3518}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] Configuration options gathered from: {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3519}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3520}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3521}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] ================================================================================ {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3526}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] allow_availability_zone_fallback = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] allow_compression_on_image_upload = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] allowed_direct_url_schemes = [] {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] api_rate_limit = True {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] auth_strategy = keystone {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] az_cache_duration = 3600 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_availability_zone = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_host = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_name = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_stats_polling_interval = 60 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backup_api_class = cinder.backup.api.API {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backup_name_template = backup-%s {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backup_use_same_host = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backup_use_temp_snapshot = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] chap_password = **** {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] chap_username = {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] cinder_internal_tenant_project_id = b0e11ff70ae94d7e8de6d46758f59225 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] cinder_internal_tenant_user_id = 2b1eec09f3124883be5fd13cf8921779 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] cloned_volume_same_az = True {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] cluster = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] compression_format = gzip {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] compute_api_class = cinder.compute.nova.API {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] config_dir = [] {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] config_source = [] {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] control_exchange = openstack {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] debug = True {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] default_availability_zone = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] default_group_type = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83555]: INFO cinder.volume.manager [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] Starting volume driver LVMVolumeDriver (3.0.0) Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] default_volume_type = lvmdriver-1 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] disk_geometry = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] driver_client_cert = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] driver_client_cert_key = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] driver_data_namespace = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] driver_ssl_cert_path = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] driver_ssl_cert_verify = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] driver_use_ssl = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] enable_force_upload = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] enable_new_services = True {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] enable_unsupported_driver = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] enabled_backends = ['lvmdriver-1'] {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] enforce_multipath_for_image_xfer = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] filter_function = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] glance_api_insecure = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] glance_api_servers = ['http://192.168.122.129/image'] {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] glance_api_ssl_compression = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] glance_ca_certificates_file = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] glance_catalog_info = image:glance:publicURL {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] glance_certfile = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] glance_keyfile = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] glance_num_retries = 3 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] glance_request_timeout = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] goodness_function = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] graceful_shutdown_timeout = 5 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] group_api_class = cinder.group.api.API {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] host = devstack {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] image_compress_on_upload = True {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] image_conversion_address_space_limit = 1 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] image_conversion_cpu_limit = 60 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] image_conversion_disable = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] image_upload_use_cinder_backend = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] image_upload_use_internal_tenant = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] image_volume_cache_enabled = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] image_volume_cache_max_count = 0 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] image_volume_cache_max_size_gb = 0 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] init_host_max_objects_retrieval = 0 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] instance_format = [instance: %(uuid)s] {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] iscsi_target_flags = {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] iscsi_write_cache = on {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] iser_helper = tgtadm {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] iser_ip_address = 192.168.122.129 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] iser_port = 3260 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] log_color = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] log_config_append = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] log_dir = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] log_file = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] log_options = True {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] log_rotate_interval = 1 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] log_rotate_interval_type = days {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] log_rotation_type = none {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] max_age = 0 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] max_logfile_count = 30 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] max_logfile_size_mb = 200 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] max_over_subscription_ratio = 20.0 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] message_reap_interval = 86400 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] message_ttl = 2592000 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] migration_create_volume_timeout_secs = 300 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] monkey_patch = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] monkey_patch_modules = [] {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] my_ip = 192.168.122.129 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] no_snapshot_gb_quota = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] num_iser_scan_tries = 3 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] num_shell_tries = 3 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] num_volume_device_scan_tries = 3 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] nvmeof_conn_info_version = 1 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] nvmet_ns_id = 10 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] nvmet_port_id = 1 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] osapi_max_limit = 1000 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] osapi_volume_ext_list = [] {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] osapi_volume_listen = 0.0.0.0 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] osapi_volume_listen_port = 8776 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] osapi_volume_use_ssl = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] osapi_volume_workers = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] per_volume_size_limit = -1 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] periodic_fuzzy_delay = 60 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] periodic_interval = 60 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] project_id_regex = [0-9a-f\-]+ {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] public_endpoint = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] publish_errors = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] quota_backup_gigabytes = 1000 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] quota_backups = 10 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] quota_gigabytes = 1000 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] quota_groups = 10 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] quota_snapshots = 10 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] quota_volumes = 10 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] rate_limit_burst = 0 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] rate_limit_except_level = CRITICAL {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] rate_limit_interval = 0 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] reinit_driver_count = 3 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] replication_device = **** {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] report_discard_supported = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] report_interval = 120 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] reservation_clean_interval = 86400 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] reservation_expire = 86400 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] reserved_image_namespaces = [] {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.051s {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] reserved_percentage = 0 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] rpc_response_timeout = 120 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] run_external_periodic_tasks = True {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] scst_target_driver = iscsi {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] scst_target_iqn_name = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] service_down_time = 720 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] shell_completion = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] snapshot_name_template = snapshot-%s {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] snapshot_same_host = True {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] split_loggers = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] state_path = /opt/stack/data/cinder {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] storage_availability_zone = nova {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] storage_protocol = iSCSI {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] syslog_log_facility = LOG_USER {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] target_helper = lioadm {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] target_ip_address = 192.168.122.129 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] target_port = 3260 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] target_protocol = iscsi {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] target_secondary_ip_addresses = [] {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] trace_flags = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] transfer_api_class = cinder.transfer.api.API {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] transport_url = **** {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] until_refresh = 0 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] use_chap_auth = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] use_default_quota_class = True {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] use_journal = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] use_json = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] use_multipath_for_image_xfer = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] use_stderr = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] use_syslog = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] verify_glance_signatures = enabled {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] volume_api_class = cinder.volume.api.API {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] volume_backend_name = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] volume_clear = zero {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] volume_clear_ionice = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] volume_clear_size = 0 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] volume_copy_bps_limit = 0 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] volume_dd_blocksize = 1M {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] volume_name_template = volume-%s {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] volume_service_inithost_offload = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] volume_usage_audit_period = month {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] zoning_mode = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:31:57 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_concurrency.disable_process_locking = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] keystone_authtoken.auth_section = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] keystone_authtoken.auth_type = password {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] keystone_authtoken.auth_version = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] keystone_authtoken.cache = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] keystone_authtoken.certfile = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] keystone_authtoken.delay_auth_decision = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] keystone_authtoken.http_connect_timeout = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] keystone_authtoken.include_service_catalog = True {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] keystone_authtoken.insecure = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] keystone_authtoken.interface = public {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] keystone_authtoken.keyfile = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] keystone_authtoken.memcache_password = {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] keystone_authtoken.memcache_username = {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] keystone_authtoken.region_name = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] keystone_authtoken.service_token_roles_required = True {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] keystone_authtoken.service_type = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] keystone_authtoken.token_cache_time = 300 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.129/identity {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] cache.backend = dogpile.cache.null {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] cache.backend_argument = **** {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] cache.backend_expiration_time = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] cache.config_prefix = cache.oslo {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] cache.debug_cache_backend = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] cache.enable_retry_client = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] cache.enable_socket_keepalive = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] cache.enabled = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] cache.expiration_time = 600 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] cache.hashclient_retry_attempts = 2 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] cache.memcache_dead_retry = 300 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] cache.memcache_pool_maxsize = 10 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] cache.memcache_sasl_enabled = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] cache.password = **** {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] cache.proxies = [] {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] cache.redis_db = 0 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] cache.redis_sentinel_service_name = mymaster {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] cache.redis_server = localhost:6379 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] cache.retry_attempts = 2 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] cache.retry_delay = 0.0 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] cache.socket_keepalive_count = 1 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] cache.socket_keepalive_idle = 1 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] cache.socket_keepalive_interval = 1 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] cache.socket_timeout = 1.0 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] cache.tls_allowed_ciphers = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] cache.tls_cafile = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] cache.tls_certfile = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] cache.tls_enabled = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] cache.tls_keyfile = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] cache.username = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] coordination.backend_url = **** {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] database.asyncio_connection = **** {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] database.asyncio_slave_connection = **** {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] database.backend = sqlalchemy {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] database.connection = **** {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.043s {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] database.connection_debug = 0 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] database.connection_parameters = {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] database.connection_recycle_time = 3600 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] database.connection_trace = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] database.db_inc_retry_interval = True {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] database.db_max_retries = 20 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] database.db_max_retry_interval = 10 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] database.db_retry_interval = 1 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] database.max_overflow = 50 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] database.max_pool_size = 5 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] database.max_retries = 10 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] database.mysql_wsrep_sync_wait = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] database.pool_timeout = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] database.retry_interval = 10 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] database.slave_connection = **** {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] database.sqlite_synchronous = True {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] database.synchronous_reader = True {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] database.use_db_reconnect = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] profiler.connection_string = messaging:// {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] profiler.enabled = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] profiler.es_doc_type = notification {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] profiler.es_scroll_size = 10000 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack sudo[83559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] profiler.es_scroll_time = 2m {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] profiler.filter_error_trace = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] profiler.hmac_keys = **** {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] profiler.sentinel_service_name = mymaster {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] profiler.socket_timeout = 0.1 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] profiler.trace_requests = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] profiler.trace_sqlalchemy = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack sudo[83559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] profiler_jaeger.process_tags = {} {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] profiler_jaeger.service_name_prefix = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] profiler_otlp.service_name_prefix = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_policy.enforce_new_defaults = True {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_policy.policy_default_rule = default {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_policy.policy_file = policy.yaml {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_policy.remote_timeout = 60.0 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] privsep_osbrick.group = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] privsep_osbrick.helper_command = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] privsep_osbrick.user = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] cinder_sys_admin.group = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] cinder_sys_admin.helper_command = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] cinder_sys_admin.user = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] service_user.auth_section = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] service_user.auth_type = password {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] service_user.cafile = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] service_user.certfile = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] service_user.collect_timing = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] service_user.insecure = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] service_user.keyfile = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] service_user.send_service_user_token = True {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] service_user.split_loggers = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] service_user.timeout = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] glance.auth_section = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] glance.auth_type = password {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] glance.certfile = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] glance.collect_timing = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] glance.insecure = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] glance.keyfile = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] glance.region_name = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] glance.split_loggers = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] glance.timeout = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.backend_availability_zone = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.chap_password = **** {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.chap_username = {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.disk_geometry = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.driver_client_cert = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.driver_client_cert_key = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.driver_data_namespace = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.driver_use_ssl = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.enable_unsupported_driver = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.extra_capabilities = {} {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.filter_function = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.goodness_function = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.iscsi_target_flags = {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.iscsi_write_cache = on {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.iser_helper = tgtadm {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.iser_ip_address = 192.168.122.129 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.iser_port = 3260 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.lvm_mirrors = 0 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.lvm_share_target = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.lvm_type = auto {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.num_shell_tries = 3 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.nvmet_port_id = 1 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.replication_device = **** {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.report_discard_supported = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.reserved_percentage = 0 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.scst_target_driver = iscsi {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.scst_target_iqn_name = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.storage_protocol = iSCSI {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.target_helper = tgtadm {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.target_ip_address = 192.168.122.129 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.target_port = 3260 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.target_protocol = iscsi {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.trace_flags = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.unique_fqdn_network = True {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.use_chap_auth = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.volume_backend_name = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.volume_clear = zero {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.volume_clear_ionice = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.volume_clear_size = 0 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.volume_group = cinder-volumes {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_reports.file_event_handler = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_reports.log_dir = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.backend_availability_zone = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.backend_host = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.chap_password = **** {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.chap_username = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.chiscsi_conf = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.disk_geometry = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.driver_client_cert = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.driver_client_cert_key = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.driver_data_namespace = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.driver_use_ssl = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.extra_capabilities = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.filter_function = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.goodness_function = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.iscsi_target_flags = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.iscsi_write_cache = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.iser_helper = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.iser_ip_address = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.iser_port = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.iser_target_prefix = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.lvm_conf_file = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.lvm_mirrors = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.lvm_share_target = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.lvm_type = auto {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.num_shell_tries = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.nvmet_ns_id = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.nvmet_port_id = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.replication_device = **** {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.report_discard_supported = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.reserved_percentage = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.scst_target_driver = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.storage_protocol = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.target_helper = lioadm {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.target_ip_address = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.target_port = 3260 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.target_protocol = iscsi {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.trace_flags = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.unique_fqdn_network = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.use_chap_auth = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.volume_clear = zero {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.volume_clear_ionice = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.volume_clear_size = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] lvmdriver-1.volumes_dir = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_messaging_rabbit.ssl = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_messaging_rabbit.ssl_version = {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_messaging_notifications.driver = [] {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_messaging_notifications.retry = -1 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] oslo_messaging_notifications.transport_url = **** {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] key_manager.fixed_key = **** {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] barbican.barbican_api_version = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] barbican.barbican_endpoint = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] barbican.barbican_endpoint_type = public {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] barbican.barbican_region_name = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] barbican.cafile = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] barbican.certfile = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] barbican.collect_timing = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] barbican.insecure = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] barbican.keyfile = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] barbican.number_of_retries = 60 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] barbican.retry_delay = 1 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] barbican.send_service_user_token = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] barbican.split_loggers = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] barbican.timeout = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] barbican.verify_ssl = True {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] barbican.verify_ssl_path = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack sudo[83559]: pam_unix(sudo:session): session closed for user root Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] barbican_service_user.auth_section = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] barbican_service_user.auth_type = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] barbican_service_user.cafile = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] barbican_service_user.certfile = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] barbican_service_user.collect_timing = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] barbican_service_user.insecure = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] barbican_service_user.keyfile = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] barbican_service_user.split_loggers = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.299s {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:31:57 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] barbican_service_user.timeout = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] vault.approle_role_id = **** {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] vault.approle_secret_id = **** {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] vault.auth_method = approle {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] vault.auth_path = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] vault.kv_mountpoint = secret {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] vault.kv_path = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] vault.kv_version = 2 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] vault.namespace = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] vault.root_token_id = **** {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] vault.ssl_ca_crt_file = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] vault.timeout = 60.0 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] vault.token_file = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] vault.token_role = None {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] vault.use_ssl = False {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:31:57 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] ******************************************************************************** {{(pid=83400) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3552}} Aug 11 04:31:57 devstack sudo[83587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 11 04:31:57 devstack sudo[83587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:31:57 devstack sudo[83587]: pam_unix(sudo:session): session closed for user root Aug 11 04:31:57 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.319s {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:31:57 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 11 04:31:57 devstack cinder-volume[83555]: INFO cinder.brick.local_dev.lvm [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Aug 11 04:31:57 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:31:57 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:31:57 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:31:57 devstack sudo[83724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 11 04:31:57 devstack sudo[83724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:31:58 devstack sudo[83724]: pam_unix(sudo:session): session closed for user root Aug 11 04:31:58 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:31:58 devstack cinder-volume[83555]: DEBUG cinder.brick.local_dev.lvm [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=83555) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Aug 11 04:31:58 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:31:58 devstack sudo[83822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 11 04:31:58 devstack sudo[83822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:31:58 devstack sudo[83822]: pam_unix(sudo:session): session closed for user root Aug 11 04:31:58 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.507s {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:31:58 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:31:58 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:31:58 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:31:58 devstack sudo[84027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 11 04:31:58 devstack sudo[84027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:31:59 devstack sudo[84027]: pam_unix(sudo:session): session closed for user root Aug 11 04:31:59 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.321s {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:31:59 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:31:59 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:31:59 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:31:59 devstack sudo[84128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Aug 11 04:31:59 devstack sudo[84128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:31:59 devstack sudo[84128]: pam_unix(sudo:session): session closed for user root Aug 11 04:31:59 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.325s {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:31:59 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:31:59 devstack sudo[84209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 11 04:31:59 devstack sudo[84209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:31:59 devstack sudo[84209]: pam_unix(sudo:session): session closed for user root Aug 11 04:31:59 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:31:59 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:31:59 devstack sudo[84217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 11 04:31:59 devstack sudo[84217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:32:00 devstack sudo[84217]: pam_unix(sudo:session): session closed for user root Aug 11 04:32:00 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.326s {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:32:00 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:32:00 devstack sudo[84296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 11 04:32:00 devstack sudo[84296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:32:00 devstack sudo[84296]: pam_unix(sudo:session): session closed for user root Aug 11 04:32:00 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:32:00 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:32:00 devstack sudo[84305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 11 04:32:00 devstack sudo[84305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:32:00 devstack sudo[84305]: pam_unix(sudo:session): session closed for user root Aug 11 04:32:00 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.337s {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:32:00 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:32:00 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:32:00 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:32:00 devstack sudo[84389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 11 04:32:00 devstack sudo[84389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:32:00 devstack sudo[84389]: pam_unix(sudo:session): session closed for user root Aug 11 04:32:00 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.245s {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:32:00 devstack cinder-volume[83555]: INFO cinder.volume.drivers.lvm [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] Enabling LVM thin provisioning by default because a thin pool exists. Aug 11 04:32:00 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:32:00 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:32:00 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:32:00 devstack sudo[84393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 11 04:32:00 devstack sudo[84393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:32:01 devstack sudo[84393]: pam_unix(sudo:session): session closed for user root Aug 11 04:32:01 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.290s {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:32:01 devstack cinder-volume[83555]: DEBUG cinder.volume.drivers.lvm [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] Updating volume stats {{(pid=83555) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 11 04:32:01 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:32:01 devstack sudo[84396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 11 04:32:01 devstack sudo[84396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:32:01 devstack sudo[84396]: pam_unix(sudo:session): session closed for user root Aug 11 04:32:01 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:32:01 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:32:01 devstack sudo[84405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 11 04:32:01 devstack sudo[84405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:32:01 devstack sudo[84405]: pam_unix(sudo:session): session closed for user root Aug 11 04:32:01 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:32:01 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:32:01 devstack sudo[84408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 11 04:32:01 devstack sudo[84408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:32:01 devstack sudo[84408]: pam_unix(sudo:session): session closed for user root Aug 11 04:32:02 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.280s {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:32:02 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:32:02 devstack sudo[84411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 11 04:32:02 devstack sudo[84411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:32:02 devstack sudo[84411]: pam_unix(sudo:session): session closed for user root Aug 11 04:32:02 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:32:02 devstack cinder-volume[83555]: INFO cinder.volume.driver [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] Driver hasn't implemented _init_vendor_properties() Aug 11 04:32:02 devstack cinder-volume[83555]: DEBUG cinder.volume.driver [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83555) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 11 04:32:02 devstack cinder-volume[83555]: DEBUG oslo_db.sqlalchemy.engines [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83555) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 11 04:32:02 devstack cinder-volume[83555]: DEBUG dbcounter [-] [83555] Writer thread running {{(pid=83555) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 11 04:32:02 devstack cinder-volume[83555]: DEBUG cinder.db.api [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] Building query based on filter {{(pid=83555) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 11 04:32:02 devstack cinder-volume[83555]: DEBUG cinder.image.image_utils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83555) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 11 04:32:02 devstack cinder-volume[83555]: INFO cinder.keymgr.migration [None req-732ab632-4275-4c6b-ac15-39bd4e1d5345 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 11 04:32:02 devstack cinder-volume[83555]: DEBUG cinder.volume.drivers.lvm [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] Updating volume stats {{(pid=83555) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 11 04:32:02 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:32:02 devstack sudo[84416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 11 04:32:02 devstack sudo[84416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:32:02 devstack sudo[84416]: pam_unix(sudo:session): session closed for user root Aug 11 04:32:02 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:32:02 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:32:02 devstack sudo[84420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 11 04:32:02 devstack sudo[84420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:32:02 devstack sudo[84420]: pam_unix(sudo:session): session closed for user root Aug 11 04:32:02 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:32:02 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:32:02 devstack sudo[84424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 11 04:32:02 devstack sudo[84424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:32:03 devstack sudo[84424]: pam_unix(sudo:session): session closed for user root Aug 11 04:32:03 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.296s {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:32:03 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:32:03 devstack sudo[84428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 11 04:32:03 devstack sudo[84428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:32:03 devstack sudo[84428]: pam_unix(sudo:session): session closed for user root Aug 11 04:32:03 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:32:03 devstack cinder-volume[83555]: DEBUG cinder.manager [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] Notifying Schedulers of capabilities ... {{(pid=83555) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:32:03 devstack cinder-volume[83555]: INFO cinder.volume.manager [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] Driver initialization completed successfully. Aug 11 04:32:03 devstack cinder-volume[83555]: INFO cinder.manager [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] Initiating service 2 cleanup Aug 11 04:32:03 devstack cinder-volume[83555]: INFO cinder.manager [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] Service 2 cleanup completed. Aug 11 04:32:03 devstack cinder-volume[83555]: DEBUG cinder.service [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] Creating RPC server for service cinder-volume {{(pid=83555) start /opt/stack/cinder/cinder/service.py:231}} Aug 11 04:32:03 devstack cinder-volume[83555]: DEBUG cinder.service [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83555) start /opt/stack/cinder/cinder/service.py:237}} Aug 11 04:32:03 devstack cinder-volume[83555]: INFO cinder.volume.manager [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Aug 11 04:32:03 devstack cinder-volume[83555]: DEBUG cinder.volume.drivers.lvm [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] Updating volume stats {{(pid=83555) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 11 04:32:03 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:32:03 devstack sudo[84433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 11 04:32:03 devstack sudo[84433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:32:03 devstack sudo[84433]: pam_unix(sudo:session): session closed for user root Aug 11 04:32:03 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:32:03 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:32:03 devstack sudo[84436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 11 04:32:03 devstack sudo[84436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:32:04 devstack sudo[84436]: pam_unix(sudo:session): session closed for user root Aug 11 04:32:04 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:32:04 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:32:04 devstack sudo[84439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 11 04:32:04 devstack sudo[84439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:32:04 devstack sudo[84439]: pam_unix(sudo:session): session closed for user root Aug 11 04:32:04 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:32:04 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:32:04 devstack sudo[84442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 11 04:32:04 devstack sudo[84442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:32:04 devstack sudo[84442]: pam_unix(sudo:session): session closed for user root Aug 11 04:32:04 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:32:04 devstack cinder-volume[83555]: INFO cinder.volume.manager [None req-14e19251-4329-49f0-aec3-dbc81b2ccebb None None] Driver post RPC initialization completed successfully. Aug 11 04:32:07 devstack cinder-volume[83400]: DEBUG dbcounter [-] [83400] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=83400) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:32:13 devstack cinder-volume[83555]: DEBUG dbcounter [-] [83555] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=83555) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:32:14 devstack cinder-volume[83555]: DEBUG dbcounter [-] [83555] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=83555) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:32:42 devstack cinder-volume[83555]: DEBUG oslo_service.periodic_task [None req-9d0d9718-cebf-40c7-b6f0-3c5e68483cf9 None None] Running periodic task VolumeManager._thread_info {{(pid=83555) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 04:32:42 devstack cinder-volume[83555]: DEBUG cinder.volume.manager [None req-9d0d9718-cebf-40c7-b6f0-3c5e68483cf9 None None] thread count: 6 {{(pid=83555) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 11 04:32:42 devstack cinder-volume[83555]: DEBUG cinder.volume.manager [None req-9d0d9718-cebf-40c7-b6f0-3c5e68483cf9 None None] thread info: [<_MainThread(MainThread, started 136852036493440)>, , , , , ] {{(pid=83555) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 11 04:33:42 devstack cinder-volume[83555]: DEBUG oslo_service.periodic_task [None req-9d0d9718-cebf-40c7-b6f0-3c5e68483cf9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83555) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 04:33:42 devstack cinder-volume[83555]: DEBUG cinder.volume.drivers.lvm [None req-9d0d9718-cebf-40c7-b6f0-3c5e68483cf9 None None] Updating volume stats {{(pid=83555) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 11 04:33:42 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-9d0d9718-cebf-40c7-b6f0-3c5e68483cf9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:33:42 devstack sudo[89632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 11 04:33:42 devstack sudo[89632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:33:43 devstack sudo[89632]: pam_unix(sudo:session): session closed for user root Aug 11 04:33:43 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-9d0d9718-cebf-40c7-b6f0-3c5e68483cf9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:33:43 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-9d0d9718-cebf-40c7-b6f0-3c5e68483cf9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:33:43 devstack sudo[89635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 11 04:33:43 devstack sudo[89635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:33:43 devstack sudo[89635]: pam_unix(sudo:session): session closed for user root Aug 11 04:33:43 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-9d0d9718-cebf-40c7-b6f0-3c5e68483cf9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:33:43 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-9d0d9718-cebf-40c7-b6f0-3c5e68483cf9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:33:43 devstack sudo[89638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 11 04:33:43 devstack sudo[89638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:33:43 devstack sudo[89638]: pam_unix(sudo:session): session closed for user root Aug 11 04:33:43 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-9d0d9718-cebf-40c7-b6f0-3c5e68483cf9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.244s {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:33:43 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-9d0d9718-cebf-40c7-b6f0-3c5e68483cf9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:33:43 devstack sudo[89641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 11 04:33:43 devstack sudo[89641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:33:43 devstack sudo[89641]: pam_unix(sudo:session): session closed for user root Aug 11 04:33:43 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-9d0d9718-cebf-40c7-b6f0-3c5e68483cf9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:33:43 devstack cinder-volume[83555]: DEBUG cinder.manager [None req-9d0d9718-cebf-40c7-b6f0-3c5e68483cf9 None None] Notifying Schedulers of capabilities ... {{(pid=83555) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:33:43 devstack cinder-volume[83555]: DEBUG oslo_service.periodic_task [None req-9d0d9718-cebf-40c7-b6f0-3c5e68483cf9 None None] Running periodic task VolumeManager._thread_info {{(pid=83555) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 04:33:43 devstack cinder-volume[83555]: DEBUG cinder.volume.manager [None req-9d0d9718-cebf-40c7-b6f0-3c5e68483cf9 None None] thread count: 6 {{(pid=83555) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 11 04:33:43 devstack cinder-volume[83555]: DEBUG cinder.volume.manager [None req-9d0d9718-cebf-40c7-b6f0-3c5e68483cf9 None None] thread info: [<_MainThread(MainThread, started 136852036493440)>, , , , , ] {{(pid=83555) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 11 04:34:14 devstack cinder-volume[83555]: DEBUG dbcounter [-] [83555] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83555) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:34:42 devstack cinder-volume[83555]: DEBUG oslo_service.periodic_task [None req-9d0d9718-cebf-40c7-b6f0-3c5e68483cf9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83555) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 04:34:42 devstack cinder-volume[83555]: DEBUG cinder.volume.drivers.lvm [None req-9d0d9718-cebf-40c7-b6f0-3c5e68483cf9 None None] Updating volume stats {{(pid=83555) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 11 04:34:42 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-9d0d9718-cebf-40c7-b6f0-3c5e68483cf9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:34:42 devstack sudo[91128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 11 04:34:42 devstack sudo[91128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:34:43 devstack sudo[91128]: pam_unix(sudo:session): session closed for user root Aug 11 04:34:43 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-9d0d9718-cebf-40c7-b6f0-3c5e68483cf9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:34:43 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-9d0d9718-cebf-40c7-b6f0-3c5e68483cf9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:34:43 devstack sudo[91140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 11 04:34:43 devstack sudo[91140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:34:43 devstack sudo[91140]: pam_unix(sudo:session): session closed for user root Aug 11 04:34:43 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-9d0d9718-cebf-40c7-b6f0-3c5e68483cf9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:34:43 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-9d0d9718-cebf-40c7-b6f0-3c5e68483cf9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:34:43 devstack sudo[91143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 11 04:34:43 devstack sudo[91143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:34:43 devstack sudo[91143]: pam_unix(sudo:session): session closed for user root Aug 11 04:34:43 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-9d0d9718-cebf-40c7-b6f0-3c5e68483cf9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:34:43 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-9d0d9718-cebf-40c7-b6f0-3c5e68483cf9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:34:43 devstack sudo[91152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 11 04:34:43 devstack sudo[91152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:34:43 devstack sudo[91152]: pam_unix(sudo:session): session closed for user root Aug 11 04:34:43 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-9d0d9718-cebf-40c7-b6f0-3c5e68483cf9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:34:43 devstack cinder-volume[83555]: DEBUG cinder.manager [None req-9d0d9718-cebf-40c7-b6f0-3c5e68483cf9 None None] Notifying Schedulers of capabilities ... {{(pid=83555) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:34:43 devstack cinder-volume[83555]: DEBUG oslo_service.periodic_task [None req-9d0d9718-cebf-40c7-b6f0-3c5e68483cf9 None None] Running periodic task VolumeManager._thread_info {{(pid=83555) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 04:34:43 devstack cinder-volume[83555]: DEBUG cinder.volume.manager [None req-9d0d9718-cebf-40c7-b6f0-3c5e68483cf9 None None] thread count: 6 {{(pid=83555) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 11 04:34:43 devstack cinder-volume[83555]: DEBUG cinder.volume.manager [None req-9d0d9718-cebf-40c7-b6f0-3c5e68483cf9 None None] thread info: [<_MainThread(MainThread, started 136852036493440)>, , , , , ] {{(pid=83555) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 11 04:35:42 devstack cinder-volume[83555]: DEBUG oslo_service.periodic_task [None req-9d0d9718-cebf-40c7-b6f0-3c5e68483cf9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83555) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 04:35:42 devstack cinder-volume[83555]: DEBUG cinder.volume.drivers.lvm [None req-9d0d9718-cebf-40c7-b6f0-3c5e68483cf9 None None] Updating volume stats {{(pid=83555) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 11 04:35:42 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-9d0d9718-cebf-40c7-b6f0-3c5e68483cf9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:35:42 devstack sudo[92701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 11 04:35:42 devstack sudo[92701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:35:43 devstack sudo[92701]: pam_unix(sudo:session): session closed for user root Aug 11 04:35:43 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-9d0d9718-cebf-40c7-b6f0-3c5e68483cf9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:35:43 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-9d0d9718-cebf-40c7-b6f0-3c5e68483cf9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:35:43 devstack sudo[92705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 11 04:35:43 devstack sudo[92705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:35:43 devstack sudo[92705]: pam_unix(sudo:session): session closed for user root Aug 11 04:35:43 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-9d0d9718-cebf-40c7-b6f0-3c5e68483cf9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.305s {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:35:43 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-9d0d9718-cebf-40c7-b6f0-3c5e68483cf9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:35:43 devstack sudo[92724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 11 04:35:43 devstack sudo[92724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:35:43 devstack sudo[92724]: pam_unix(sudo:session): session closed for user root Aug 11 04:35:43 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-9d0d9718-cebf-40c7-b6f0-3c5e68483cf9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.247s {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:35:43 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-9d0d9718-cebf-40c7-b6f0-3c5e68483cf9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:35:43 devstack sudo[92727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 11 04:35:43 devstack sudo[92727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:35:43 devstack sudo[92727]: pam_unix(sudo:session): session closed for user root Aug 11 04:35:43 devstack cinder-volume[83555]: DEBUG oslo_concurrency.processutils [None req-9d0d9718-cebf-40c7-b6f0-3c5e68483cf9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.240s {{(pid=83555) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:35:43 devstack cinder-volume[83555]: DEBUG cinder.manager [None req-9d0d9718-cebf-40c7-b6f0-3c5e68483cf9 None None] Notifying Schedulers of capabilities ... {{(pid=83555) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:35:43 devstack cinder-volume[83555]: DEBUG oslo_service.periodic_task [None req-9d0d9718-cebf-40c7-b6f0-3c5e68483cf9 None None] Running periodic task VolumeManager._thread_info {{(pid=83555) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 04:35:43 devstack cinder-volume[83555]: DEBUG cinder.volume.manager [None req-9d0d9718-cebf-40c7-b6f0-3c5e68483cf9 None None] thread count: 6 {{(pid=83555) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 11 04:35:43 devstack cinder-volume[83555]: DEBUG cinder.volume.manager [None req-9d0d9718-cebf-40c7-b6f0-3c5e68483cf9 None None] thread info: [<_MainThread(MainThread, started 136852036493440)>, , , , , ] {{(pid=83555) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 11 04:36:14 devstack cinder-volume[83555]: DEBUG dbcounter [-] [83555] Writing DB stats cinder:SELECT=1 {{(pid=83555) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:36:14 devstack cinder-volume[83555]: DEBUG dbcounter [-] [83555] Writing DB stats cinder:UPDATE=1 {{(pid=83555) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:36:25 devstack cinder-volume[83400]: INFO oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] Caught SIGTERM, stopping children Aug 11 04:36:25 devstack cinder-volume[83400]: DEBUG oslo_concurrency.lockutils [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] Acquiring lock "singleton_lock" {{(pid=83400) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 11 04:36:25 devstack cinder-volume[83400]: DEBUG oslo_concurrency.lockutils [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] Acquired lock "singleton_lock" {{(pid=83400) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 11 04:36:25 devstack cinder-volume[83400]: DEBUG oslo_concurrency.lockutils [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] Releasing lock "singleton_lock" {{(pid=83400) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 11 04:36:25 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] Stop services. {{(pid=83400) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 11 04:36:25 devstack cinder-volume[83400]: DEBUG oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] Killing children. {{(pid=83400) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 11 04:36:25 devstack cinder-volume[83400]: INFO oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] Waiting on 1 children to exit Aug 11 04:36:28 devstack cinder-volume[83555]: DEBUG oslo_concurrency.lockutils [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] Acquiring lock "singleton_lock" {{(pid=83555) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 11 04:36:28 devstack cinder-volume[83555]: DEBUG oslo_concurrency.lockutils [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] Acquired lock "singleton_lock" {{(pid=83555) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 11 04:36:28 devstack cinder-volume[83555]: DEBUG oslo_concurrency.lockutils [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] Releasing lock "singleton_lock" {{(pid=83555) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 11 04:36:28 devstack cinder-volume[83555]: WARNING amqp [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 11 04:36:28 devstack cinder-volume[83555]: WARNING amqp [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 11 04:36:28 devstack cinder-volume[83400]: INFO oslo_service.backend._eventlet.service [None req-a3e4e2ef-bddd-4bfb-820b-3f5d194acc5d None None] Child 83555 exited with status 0 Aug 11 04:36:29 devstack cinder-volume[93676]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 11 04:36:29 devstack cinder-volume[93676]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 11 04:36:29 devstack cinder-volume[93676]: we strongly recommend against using it for new projects. Aug 11 04:36:29 devstack cinder-volume[93676]: If you are already using Eventlet, we recommend migrating to a different Aug 11 04:36:29 devstack cinder-volume[93676]: framework. For more detail see Aug 11 04:36:29 devstack cinder-volume[93676]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 11 04:36:29 devstack cinder-volume[93676]: import eventlet # noqa Aug 11 04:36:31 devstack cinder-volume[93676]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93676) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 11 04:36:31 devstack cinder-volume[93676]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93676) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 11 04:36:31 devstack cinder-volume[93676]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93676) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 11 04:36:31 devstack cinder-volume[93676]: INFO dbcounter [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] Registered counter for database cinder Aug 11 04:36:31 devstack cinder-volume[93676]: DEBUG oslo_db.sqlalchemy.engines [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93676) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG dbcounter [-] [93676] Writer thread running {{(pid=93676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 11 04:36:32 devstack cinder-volume[93676]: INFO cinder.rpc [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 11 04:36:32 devstack cinder-volume[93676]: INFO cinder.rpc [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_db.sqlalchemy.engines [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93676) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 11 04:36:32 devstack cinder-volume[93676]: INFO cinder.volume.manager [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] Determined volume DB was empty at startup. Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG cinder.volume.manager [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93676) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 11 04:36:32 devstack cinder-volume[93676]: INFO cinder.volume.manager [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 11 04:36:32 devstack cinder-volume[93676]: WARNING stevedore.named [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 11 04:36:32 devstack cinder-volume[93676]: WARNING castellan.key_manager [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 11 04:36:32 devstack cinder-volume[93676]: WARNING cinder.keymgr.conf_key_mgr [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 11 04:36:32 devstack cinder-volume[93676]: INFO cinder.volume.manager [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_db.sqlalchemy.engines [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93676) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 11 04:36:32 devstack cinder-volume[93676]: INFO oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] Starting 1 workers Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] Started child 93893 {{(pid=93676) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] Full set of CONF: {{(pid=93676) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] ******************************************************************************** {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3518}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] Configuration options gathered from: {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3519}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3520}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3521}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] ================================================================================ {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3526}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] allow_availability_zone_fallback = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] allow_compression_on_image_upload = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] allowed_direct_url_schemes = [] {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] api_rate_limit = True {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] auth_strategy = keystone {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_availability_zone = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_host = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_name = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93893]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_stats_polling_interval = 60 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backup_api_class = cinder.backup.api.API {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backup_name_template = backup-%s {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backup_use_same_host = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backup_use_temp_snapshot = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] chap_password = **** {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] chap_username = {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] cinder_internal_tenant_project_id = b0e11ff70ae94d7e8de6d46758f59225 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] cinder_internal_tenant_user_id = 2b1eec09f3124883be5fd13cf8921779 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] cluster = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] compression_format = gzip {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] compute_api_class = cinder.compute.nova.API {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] config_dir = [] {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] config_source = [] {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] control_exchange = openstack {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] debug = True {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] default_availability_zone = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] default_group_type = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] default_volume_type = QuobyteHD {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] disk_geometry = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] driver_client_cert = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] driver_client_cert_key = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] driver_data_namespace = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] driver_ssl_cert_path = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] driver_ssl_cert_verify = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] driver_use_ssl = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] enable_new_services = True {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] enable_unsupported_driver = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] enabled_backends = ['QuobyteHD'] {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] enforce_multipath_for_image_xfer = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] filter_function = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] glance_api_insecure = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] glance_api_servers = ['http://192.168.122.129/image'] {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] glance_api_ssl_compression = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] glance_ca_certificates_file = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] glance_catalog_info = image:glance:publicURL {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] glance_certfile = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] glance_keyfile = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] glance_num_retries = 3 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] glance_request_timeout = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] goodness_function = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] graceful_shutdown_timeout = 5 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] group_api_class = cinder.group.api.API {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] host = devstack {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] image_compress_on_upload = True {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] image_conversion_address_space_limit = 1 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] image_conversion_cpu_limit = 60 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] image_conversion_disable = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] image_upload_use_cinder_backend = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] image_upload_use_internal_tenant = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] image_volume_cache_enabled = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] image_volume_cache_max_count = 0 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] image_volume_cache_max_size_gb = 0 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] init_host_max_objects_retrieval = 0 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] instance_format = [instance: %(uuid)s] {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] iscsi_target_flags = {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] iscsi_write_cache = on {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] iser_helper = tgtadm {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] iser_ip_address = 192.168.122.129 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] iser_port = 3260 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] log_color = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] log_config_append = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] log_dir = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] log_file = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] log_options = True {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] log_rotate_interval = 1 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] log_rotate_interval_type = days {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] log_rotation_type = none {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] max_age = 0 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] max_logfile_count = 30 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] max_logfile_size_mb = 200 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] max_over_subscription_ratio = 20.0 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] message_reap_interval = 86400 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] message_ttl = 2592000 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] migration_create_volume_timeout_secs = 300 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] monkey_patch = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] monkey_patch_modules = [] {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] my_ip = 192.168.122.129 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] no_snapshot_gb_quota = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] num_iser_scan_tries = 3 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] num_shell_tries = 3 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] num_volume_device_scan_tries = 3 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] nvmeof_conn_info_version = 1 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] nvmet_ns_id = 10 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] nvmet_port_id = 1 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] osapi_max_limit = 1000 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] osapi_volume_ext_list = [] {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] osapi_volume_listen = 0.0.0.0 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] osapi_volume_listen_port = 8776 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] osapi_volume_use_ssl = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] osapi_volume_workers = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] per_volume_size_limit = -1 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] periodic_fuzzy_delay = 60 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] periodic_interval = 60 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] project_id_regex = [0-9a-f\-]+ {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] public_endpoint = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] publish_errors = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] quota_backup_gigabytes = 1000 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] quota_backups = 10 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] quota_gigabytes = 1000 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] quota_groups = 10 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] quota_snapshots = 10 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] quota_volumes = 10 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] rate_limit_burst = 0 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] rate_limit_except_level = CRITICAL {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] rate_limit_interval = 0 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] reinit_driver_count = 3 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] replication_device = **** {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] report_discard_supported = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] report_interval = 120 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] reservation_clean_interval = 86400 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] reservation_expire = 86400 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] reserved_image_namespaces = [] {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] reserved_percentage = 0 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] rpc_response_timeout = 120 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] run_external_periodic_tasks = True {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] scst_target_driver = iscsi {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] scst_target_iqn_name = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] service_down_time = 720 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] shell_completion = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] snapshot_name_template = snapshot-%s {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] split_loggers = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] state_path = /opt/stack/data/cinder {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] storage_availability_zone = nova {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] storage_protocol = iSCSI {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] syslog_log_facility = LOG_USER {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] target_helper = lioadm {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] target_ip_address = 192.168.122.129 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] target_port = 3260 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] target_protocol = iscsi {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] target_secondary_ip_addresses = [] {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] trace_flags = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] transfer_api_class = cinder.transfer.api.API {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] transport_url = **** {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] until_refresh = 0 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] use_chap_auth = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] use_default_quota_class = True {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] use_journal = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] use_json = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] use_multipath_for_image_xfer = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] use_stderr = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] use_syslog = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] verify_glance_signatures = enabled {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] volume_api_class = cinder.volume.api.API {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] volume_backend_name = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] volume_clear = zero {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] volume_clear_ionice = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] volume_clear_size = 0 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] volume_copy_bps_limit = 0 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] volume_dd_blocksize = 1M {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93893]: INFO cinder.volume.manager [None req-a0bc59df-c310-4c3e-a827-77f7609f14dd None None] Starting volume driver QuobyteDriver (1.2) Aug 11 04:36:32 devstack cinder-volume[93893]: DEBUG cinder.volume.drivers.remotefs [None req-a0bc59df-c310-4c3e-a827-77f7609f14dd None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93893) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] volume_name_template = volume-%s {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] volume_service_inithost_offload = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] volume_usage_audit_period = month {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] zoning_mode = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_concurrency.disable_process_locking = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] keystone_authtoken.auth_section = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] keystone_authtoken.auth_type = password {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] keystone_authtoken.auth_version = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] keystone_authtoken.cache = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] keystone_authtoken.certfile = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] keystone_authtoken.delay_auth_decision = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] keystone_authtoken.http_connect_timeout = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] keystone_authtoken.include_service_catalog = True {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] keystone_authtoken.insecure = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] keystone_authtoken.interface = public {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] keystone_authtoken.keyfile = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] keystone_authtoken.memcache_password = {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] keystone_authtoken.memcache_username = {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] keystone_authtoken.region_name = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] keystone_authtoken.service_token_roles_required = True {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] keystone_authtoken.service_type = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] keystone_authtoken.token_cache_time = 300 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.129/identity {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] cache.backend = dogpile.cache.null {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] cache.backend_argument = **** {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] cache.backend_expiration_time = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] cache.config_prefix = cache.oslo {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] cache.debug_cache_backend = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] cache.enable_retry_client = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] cache.enable_socket_keepalive = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] cache.enabled = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] cache.expiration_time = 600 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] cache.hashclient_retry_attempts = 2 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] cache.memcache_dead_retry = 300 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] cache.memcache_pool_maxsize = 10 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] cache.memcache_sasl_enabled = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] cache.password = **** {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] cache.proxies = [] {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] cache.redis_db = 0 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] cache.redis_sentinel_service_name = mymaster {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] cache.redis_server = localhost:6379 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] cache.retry_attempts = 2 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] cache.retry_delay = 0.0 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] cache.socket_keepalive_count = 1 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] cache.socket_keepalive_idle = 1 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] cache.socket_keepalive_interval = 1 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] cache.socket_timeout = 1.0 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] cache.tls_allowed_ciphers = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] cache.tls_cafile = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] cache.tls_certfile = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] cache.tls_enabled = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] cache.tls_keyfile = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] cache.username = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] coordination.backend_url = **** {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] database.asyncio_connection = **** {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] database.asyncio_slave_connection = **** {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] database.backend = sqlalchemy {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] database.connection = **** {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] database.connection_debug = 0 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] database.connection_parameters = {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] database.connection_recycle_time = 3600 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] database.connection_trace = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] database.db_inc_retry_interval = True {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] database.db_max_retries = 20 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] database.db_max_retry_interval = 10 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] database.db_retry_interval = 1 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] database.max_overflow = 50 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] database.max_pool_size = 5 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] database.max_retries = 10 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] database.mysql_wsrep_sync_wait = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] database.pool_timeout = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] database.retry_interval = 10 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] database.slave_connection = **** {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] database.sqlite_synchronous = True {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] database.synchronous_reader = True {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] database.use_db_reconnect = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] profiler.connection_string = messaging:// {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] profiler.enabled = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] profiler.es_doc_type = notification {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] profiler.es_scroll_size = 10000 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] profiler.es_scroll_time = 2m {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] profiler.filter_error_trace = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] profiler.hmac_keys = **** {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] profiler.sentinel_service_name = mymaster {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] profiler.socket_timeout = 0.1 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] profiler.trace_requests = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] profiler.trace_sqlalchemy = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] profiler_jaeger.process_tags = {} {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] profiler_jaeger.service_name_prefix = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] profiler_otlp.service_name_prefix = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_policy.enforce_new_defaults = True {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_policy.policy_default_rule = default {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_policy.policy_file = policy.yaml {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_policy.remote_timeout = 60.0 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] privsep_osbrick.group = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] privsep_osbrick.helper_command = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93893]: DEBUG cinder.volume.drivers.quobyte [None req-a0bc59df-c310-4c3e-a827-77f7609f14dd None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93893) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Aug 11 04:36:32 devstack cinder-volume[93893]: WARNING cinder.volume.drivers.quobyte [None req-a0bc59df-c310-4c3e-a827-77f7609f14dd None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 11 04:36:32 devstack cinder-volume[93893]: WARNING cinder.volume.drivers.quobyte [None req-a0bc59df-c310-4c3e-a827-77f7609f14dd None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] privsep_osbrick.user = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] cinder_sys_admin.group = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] cinder_sys_admin.helper_command = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93893]: DEBUG oslo_concurrency.processutils [None req-a0bc59df-c310-4c3e-a827-77f7609f14dd None None] Running cmd (subprocess): mount.quobyte {{(pid=93893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] cinder_sys_admin.user = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] service_user.auth_section = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] service_user.auth_type = password {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] service_user.cafile = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] service_user.certfile = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] service_user.collect_timing = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] service_user.insecure = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] service_user.keyfile = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] service_user.send_service_user_token = True {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] service_user.split_loggers = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] service_user.timeout = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] glance.auth_section = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] glance.auth_type = password {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] glance.certfile = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] glance.collect_timing = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] glance.insecure = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] glance.keyfile = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] glance.region_name = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] glance.split_loggers = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] glance.timeout = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.backend_availability_zone = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.chap_password = **** {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.chap_username = {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.disk_geometry = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.driver_client_cert = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.driver_client_cert_key = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.driver_data_namespace = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.driver_use_ssl = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.enable_unsupported_driver = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.extra_capabilities = {} {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.filter_function = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.goodness_function = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.iscsi_target_flags = {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.iscsi_write_cache = on {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.iser_helper = tgtadm {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.iser_ip_address = 192.168.122.129 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.iser_port = 3260 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.nas_host = {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.nas_login = admin {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.nas_mount_options = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.nas_password = **** {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.nas_private_key = {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.nas_share_path = {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.nas_ssh_port = 22 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.num_shell_tries = 3 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.nvmet_port_id = 1 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.quobyte_client_cfg = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.quobyte_volume_url = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.replication_device = **** {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.report_discard_supported = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.reserved_percentage = 0 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.scst_target_driver = iscsi {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.scst_target_iqn_name = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.storage_protocol = iSCSI {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.target_helper = tgtadm {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.target_ip_address = 192.168.122.129 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.target_port = 3260 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.target_protocol = iscsi {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.trace_flags = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.unique_fqdn_network = True {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.use_chap_auth = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.volume_backend_name = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.volume_clear = zero {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.volume_clear_ionice = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.volume_clear_size = 0 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack quobyte-client[93898]: Reading configuration file: /etc/quobyte/client.cfg Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack quobyte-client[93898]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93893]: DEBUG oslo_concurrency.processutils [None req-a0bc59df-c310-4c3e-a827-77f7609f14dd None None] CMD "mount.quobyte" returned: 1 in 0.068s {{(pid=93893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:36:32 devstack cinder-volume[93893]: DEBUG oslo_concurrency.lockutils [None req-a0bc59df-c310-4c3e-a827-77f7609f14dd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:36:32 devstack cinder-volume[93893]: DEBUG oslo_concurrency.lockutils [None req-a0bc59df-c310-4c3e-a827-77f7609f14dd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_reports.file_event_handler = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93893]: DEBUG cinder.volume.drivers.quobyte [None req-a0bc59df-c310-4c3e-a827-77f7609f14dd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=93893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_reports.log_dir = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.backend_availability_zone = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93893]: INFO cinder.volume.drivers.quobyte [None req-a0bc59df-c310-4c3e-a827-77f7609f14dd None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd ... Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.backend_host = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93893]: DEBUG oslo_concurrency.processutils [None req-a0bc59df-c310-4c3e-a827-77f7609f14dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 -c /etc/quobyte/client-cinder.cfg {{(pid=93893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.chap_password = **** {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.chap_username = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.chiscsi_conf = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.disk_geometry = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.driver_client_cert = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.driver_client_cert_key = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.driver_data_namespace = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.driver_use_ssl = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.extra_capabilities = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.filter_function = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.goodness_function = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.iscsi_target_flags = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.iscsi_write_cache = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.iser_helper = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.iser_ip_address = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.iser_port = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.iser_target_prefix = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.nas_host = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.nas_login = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.nas_mount_options = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.nas_password = **** {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.nas_private_key = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.nas_share_path = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.nas_ssh_port = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.num_shell_tries = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.nvmet_ns_id = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.nvmet_port_id = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack sudo[93899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 -c /etc/quobyte/client-cinder.cfg Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack sudo[93899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.replication_device = **** {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.report_discard_supported = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.reserved_percentage = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.scst_target_driver = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.storage_protocol = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.target_helper = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.target_ip_address = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.target_port = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.target_prefix = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.target_protocol = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.trace_flags = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.unique_fqdn_network = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.use_chap_auth = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.volume_clear = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.volume_clear_ionice = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.volume_clear_size = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] QuobyteHD.volumes_dir = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_messaging_rabbit.ssl = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_messaging_rabbit.ssl_version = {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_messaging_notifications.driver = [] {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_messaging_notifications.retry = -1 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] oslo_messaging_notifications.transport_url = **** {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] key_manager.fixed_key = **** {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] barbican.barbican_api_version = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] barbican.barbican_endpoint = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] barbican.barbican_endpoint_type = public {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] barbican.barbican_region_name = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] barbican.cafile = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] barbican.certfile = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] barbican.collect_timing = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] barbican.insecure = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] barbican.keyfile = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] barbican.number_of_retries = 60 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] barbican.retry_delay = 1 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] barbican.send_service_user_token = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] barbican.split_loggers = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] barbican.timeout = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] barbican.verify_ssl = True {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] barbican.verify_ssl_path = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] barbican_service_user.auth_section = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] barbican_service_user.auth_type = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] barbican_service_user.cafile = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] barbican_service_user.certfile = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] barbican_service_user.collect_timing = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] barbican_service_user.insecure = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] barbican_service_user.keyfile = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] barbican_service_user.split_loggers = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] barbican_service_user.timeout = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] vault.approle_role_id = **** {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] vault.approle_secret_id = **** {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] vault.auth_method = approle {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] vault.auth_path = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] vault.kv_mountpoint = secret {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] vault.kv_path = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] vault.kv_version = 2 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] vault.namespace = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] vault.root_token_id = **** {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] vault.ssl_ca_crt_file = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] vault.timeout = 60.0 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] vault.token_file = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] vault.token_role = None {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] vault.use_ssl = False {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:32 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] ******************************************************************************** {{(pid=93676) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3552}} Aug 11 04:36:33 devstack sudo[93899]: pam_unix(sudo:session): session closed for user root Aug 11 04:36:33 devstack cinder-volume[93893]: DEBUG oslo_concurrency.processutils [None req-a0bc59df-c310-4c3e-a827-77f7609f14dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.390s {{(pid=93893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:36:33 devstack cinder-volume[93893]: INFO cinder.volume.drivers.quobyte [None req-a0bc59df-c310-4c3e-a827-77f7609f14dd None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd succeeded Aug 11 04:36:33 devstack cinder-volume[93893]: DEBUG cinder.volume.drivers.quobyte [None req-a0bc59df-c310-4c3e-a827-77f7609f14dd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=93893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:36:33 devstack cinder-volume[93893]: DEBUG oslo_concurrency.lockutils [None req-a0bc59df-c310-4c3e-a827-77f7609f14dd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.403s {{(pid=93893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:36:33 devstack cinder-volume[93893]: DEBUG oslo_concurrency.processutils [None req-a0bc59df-c310-4c3e-a827-77f7609f14dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=93893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:36:33 devstack sudo[93968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:36:33 devstack sudo[93968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:36:33 devstack sudo[93968]: pam_unix(sudo:session): session closed for user root Aug 11 04:36:33 devstack cinder-volume[93893]: DEBUG oslo_concurrency.processutils [None req-a0bc59df-c310-4c3e-a827-77f7609f14dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.235s {{(pid=93893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:36:33 devstack cinder-volume[93893]: INFO cinder.volume.driver [None req-a0bc59df-c310-4c3e-a827-77f7609f14dd None None] Driver hasn't implemented _init_vendor_properties() Aug 11 04:36:33 devstack cinder-volume[93893]: DEBUG cinder.volume.driver [None req-a0bc59df-c310-4c3e-a827-77f7609f14dd None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7576522827148, 'free_capacity_gb': 1775.7576522827148, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93893) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 11 04:36:33 devstack cinder-volume[93893]: DEBUG oslo_db.sqlalchemy.engines [None req-a0bc59df-c310-4c3e-a827-77f7609f14dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93893) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 11 04:36:33 devstack cinder-volume[93893]: DEBUG dbcounter [-] [93893] Writer thread running {{(pid=93893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 11 04:36:33 devstack cinder-volume[93893]: DEBUG cinder.db.api [None req-a0bc59df-c310-4c3e-a827-77f7609f14dd None None] Building query based on filter {{(pid=93893) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 11 04:36:33 devstack cinder-volume[93893]: DEBUG cinder.image.image_utils [None req-a0bc59df-c310-4c3e-a827-77f7609f14dd None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93893) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 11 04:36:33 devstack cinder-volume[93893]: INFO cinder.keymgr.migration [None req-765db09b-0bff-4083-9a8c-385745c6bd1c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 11 04:36:33 devstack cinder-volume[93893]: DEBUG oslo_concurrency.lockutils [None req-a0bc59df-c310-4c3e-a827-77f7609f14dd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:36:33 devstack cinder-volume[93893]: DEBUG oslo_concurrency.lockutils [None req-a0bc59df-c310-4c3e-a827-77f7609f14dd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:36:33 devstack cinder-volume[93893]: DEBUG cinder.volume.drivers.quobyte [None req-a0bc59df-c310-4c3e-a827-77f7609f14dd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=93893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:36:33 devstack cinder-volume[93893]: DEBUG cinder.volume.drivers.quobyte [None req-a0bc59df-c310-4c3e-a827-77f7609f14dd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=93893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:36:33 devstack cinder-volume[93893]: DEBUG oslo_concurrency.lockutils [None req-a0bc59df-c310-4c3e-a827-77f7609f14dd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:36:33 devstack cinder-volume[93893]: DEBUG oslo_concurrency.processutils [None req-a0bc59df-c310-4c3e-a827-77f7609f14dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=93893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:36:33 devstack sudo[93972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:36:33 devstack sudo[93972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:36:33 devstack sudo[93972]: pam_unix(sudo:session): session closed for user root Aug 11 04:36:33 devstack cinder-volume[93893]: DEBUG oslo_concurrency.processutils [None req-a0bc59df-c310-4c3e-a827-77f7609f14dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.235s {{(pid=93893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:36:33 devstack cinder-volume[93893]: DEBUG cinder.manager [None req-a0bc59df-c310-4c3e-a827-77f7609f14dd None None] Notifying Schedulers of capabilities ... {{(pid=93893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:36:33 devstack cinder-volume[93893]: INFO cinder.volume.manager [None req-a0bc59df-c310-4c3e-a827-77f7609f14dd None None] Driver initialization completed successfully. Aug 11 04:36:33 devstack cinder-volume[93893]: INFO cinder.manager [None req-a0bc59df-c310-4c3e-a827-77f7609f14dd None None] Initiating service 3 cleanup Aug 11 04:36:33 devstack cinder-volume[93893]: INFO cinder.manager [None req-a0bc59df-c310-4c3e-a827-77f7609f14dd None None] Service 3 cleanup completed. Aug 11 04:36:33 devstack cinder-volume[93893]: DEBUG cinder.service [None req-a0bc59df-c310-4c3e-a827-77f7609f14dd None None] Creating RPC server for service cinder-volume {{(pid=93893) start /opt/stack/cinder/cinder/service.py:231}} Aug 11 04:36:33 devstack cinder-volume[93893]: DEBUG cinder.service [None req-a0bc59df-c310-4c3e-a827-77f7609f14dd None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93893) start /opt/stack/cinder/cinder/service.py:237}} Aug 11 04:36:34 devstack cinder-volume[93893]: INFO cinder.volume.manager [None req-a0bc59df-c310-4c3e-a827-77f7609f14dd None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Aug 11 04:36:34 devstack cinder-volume[93893]: DEBUG oslo_concurrency.lockutils [None req-a0bc59df-c310-4c3e-a827-77f7609f14dd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:36:34 devstack cinder-volume[93893]: DEBUG oslo_concurrency.lockutils [None req-a0bc59df-c310-4c3e-a827-77f7609f14dd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:36:34 devstack cinder-volume[93893]: DEBUG cinder.volume.drivers.quobyte [None req-a0bc59df-c310-4c3e-a827-77f7609f14dd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=93893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:36:34 devstack cinder-volume[93893]: DEBUG cinder.volume.drivers.quobyte [None req-a0bc59df-c310-4c3e-a827-77f7609f14dd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=93893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:36:34 devstack cinder-volume[93893]: DEBUG oslo_concurrency.lockutils [None req-a0bc59df-c310-4c3e-a827-77f7609f14dd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:36:34 devstack cinder-volume[93893]: DEBUG oslo_concurrency.processutils [None req-a0bc59df-c310-4c3e-a827-77f7609f14dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=93893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:36:34 devstack sudo[93975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:36:34 devstack sudo[93975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:36:34 devstack sudo[93975]: pam_unix(sudo:session): session closed for user root Aug 11 04:36:34 devstack cinder-volume[93893]: DEBUG oslo_concurrency.processutils [None req-a0bc59df-c310-4c3e-a827-77f7609f14dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.264s {{(pid=93893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:36:34 devstack cinder-volume[93893]: INFO cinder.volume.manager [None req-a0bc59df-c310-4c3e-a827-77f7609f14dd None None] Driver post RPC initialization completed successfully. Aug 11 04:36:34 devstack cinder-volume[93893]: DEBUG oslo_service.periodic_task [None req-1ddb3742-73b4-4842-82b2-53ddf2691544 None None] Running periodic task VolumeManager._thread_info {{(pid=93893) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 04:36:34 devstack cinder-volume[93893]: DEBUG cinder.volume.manager [None req-1ddb3742-73b4-4842-82b2-53ddf2691544 None None] thread count: 6 {{(pid=93893) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 11 04:36:34 devstack cinder-volume[93893]: DEBUG cinder.volume.manager [None req-1ddb3742-73b4-4842-82b2-53ddf2691544 None None] thread info: [<_MainThread(MainThread, started 140206898167936)>, , , , , ] {{(pid=93893) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 11 04:36:38 devstack cinder-volume[93893]: DEBUG oslo_concurrency.lockutils [None req-01028281-b9f6-4e91-81f5-cfa89377a9bc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:36:38 devstack cinder-volume[93893]: DEBUG oslo_concurrency.lockutils [None req-01028281-b9f6-4e91-81f5-cfa89377a9bc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:36:38 devstack cinder-volume[93893]: DEBUG cinder.volume.drivers.quobyte [None req-01028281-b9f6-4e91-81f5-cfa89377a9bc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=93893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:36:38 devstack cinder-volume[93893]: DEBUG cinder.volume.drivers.quobyte [None req-01028281-b9f6-4e91-81f5-cfa89377a9bc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=93893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:36:38 devstack cinder-volume[93893]: DEBUG oslo_concurrency.lockutils [None req-01028281-b9f6-4e91-81f5-cfa89377a9bc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:36:38 devstack cinder-volume[93893]: DEBUG oslo_concurrency.processutils [None req-01028281-b9f6-4e91-81f5-cfa89377a9bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=93893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:36:38 devstack sudo[94120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:36:38 devstack sudo[94120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:36:39 devstack sudo[94120]: pam_unix(sudo:session): session closed for user root Aug 11 04:36:39 devstack cinder-volume[93893]: DEBUG oslo_concurrency.processutils [None req-01028281-b9f6-4e91-81f5-cfa89377a9bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.243s {{(pid=93893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:36:39 devstack cinder-volume[93893]: DEBUG cinder.manager [None req-01028281-b9f6-4e91-81f5-cfa89377a9bc None None] Notifying Schedulers of capabilities ... {{(pid=93893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:36:39 devstack cinder-volume[93676]: INFO oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] Caught SIGTERM, stopping children Aug 11 04:36:39 devstack cinder-volume[93676]: DEBUG oslo_concurrency.lockutils [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] Acquiring lock "singleton_lock" {{(pid=93676) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 11 04:36:39 devstack cinder-volume[93676]: DEBUG oslo_concurrency.lockutils [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] Acquired lock "singleton_lock" {{(pid=93676) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 11 04:36:39 devstack cinder-volume[93676]: DEBUG oslo_concurrency.lockutils [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] Releasing lock "singleton_lock" {{(pid=93676) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 11 04:36:39 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] Stop services. {{(pid=93676) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 11 04:36:39 devstack cinder-volume[93676]: DEBUG oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] Killing children. {{(pid=93676) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 11 04:36:39 devstack cinder-volume[93676]: INFO oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] Waiting on 1 children to exit Aug 11 04:36:42 devstack cinder-volume[93893]: DEBUG oslo_concurrency.lockutils [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] Acquiring lock "singleton_lock" {{(pid=93893) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 11 04:36:42 devstack cinder-volume[93893]: DEBUG oslo_concurrency.lockutils [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] Acquired lock "singleton_lock" {{(pid=93893) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 11 04:36:42 devstack cinder-volume[93893]: DEBUG oslo_concurrency.lockutils [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] Releasing lock "singleton_lock" {{(pid=93893) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 11 04:36:42 devstack cinder-volume[93893]: WARNING amqp [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 11 04:36:42 devstack cinder-volume[93893]: WARNING amqp [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 11 04:36:42 devstack cinder-volume[93676]: INFO oslo_service.backend._eventlet.service [None req-7d2db815-681e-4c80-aa62-84fcf1487142 None None] Child 93893 exited with status 0 Aug 11 04:36:42 devstack cinder-volume[94177]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 11 04:36:42 devstack cinder-volume[94177]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 11 04:36:42 devstack cinder-volume[94177]: we strongly recommend against using it for new projects. Aug 11 04:36:42 devstack cinder-volume[94177]: If you are already using Eventlet, we recommend migrating to a different Aug 11 04:36:42 devstack cinder-volume[94177]: framework. For more detail see Aug 11 04:36:42 devstack cinder-volume[94177]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 11 04:36:42 devstack cinder-volume[94177]: import eventlet # noqa Aug 11 04:36:45 devstack cinder-volume[94177]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=94177) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 11 04:36:45 devstack cinder-volume[94177]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=94177) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 11 04:36:45 devstack cinder-volume[94177]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=94177) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 11 04:36:46 devstack cinder-volume[94177]: INFO dbcounter [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] Registered counter for database cinder Aug 11 04:36:46 devstack cinder-volume[94177]: DEBUG oslo_db.sqlalchemy.engines [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94177) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 11 04:36:46 devstack cinder-volume[94177]: DEBUG dbcounter [-] [94177] Writer thread running {{(pid=94177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 11 04:36:46 devstack cinder-volume[94177]: INFO cinder.rpc [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 11 04:36:46 devstack cinder-volume[94177]: INFO cinder.rpc [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 11 04:36:46 devstack cinder-volume[94177]: DEBUG oslo_db.sqlalchemy.engines [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94177) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 11 04:36:47 devstack cinder-volume[94177]: INFO cinder.volume.manager [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] Determined volume DB was empty at startup. Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG cinder.volume.manager [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=94177) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 11 04:36:47 devstack cinder-volume[94177]: WARNING stevedore.named [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 11 04:36:47 devstack cinder-volume[94177]: WARNING castellan.key_manager [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 11 04:36:47 devstack cinder-volume[94177]: WARNING cinder.keymgr.conf_key_mgr [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 11 04:36:47 devstack cinder-volume[94177]: INFO cinder.volume.manager [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_db.sqlalchemy.engines [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94177) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 11 04:36:47 devstack cinder-volume[94177]: INFO oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] Starting 1 workers Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] Started child 94472 {{(pid=94177) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] Full set of CONF: {{(pid=94177) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] ******************************************************************************** {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3518}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] Configuration options gathered from: {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3519}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3520}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3521}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] ================================================================================ {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3526}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] allow_availability_zone_fallback = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] allow_compression_on_image_upload = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] allowed_direct_url_schemes = [] {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] api_rate_limit = True {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] auth_strategy = keystone {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_availability_zone = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_host = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_name = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_stats_polling_interval = 60 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backup_api_class = cinder.backup.api.API {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94472]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backup_name_template = backup-%s {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backup_use_same_host = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backup_use_temp_snapshot = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] chap_password = **** {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] chap_username = {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] cinder_internal_tenant_project_id = b0e11ff70ae94d7e8de6d46758f59225 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] cinder_internal_tenant_user_id = 2b1eec09f3124883be5fd13cf8921779 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] cluster = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] compression_format = gzip {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] compute_api_class = cinder.compute.nova.API {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] config_dir = [] {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] config_source = [] {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] control_exchange = openstack {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] debug = True {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] default_availability_zone = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] default_group_type = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] default_volume_type = QuobyteHD {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] disk_geometry = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] driver_client_cert = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] driver_client_cert_key = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] driver_data_namespace = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] driver_ssl_cert_path = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] driver_ssl_cert_verify = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] driver_use_ssl = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] enable_new_services = True {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] enable_unsupported_driver = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] enabled_backends = ['QuobyteHD'] {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] enforce_multipath_for_image_xfer = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] filter_function = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] glance_api_insecure = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] glance_api_servers = ['http://192.168.122.129/image'] {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] glance_api_ssl_compression = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] glance_ca_certificates_file = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] glance_catalog_info = image:glance:publicURL {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] glance_certfile = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] glance_keyfile = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] glance_num_retries = 3 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] glance_request_timeout = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] goodness_function = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] graceful_shutdown_timeout = 5 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] group_api_class = cinder.group.api.API {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] host = devstack {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] image_compress_on_upload = True {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] image_conversion_address_space_limit = 1 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] image_conversion_cpu_limit = 60 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] image_conversion_disable = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] image_upload_use_cinder_backend = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] image_upload_use_internal_tenant = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] image_volume_cache_enabled = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] image_volume_cache_max_count = 0 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] image_volume_cache_max_size_gb = 0 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] init_host_max_objects_retrieval = 0 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] instance_format = [instance: %(uuid)s] {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] iscsi_target_flags = {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] iscsi_write_cache = on {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] iser_helper = tgtadm {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] iser_ip_address = 192.168.122.129 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] iser_port = 3260 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] log_color = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] log_config_append = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] log_dir = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] log_file = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] log_options = True {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] log_rotate_interval = 1 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] log_rotate_interval_type = days {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] log_rotation_type = none {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] max_age = 0 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] max_logfile_count = 30 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] max_logfile_size_mb = 200 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] max_over_subscription_ratio = 20.0 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] message_reap_interval = 86400 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] message_ttl = 2592000 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] migration_create_volume_timeout_secs = 300 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] monkey_patch = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] monkey_patch_modules = [] {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] my_ip = 192.168.122.129 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] no_snapshot_gb_quota = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] num_iser_scan_tries = 3 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] num_shell_tries = 3 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] num_volume_device_scan_tries = 3 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] nvmeof_conn_info_version = 1 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] nvmet_ns_id = 10 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] nvmet_port_id = 1 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] osapi_max_limit = 1000 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] osapi_volume_ext_list = [] {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] osapi_volume_listen = 0.0.0.0 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] osapi_volume_listen_port = 8776 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] osapi_volume_use_ssl = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] osapi_volume_workers = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] per_volume_size_limit = -1 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] periodic_fuzzy_delay = 60 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] periodic_interval = 60 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] project_id_regex = [0-9a-f\-]+ {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] public_endpoint = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] publish_errors = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] quota_backup_gigabytes = 1000 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] quota_backups = 10 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-f7c99197-7c8e-4f10-994a-970577d280b1 None None] Starting volume driver QuobyteDriver (1.2) Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] quota_gigabytes = 1000 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-f7c99197-7c8e-4f10-994a-970577d280b1 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=94472) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] quota_groups = 10 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] quota_snapshots = 10 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] quota_volumes = 10 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] rate_limit_burst = 0 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] rate_limit_except_level = CRITICAL {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] rate_limit_interval = 0 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] reinit_driver_count = 3 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] replication_device = **** {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] report_discard_supported = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] report_interval = 120 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] reservation_clean_interval = 86400 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] reservation_expire = 86400 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] reserved_image_namespaces = [] {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] reserved_percentage = 0 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] rpc_response_timeout = 120 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] run_external_periodic_tasks = True {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] scst_target_driver = iscsi {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] scst_target_iqn_name = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] service_down_time = 720 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] shell_completion = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] snapshot_name_template = snapshot-%s {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] split_loggers = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] state_path = /opt/stack/data/cinder {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] storage_availability_zone = nova {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] storage_protocol = iSCSI {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] syslog_log_facility = LOG_USER {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] target_helper = lioadm {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] target_ip_address = 192.168.122.129 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] target_port = 3260 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] target_protocol = iscsi {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] target_secondary_ip_addresses = [] {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] trace_flags = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] transfer_api_class = cinder.transfer.api.API {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] transport_url = **** {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] until_refresh = 0 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] use_chap_auth = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] use_default_quota_class = True {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] use_journal = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] use_json = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] use_multipath_for_image_xfer = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] use_stderr = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] use_syslog = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] verify_glance_signatures = enabled {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] volume_api_class = cinder.volume.api.API {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] volume_backend_name = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] volume_clear = zero {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] volume_clear_ionice = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] volume_clear_size = 0 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] volume_copy_bps_limit = 0 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] volume_dd_blocksize = 1M {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] volume_name_template = volume-%s {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] volume_service_inithost_offload = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] volume_usage_audit_period = month {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] zoning_mode = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_concurrency.disable_process_locking = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] keystone_authtoken.auth_section = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] keystone_authtoken.auth_type = password {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] keystone_authtoken.auth_version = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] keystone_authtoken.cache = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] keystone_authtoken.certfile = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] keystone_authtoken.delay_auth_decision = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] keystone_authtoken.http_connect_timeout = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] keystone_authtoken.include_service_catalog = True {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] keystone_authtoken.insecure = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] keystone_authtoken.interface = public {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] keystone_authtoken.keyfile = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] keystone_authtoken.memcache_password = {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] keystone_authtoken.memcache_username = {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] keystone_authtoken.region_name = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] keystone_authtoken.service_token_roles_required = True {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] keystone_authtoken.service_type = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] keystone_authtoken.token_cache_time = 300 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.129/identity {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] cache.backend = dogpile.cache.null {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] cache.backend_argument = **** {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] cache.backend_expiration_time = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] cache.config_prefix = cache.oslo {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] cache.debug_cache_backend = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] cache.enable_retry_client = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] cache.enable_socket_keepalive = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] cache.enabled = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] cache.expiration_time = 600 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] cache.hashclient_retry_attempts = 2 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] cache.memcache_dead_retry = 300 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] cache.memcache_pool_maxsize = 10 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] cache.memcache_sasl_enabled = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] cache.password = **** {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] cache.proxies = [] {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] cache.redis_db = 0 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] cache.redis_sentinel_service_name = mymaster {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] cache.redis_server = localhost:6379 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] cache.retry_attempts = 2 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] cache.retry_delay = 0.0 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] cache.socket_keepalive_count = 1 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] cache.socket_keepalive_idle = 1 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] cache.socket_keepalive_interval = 1 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] cache.socket_timeout = 1.0 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] cache.tls_allowed_ciphers = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] cache.tls_cafile = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] cache.tls_certfile = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] cache.tls_enabled = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] cache.tls_keyfile = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] cache.username = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] coordination.backend_url = **** {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] database.asyncio_connection = **** {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] database.asyncio_slave_connection = **** {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] database.backend = sqlalchemy {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] database.connection = **** {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] database.connection_debug = 0 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] database.connection_parameters = {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] database.connection_recycle_time = 3600 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] database.connection_trace = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] database.db_inc_retry_interval = True {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] database.db_max_retries = 20 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] database.db_max_retry_interval = 10 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] database.db_retry_interval = 1 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] database.max_overflow = 50 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] database.max_pool_size = 5 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] database.max_retries = 10 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] database.mysql_wsrep_sync_wait = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] database.pool_timeout = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] database.retry_interval = 10 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] database.slave_connection = **** {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] database.sqlite_synchronous = True {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] database.synchronous_reader = True {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] database.use_db_reconnect = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] profiler.connection_string = messaging:// {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] profiler.enabled = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] profiler.es_doc_type = notification {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] profiler.es_scroll_size = 10000 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] profiler.es_scroll_time = 2m {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] profiler.filter_error_trace = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] profiler.hmac_keys = **** {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] profiler.sentinel_service_name = mymaster {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] profiler.socket_timeout = 0.1 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] profiler.trace_requests = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] profiler.trace_sqlalchemy = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] profiler_jaeger.process_tags = {} {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] profiler_jaeger.service_name_prefix = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] profiler_otlp.service_name_prefix = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_policy.enforce_new_defaults = True {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_policy.policy_default_rule = default {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_policy.policy_file = policy.yaml {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_policy.remote_timeout = 60.0 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] privsep_osbrick.group = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] privsep_osbrick.helper_command = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] privsep_osbrick.user = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] cinder_sys_admin.group = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] cinder_sys_admin.helper_command = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] cinder_sys_admin.user = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] service_user.auth_section = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] service_user.auth_type = password {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] service_user.cafile = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] service_user.certfile = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] service_user.collect_timing = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] service_user.insecure = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] service_user.keyfile = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] service_user.send_service_user_token = True {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] service_user.split_loggers = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] service_user.timeout = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] glance.auth_section = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] glance.auth_type = password {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f7c99197-7c8e-4f10-994a-970577d280b1 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=94472) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Aug 11 04:36:47 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.quobyte [None req-f7c99197-7c8e-4f10-994a-970577d280b1 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 11 04:36:47 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.quobyte [None req-f7c99197-7c8e-4f10-994a-970577d280b1 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] glance.certfile = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] glance.collect_timing = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] glance.insecure = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] glance.keyfile = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f7c99197-7c8e-4f10-994a-970577d280b1 None None] Running cmd (subprocess): mount.quobyte {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] glance.region_name = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] glance.split_loggers = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] glance.timeout = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.backend_availability_zone = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.chap_password = **** {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.chap_username = {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.disk_geometry = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.driver_client_cert = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.driver_client_cert_key = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.driver_data_namespace = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.driver_use_ssl = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.enable_unsupported_driver = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.extra_capabilities = {} {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.filter_function = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.goodness_function = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.iscsi_target_flags = {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.iscsi_write_cache = on {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.iser_helper = tgtadm {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.iser_ip_address = 192.168.122.129 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.iser_port = 3260 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.nas_host = {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.nas_login = admin {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.nas_mount_options = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.nas_password = **** {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.nas_private_key = {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.nas_share_path = {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.nas_ssh_port = 22 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.num_shell_tries = 3 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.nvmet_port_id = 1 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.quobyte_client_cfg = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.quobyte_volume_url = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.replication_device = **** {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.report_discard_supported = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.reserved_percentage = 0 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.scst_target_driver = iscsi {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.scst_target_iqn_name = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.storage_protocol = iSCSI {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.target_helper = tgtadm {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.target_ip_address = 192.168.122.129 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.target_port = 3260 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.target_protocol = iscsi {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.trace_flags = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.unique_fqdn_network = True {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.use_chap_auth = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.volume_backend_name = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.volume_clear = zero {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.volume_clear_ionice = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.volume_clear_size = 0 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_reports.file_event_handler = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_reports.log_dir = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.backend_availability_zone = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.backend_host = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.chap_password = **** {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.chap_username = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.chiscsi_conf = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.disk_geometry = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.driver_client_cert = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.driver_client_cert_key = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.driver_data_namespace = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.driver_use_ssl = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.extra_capabilities = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.filter_function = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.goodness_function = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.iscsi_target_flags = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.iscsi_write_cache = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.iser_helper = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.iser_ip_address = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.iser_port = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.iser_target_prefix = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.nas_host = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.nas_login = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.nas_mount_options = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.nas_password = **** {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.nas_private_key = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.nas_share_path = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.nas_ssh_port = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.num_shell_tries = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.nvmet_ns_id = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.nvmet_port_id = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.replication_device = **** {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.report_discard_supported = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.reserved_percentage = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.scst_target_driver = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.storage_protocol = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.target_helper = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.target_ip_address = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.target_port = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.target_prefix = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.target_protocol = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.trace_flags = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.unique_fqdn_network = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.use_chap_auth = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.volume_clear = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.volume_clear_ionice = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.volume_clear_size = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] QuobyteHD.volumes_dir = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_messaging_rabbit.ssl = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_messaging_rabbit.ssl_version = {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_messaging_notifications.driver = [] {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_messaging_notifications.retry = -1 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] key_manager.fixed_key = **** {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] barbican.barbican_api_version = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] barbican.barbican_endpoint = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] barbican.barbican_endpoint_type = public {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] barbican.barbican_region_name = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] barbican.cafile = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] barbican.certfile = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] barbican.collect_timing = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] barbican.insecure = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] barbican.keyfile = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] barbican.number_of_retries = 60 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] barbican.retry_delay = 1 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] barbican.send_service_user_token = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] barbican.split_loggers = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] barbican.timeout = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] barbican.verify_ssl = True {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] barbican.verify_ssl_path = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] barbican_service_user.auth_section = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] barbican_service_user.auth_type = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] barbican_service_user.cafile = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] barbican_service_user.certfile = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] barbican_service_user.collect_timing = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] barbican_service_user.insecure = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] barbican_service_user.keyfile = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] barbican_service_user.split_loggers = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] barbican_service_user.timeout = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] vault.approle_role_id = **** {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] vault.approle_secret_id = **** {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack quobyte-client[94473]: Reading configuration file: /etc/quobyte/client.cfg Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] vault.auth_method = approle {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] vault.auth_path = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] vault.kv_mountpoint = secret {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] vault.kv_path = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] vault.kv_version = 2 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] vault.namespace = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] vault.root_token_id = **** {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack quobyte-client[94473]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] vault.ssl_ca_crt_file = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] vault.timeout = 60.0 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] vault.token_file = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] vault.token_role = None {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] vault.use_ssl = False {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 04:36:47 devstack cinder-volume[94177]: DEBUG oslo_service.backend._eventlet.service [None req-caff0915-2c45-42fc-b16e-053e1751b3b3 None None] ******************************************************************************** {{(pid=94177) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3552}} Aug 11 04:36:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f7c99197-7c8e-4f10-994a-970577d280b1 None None] CMD "mount.quobyte" returned: 1 in 0.106s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:36:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f7c99197-7c8e-4f10-994a-970577d280b1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:36:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f7c99197-7c8e-4f10-994a-970577d280b1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:36:47 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f7c99197-7c8e-4f10-994a-970577d280b1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:36:47 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f7c99197-7c8e-4f10-994a-970577d280b1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:36:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f7c99197-7c8e-4f10-994a-970577d280b1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:36:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f7c99197-7c8e-4f10-994a-970577d280b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:36:47 devstack sudo[94482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:36:47 devstack sudo[94482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:36:47 devstack sudo[94482]: pam_unix(sudo:session): session closed for user root Aug 11 04:36:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f7c99197-7c8e-4f10-994a-970577d280b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.236s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:36:47 devstack cinder-volume[94472]: INFO cinder.volume.driver [None req-f7c99197-7c8e-4f10-994a-970577d280b1 None None] Driver hasn't implemented _init_vendor_properties() Aug 11 04:36:47 devstack cinder-volume[94472]: DEBUG cinder.volume.driver [None req-f7c99197-7c8e-4f10-994a-970577d280b1 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7576522827148, 'free_capacity_gb': 1775.7576522827148, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94472) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 11 04:36:47 devstack cinder-volume[94472]: DEBUG oslo_db.sqlalchemy.engines [None req-f7c99197-7c8e-4f10-994a-970577d280b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94472) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 11 04:36:47 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writer thread running {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 11 04:36:47 devstack cinder-volume[94472]: DEBUG cinder.db.api [None req-f7c99197-7c8e-4f10-994a-970577d280b1 None None] Building query based on filter {{(pid=94472) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 11 04:36:47 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-f7c99197-7c8e-4f10-994a-970577d280b1 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=94472) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 11 04:36:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f7c99197-7c8e-4f10-994a-970577d280b1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:36:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f7c99197-7c8e-4f10-994a-970577d280b1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:36:47 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f7c99197-7c8e-4f10-994a-970577d280b1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:36:47 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f7c99197-7c8e-4f10-994a-970577d280b1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:36:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f7c99197-7c8e-4f10-994a-970577d280b1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:36:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f7c99197-7c8e-4f10-994a-970577d280b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:36:47 devstack cinder-volume[94472]: INFO cinder.keymgr.migration [None req-85d7d00d-71ac-4b79-a592-664ac89ed2b9 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 11 04:36:47 devstack sudo[94493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:36:47 devstack sudo[94493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:36:48 devstack sudo[94493]: pam_unix(sudo:session): session closed for user root Aug 11 04:36:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f7c99197-7c8e-4f10-994a-970577d280b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.237s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:36:48 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-f7c99197-7c8e-4f10-994a-970577d280b1 None None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:36:48 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-f7c99197-7c8e-4f10-994a-970577d280b1 None None] Driver initialization completed successfully. Aug 11 04:36:48 devstack cinder-volume[94472]: INFO cinder.manager [None req-f7c99197-7c8e-4f10-994a-970577d280b1 None None] Initiating service 3 cleanup Aug 11 04:36:48 devstack cinder-volume[94472]: INFO cinder.manager [None req-f7c99197-7c8e-4f10-994a-970577d280b1 None None] Service 3 cleanup completed. Aug 11 04:36:48 devstack cinder-volume[94472]: DEBUG cinder.service [None req-f7c99197-7c8e-4f10-994a-970577d280b1 None None] Creating RPC server for service cinder-volume {{(pid=94472) start /opt/stack/cinder/cinder/service.py:231}} Aug 11 04:36:48 devstack cinder-volume[94472]: DEBUG cinder.service [None req-f7c99197-7c8e-4f10-994a-970577d280b1 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=94472) start /opt/stack/cinder/cinder/service.py:237}} Aug 11 04:36:48 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-f7c99197-7c8e-4f10-994a-970577d280b1 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Aug 11 04:36:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f7c99197-7c8e-4f10-994a-970577d280b1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:36:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f7c99197-7c8e-4f10-994a-970577d280b1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:36:48 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f7c99197-7c8e-4f10-994a-970577d280b1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:36:48 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f7c99197-7c8e-4f10-994a-970577d280b1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:36:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f7c99197-7c8e-4f10-994a-970577d280b1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:36:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f7c99197-7c8e-4f10-994a-970577d280b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:36:48 devstack sudo[94504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:36:48 devstack sudo[94504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:36:48 devstack sudo[94504]: pam_unix(sudo:session): session closed for user root Aug 11 04:36:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f7c99197-7c8e-4f10-994a-970577d280b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.254s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:36:48 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-f7c99197-7c8e-4f10-994a-970577d280b1 None None] Driver post RPC initialization completed successfully. Aug 11 04:36:57 devstack cinder-volume[94177]: DEBUG dbcounter [-] [94177] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=94177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:36:58 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=2 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:36:58 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:36:58 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running periodic task VolumeManager._thread_info {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 04:36:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] thread count: 6 {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 11 04:36:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] thread info: [<_MainThread(MainThread, started 133315846115456)>, , , , , ] {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 11 04:37:58 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 04:37:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:37:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:37:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:37:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:37:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:37:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:37:58 devstack sudo[95198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:37:58 devstack sudo[95198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:37:59 devstack sudo[95198]: pam_unix(sudo:session): session closed for user root Aug 11 04:37:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.723s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:37:59 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:37:59 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running periodic task VolumeManager._thread_info {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 04:37:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] thread count: 6 {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 11 04:37:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] thread info: [<_MainThread(MainThread, started 133315846115456)>, , , , , ] {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 11 04:38:02 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b9c8aaa-f070-48d2-bc8c-2bb84a890f41 tempest-DeleteServersTestJSON-751150030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:38:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8b9c8aaa-f070-48d2-bc8c-2bb84a890f41 tempest-DeleteServersTestJSON-751150030 None] Flow 'volume_create_manager' (1aadf9bb-427d-41d8-92b6-56111d911c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:38:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8b9c8aaa-f070-48d2-bc8c-2bb84a890f41 tempest-DeleteServersTestJSON-751150030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86f84615-acb8-4448-bb65-8418e9e03a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:38:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8b9c8aaa-f070-48d2-bc8c-2bb84a890f41 tempest-DeleteServersTestJSON-751150030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86f84615-acb8-4448-bb65-8418e9e03a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-728895825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7c96449-a4b6-4ca9-8d0f-7437cc90804b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b5f80b5e51e48e19c19f01d55270fca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:38:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:38:02Z,use_quota=True,user_id='ffb8d2a1e8b44bff87028abec4261efe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:38:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8b9c8aaa-f070-48d2-bc8c-2bb84a890f41 tempest-DeleteServersTestJSON-751150030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6684dea4-21e7-461c-829e-7ea2722caac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:38:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8b9c8aaa-f070-48d2-bc8c-2bb84a890f41 tempest-DeleteServersTestJSON-751150030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6684dea4-21e7-461c-829e-7ea2722caac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:38:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8b9c8aaa-f070-48d2-bc8c-2bb84a890f41 tempest-DeleteServersTestJSON-751150030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dc2ef3f-2423-4c8d-85c9-64228fd4e50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:38:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8b9c8aaa-f070-48d2-bc8c-2bb84a890f41 tempest-DeleteServersTestJSON-751150030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dc2ef3f-2423-4c8d-85c9-64228fd4e50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7c96449-a4b6-4ca9-8d0f-7437cc90804b', 'volume_name': 'volume-e7c96449-a4b6-4ca9-8d0f-7437cc90804b', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:38:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8b9c8aaa-f070-48d2-bc8c-2bb84a890f41 tempest-DeleteServersTestJSON-751150030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f20252eb-9a56-47ab-b027-c58956ab535c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:38:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8b9c8aaa-f070-48d2-bc8c-2bb84a890f41 tempest-DeleteServersTestJSON-751150030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f20252eb-9a56-47ab-b027-c58956ab535c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:38:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8b9c8aaa-f070-48d2-bc8c-2bb84a890f41 tempest-DeleteServersTestJSON-751150030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f005ff2-5b6d-450e-a54c-1e9f52f952f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:38:02 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-8b9c8aaa-f070-48d2-bc8c-2bb84a890f41 tempest-DeleteServersTestJSON-751150030 None] Volume e7c96449-a4b6-4ca9-8d0f-7437cc90804b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7c96449-a4b6-4ca9-8d0f-7437cc90804b', 'volume_size': 1} Aug 11 04:38:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8b9c8aaa-f070-48d2-bc8c-2bb84a890f41 tempest-DeleteServersTestJSON-751150030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:38:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8b9c8aaa-f070-48d2-bc8c-2bb84a890f41 tempest-DeleteServersTestJSON-751150030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:38:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-8b9c8aaa-f070-48d2-bc8c-2bb84a890f41 tempest-DeleteServersTestJSON-751150030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-728895825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7c96449-a4b6-4ca9-8d0f-7437cc90804b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b5f80b5e51e48e19c19f01d55270fca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:38:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:38:02Z,use_quota=True,user_id='ffb8d2a1e8b44bff87028abec4261efe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:38:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-8b9c8aaa-f070-48d2-bc8c-2bb84a890f41 tempest-DeleteServersTestJSON-751150030 None] Creating volume e7c96449-a4b6-4ca9-8d0f-7437cc90804b {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:38:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8b9c8aaa-f070-48d2-bc8c-2bb84a890f41 tempest-DeleteServersTestJSON-751150030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:38:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8b9c8aaa-f070-48d2-bc8c-2bb84a890f41 tempest-DeleteServersTestJSON-751150030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:38:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-8b9c8aaa-f070-48d2-bc8c-2bb84a890f41 tempest-DeleteServersTestJSON-751150030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:38:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-8b9c8aaa-f070-48d2-bc8c-2bb84a890f41 tempest-DeleteServersTestJSON-751150030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:38:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8b9c8aaa-f070-48d2-bc8c-2bb84a890f41 tempest-DeleteServersTestJSON-751150030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:38:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-8b9c8aaa-f070-48d2-bc8c-2bb84a890f41 tempest-DeleteServersTestJSON-751150030 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:38:02 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-8b9c8aaa-f070-48d2-bc8c-2bb84a890f41 tempest-DeleteServersTestJSON-751150030 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:38:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8b9c8aaa-f070-48d2-bc8c-2bb84a890f41 tempest-DeleteServersTestJSON-751150030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e7c96449-a4b6-4ca9-8d0f-7437cc90804b 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:38:03 devstack sudo[95298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e7c96449-a4b6-4ca9-8d0f-7437cc90804b 1073741824 Aug 11 04:38:03 devstack sudo[95298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:38:04 devstack sudo[95298]: pam_unix(sudo:session): session closed for user root Aug 11 04:38:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8b9c8aaa-f070-48d2-bc8c-2bb84a890f41 tempest-DeleteServersTestJSON-751150030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e7c96449-a4b6-4ca9-8d0f-7437cc90804b 1073741824" returned: 0 in 1.727s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:38:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8b9c8aaa-f070-48d2-bc8c-2bb84a890f41 tempest-DeleteServersTestJSON-751150030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e7c96449-a4b6-4ca9-8d0f-7437cc90804b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:38:04 devstack sudo[95649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e7c96449-a4b6-4ca9-8d0f-7437cc90804b Aug 11 04:38:04 devstack sudo[95649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:38:05 devstack sudo[95649]: pam_unix(sudo:session): session closed for user root Aug 11 04:38:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8b9c8aaa-f070-48d2-bc8c-2bb84a890f41 tempest-DeleteServersTestJSON-751150030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e7c96449-a4b6-4ca9-8d0f-7437cc90804b" returned: 0 in 0.695s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:38:05 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-8b9c8aaa-f070-48d2-bc8c-2bb84a890f41 tempest-DeleteServersTestJSON-751150030 None] <== create_volume: return (2651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:38:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8b9c8aaa-f070-48d2-bc8c-2bb84a890f41 tempest-DeleteServersTestJSON-751150030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.662s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:38:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8b9c8aaa-f070-48d2-bc8c-2bb84a890f41 tempest-DeleteServersTestJSON-751150030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f005ff2-5b6d-450e-a54c-1e9f52f952f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7c96449-a4b6-4ca9-8d0f-7437cc90804b', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:38:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8b9c8aaa-f070-48d2-bc8c-2bb84a890f41 tempest-DeleteServersTestJSON-751150030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c392b33-ce9f-4d8f-86bf-d6072117a828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:38:05 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-8b9c8aaa-f070-48d2-bc8c-2bb84a890f41 tempest-DeleteServersTestJSON-751150030 None] Volume volume-e7c96449-a4b6-4ca9-8d0f-7437cc90804b (e7c96449-a4b6-4ca9-8d0f-7437cc90804b): created successfully Aug 11 04:38:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8b9c8aaa-f070-48d2-bc8c-2bb84a890f41 tempest-DeleteServersTestJSON-751150030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c392b33-ce9f-4d8f-86bf-d6072117a828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:38:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8b9c8aaa-f070-48d2-bc8c-2bb84a890f41 tempest-DeleteServersTestJSON-751150030 None] Flow 'volume_create_manager' (1aadf9bb-427d-41d8-92b6-56111d911c6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:38:05 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-8b9c8aaa-f070-48d2-bc8c-2bb84a890f41 tempest-DeleteServersTestJSON-751150030 None] Created volume successfully. Aug 11 04:38:07 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-635cf8d8-dfab-43aa-98d2-43b8eb7b3ef4 tempest-VolumesAdminNegativeTest-1912040958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:38:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-635cf8d8-dfab-43aa-98d2-43b8eb7b3ef4 tempest-VolumesAdminNegativeTest-1912040958 None] Flow 'volume_create_manager' (e753a689-86b9-484b-ab1c-d0aba0edc4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:38:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-635cf8d8-dfab-43aa-98d2-43b8eb7b3ef4 tempest-VolumesAdminNegativeTest-1912040958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21026905-cef2-4ea3-810a-86c07630482a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:38:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-635cf8d8-dfab-43aa-98d2-43b8eb7b3ef4 tempest-VolumesAdminNegativeTest-1912040958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21026905-cef2-4ea3-810a-86c07630482a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-388962176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ea3a35e-670f-4d60-99a9-7ef8bb7592f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efb8fff5132b418d8a4236548956d70c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:38:08Z,use_quota=True,user_id='90ddddedef74441784334b8885ec4866',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:38:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-635cf8d8-dfab-43aa-98d2-43b8eb7b3ef4 tempest-VolumesAdminNegativeTest-1912040958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81fab201-a097-40ce-81ea-c870cbe7a6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:38:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-635cf8d8-dfab-43aa-98d2-43b8eb7b3ef4 tempest-VolumesAdminNegativeTest-1912040958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81fab201-a097-40ce-81ea-c870cbe7a6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:38:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-635cf8d8-dfab-43aa-98d2-43b8eb7b3ef4 tempest-VolumesAdminNegativeTest-1912040958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1f3e772-297a-44dd-8da6-97ac70a685e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:38:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-635cf8d8-dfab-43aa-98d2-43b8eb7b3ef4 tempest-VolumesAdminNegativeTest-1912040958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1f3e772-297a-44dd-8da6-97ac70a685e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ea3a35e-670f-4d60-99a9-7ef8bb7592f2', 'volume_name': 'volume-3ea3a35e-670f-4d60-99a9-7ef8bb7592f2', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:38:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-635cf8d8-dfab-43aa-98d2-43b8eb7b3ef4 tempest-VolumesAdminNegativeTest-1912040958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e68f25c8-e283-46d1-990f-2f11a5708279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:38:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-635cf8d8-dfab-43aa-98d2-43b8eb7b3ef4 tempest-VolumesAdminNegativeTest-1912040958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e68f25c8-e283-46d1-990f-2f11a5708279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:38:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-635cf8d8-dfab-43aa-98d2-43b8eb7b3ef4 tempest-VolumesAdminNegativeTest-1912040958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23b843d3-5c94-4d83-8814-536cdfc5883a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:38:07 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-635cf8d8-dfab-43aa-98d2-43b8eb7b3ef4 tempest-VolumesAdminNegativeTest-1912040958 None] Volume 3ea3a35e-670f-4d60-99a9-7ef8bb7592f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ea3a35e-670f-4d60-99a9-7ef8bb7592f2', 'volume_size': 1} Aug 11 04:38:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-635cf8d8-dfab-43aa-98d2-43b8eb7b3ef4 tempest-VolumesAdminNegativeTest-1912040958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:38:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-635cf8d8-dfab-43aa-98d2-43b8eb7b3ef4 tempest-VolumesAdminNegativeTest-1912040958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:38:07 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-635cf8d8-dfab-43aa-98d2-43b8eb7b3ef4 tempest-VolumesAdminNegativeTest-1912040958 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-388962176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ea3a35e-670f-4d60-99a9-7ef8bb7592f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efb8fff5132b418d8a4236548956d70c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:38:08Z,use_quota=True,user_id='90ddddedef74441784334b8885ec4866',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:38:07 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-635cf8d8-dfab-43aa-98d2-43b8eb7b3ef4 tempest-VolumesAdminNegativeTest-1912040958 None] Creating volume 3ea3a35e-670f-4d60-99a9-7ef8bb7592f2 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:38:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-635cf8d8-dfab-43aa-98d2-43b8eb7b3ef4 tempest-VolumesAdminNegativeTest-1912040958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:38:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-635cf8d8-dfab-43aa-98d2-43b8eb7b3ef4 tempest-VolumesAdminNegativeTest-1912040958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:38:07 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-635cf8d8-dfab-43aa-98d2-43b8eb7b3ef4 tempest-VolumesAdminNegativeTest-1912040958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:38:07 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-635cf8d8-dfab-43aa-98d2-43b8eb7b3ef4 tempest-VolumesAdminNegativeTest-1912040958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:38:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-635cf8d8-dfab-43aa-98d2-43b8eb7b3ef4 tempest-VolumesAdminNegativeTest-1912040958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:38:07 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-635cf8d8-dfab-43aa-98d2-43b8eb7b3ef4 tempest-VolumesAdminNegativeTest-1912040958 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:38:07 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-635cf8d8-dfab-43aa-98d2-43b8eb7b3ef4 tempest-VolumesAdminNegativeTest-1912040958 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:38:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-635cf8d8-dfab-43aa-98d2-43b8eb7b3ef4 tempest-VolumesAdminNegativeTest-1912040958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3ea3a35e-670f-4d60-99a9-7ef8bb7592f2 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:38:07 devstack sudo[95665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3ea3a35e-670f-4d60-99a9-7ef8bb7592f2 1073741824 Aug 11 04:38:07 devstack sudo[95665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:38:09 devstack sudo[95665]: pam_unix(sudo:session): session closed for user root Aug 11 04:38:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-635cf8d8-dfab-43aa-98d2-43b8eb7b3ef4 tempest-VolumesAdminNegativeTest-1912040958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3ea3a35e-670f-4d60-99a9-7ef8bb7592f2 1073741824" returned: 0 in 1.247s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:38:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-635cf8d8-dfab-43aa-98d2-43b8eb7b3ef4 tempest-VolumesAdminNegativeTest-1912040958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3ea3a35e-670f-4d60-99a9-7ef8bb7592f2 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:38:09 devstack sudo[95671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3ea3a35e-670f-4d60-99a9-7ef8bb7592f2 Aug 11 04:38:09 devstack sudo[95671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:38:09 devstack sudo[95671]: pam_unix(sudo:session): session closed for user root Aug 11 04:38:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-635cf8d8-dfab-43aa-98d2-43b8eb7b3ef4 tempest-VolumesAdminNegativeTest-1912040958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3ea3a35e-670f-4d60-99a9-7ef8bb7592f2" returned: 0 in 0.572s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:38:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-635cf8d8-dfab-43aa-98d2-43b8eb7b3ef4 tempest-VolumesAdminNegativeTest-1912040958 None] <== create_volume: return (1930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:38:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-635cf8d8-dfab-43aa-98d2-43b8eb7b3ef4 tempest-VolumesAdminNegativeTest-1912040958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.941s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:38:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-635cf8d8-dfab-43aa-98d2-43b8eb7b3ef4 tempest-VolumesAdminNegativeTest-1912040958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23b843d3-5c94-4d83-8814-536cdfc5883a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ea3a35e-670f-4d60-99a9-7ef8bb7592f2', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:38:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-635cf8d8-dfab-43aa-98d2-43b8eb7b3ef4 tempest-VolumesAdminNegativeTest-1912040958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fe4e19c-0b3a-4216-ad9c-83d05a8472c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:38:09 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-635cf8d8-dfab-43aa-98d2-43b8eb7b3ef4 tempest-VolumesAdminNegativeTest-1912040958 None] Volume volume-3ea3a35e-670f-4d60-99a9-7ef8bb7592f2 (3ea3a35e-670f-4d60-99a9-7ef8bb7592f2): created successfully Aug 11 04:38:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-635cf8d8-dfab-43aa-98d2-43b8eb7b3ef4 tempest-VolumesAdminNegativeTest-1912040958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fe4e19c-0b3a-4216-ad9c-83d05a8472c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:38:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-635cf8d8-dfab-43aa-98d2-43b8eb7b3ef4 tempest-VolumesAdminNegativeTest-1912040958 None] Flow 'volume_create_manager' (e753a689-86b9-484b-ab1c-d0aba0edc4f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:38:10 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-635cf8d8-dfab-43aa-98d2-43b8eb7b3ef4 tempest-VolumesAdminNegativeTest-1912040958 None] Created volume successfully. Aug 11 04:38:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4912d540-03eb-4502-9003-b62118d9c8b9 tempest-VolumesAdminNegativeTest-1912040958 None] Acquiring lock "cinder-3ea3a35e-670f-4d60-99a9-7ef8bb7592f2-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:38:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4912d540-03eb-4502-9003-b62118d9c8b9 tempest-VolumesAdminNegativeTest-1912040958 None] Lock "cinder-3ea3a35e-670f-4d60-99a9-7ef8bb7592f2-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:38:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4912d540-03eb-4502-9003-b62118d9c8b9 tempest-VolumesAdminNegativeTest-1912040958 None] Acquiring lock "cinder-quobyte-3ea3a35e-670f-4d60-99a9-7ef8bb7592f2" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:38:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4912d540-03eb-4502-9003-b62118d9c8b9 tempest-VolumesAdminNegativeTest-1912040958 None] Lock "cinder-quobyte-3ea3a35e-670f-4d60-99a9-7ef8bb7592f2" acquired by "delete_volume" :: waited 0.032s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:38:11 devstack cinder-volume[94472]: INFO oslo.privsep.daemon [None req-4912d540-03eb-4502-9003-b62118d9c8b9 tempest-VolumesAdminNegativeTest-1912040958 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpnmuob_ne/privsep.sock'] Aug 11 04:38:11 devstack sudo[95701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpnmuob_ne/privsep.sock Aug 11 04:38:11 devstack sudo[95701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:38:12 devstack cinder-volume[94472]: WARNING py.warnings [req-14399ab3-5376-4c33-a313-19261174ddfe req-992a640c-607f-4075-b788-439dcccdcdd6 tempest-DeleteServersTestJSON-751150030 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Aug 11 04:38:12 devstack cinder-volume[94472]: .first() Aug 11 04:38:12 devstack cinder-volume[94472]: Aug 11 04:38:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-14399ab3-5376-4c33-a313-19261174ddfe req-992a640c-607f-4075-b788-439dcccdcdd6 tempest-DeleteServersTestJSON-751150030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:38:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-14399ab3-5376-4c33-a313-19261174ddfe req-992a640c-607f-4075-b788-439dcccdcdd6 tempest-DeleteServersTestJSON-751150030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:38:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-14399ab3-5376-4c33-a313-19261174ddfe req-992a640c-607f-4075-b788-439dcccdcdd6 tempest-DeleteServersTestJSON-751150030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:38:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-14399ab3-5376-4c33-a313-19261174ddfe req-992a640c-607f-4075-b788-439dcccdcdd6 tempest-DeleteServersTestJSON-751150030 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd', 'name': 'volume-e7c96449-a4b6-4ca9-8d0f-7437cc90804b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6928a5d3-b365-4e07-ae5c-b14a88215b88', 'enforce_multipath': True} {{(pid=94472) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 11 04:38:12 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-14399ab3-5376-4c33-a313-19261174ddfe req-992a640c-607f-4075-b788-439dcccdcdd6 tempest-DeleteServersTestJSON-751150030 None] attachment_update completed successfully. Aug 11 04:38:13 devstack cinder-volume[94472]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Aug 11 04:38:13 devstack cinder-volume[94472]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 11 04:38:13 devstack cinder-volume[94472]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Aug 11 04:38:13 devstack cinder-volume[94472]: WARNING oslo.privsep.daemon [-] privsep log: Aug 11 04:38:13 devstack cinder-volume[94472]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Aug 11 04:38:13 devstack cinder-volume[94472]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Aug 11 04:38:13 devstack cinder-volume[94472]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 11 04:38:13 devstack cinder-volume[94472]: WARNING oslo.privsep.daemon [-] privsep log: Aug 11 04:38:13 devstack cinder-volume[94472]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Aug 11 04:38:13 devstack sudo[95701]: pam_unix(sudo:session): session closed for user root Aug 11 04:38:13 devstack cinder-volume[94472]: INFO oslo.privsep.daemon [None req-4912d540-03eb-4502-9003-b62118d9c8b9 tempest-VolumesAdminNegativeTest-1912040958 None] Spawned new privsep daemon via rootwrap Aug 11 04:38:13 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [None req-4912d540-03eb-4502-9003-b62118d9c8b9 tempest-VolumesAdminNegativeTest-1912040958 None] Accepted privsep connection to /tmp/tmpnmuob_ne/privsep.sock {{(pid=94472) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Aug 11 04:38:13 devstack cinder-volume[94472]: INFO oslo.privsep.daemon [-] privsep daemon starting Aug 11 04:38:13 devstack cinder-volume[94472]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Aug 11 04:38:13 devstack cinder-volume[94472]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Aug 11 04:38:13 devstack cinder-volume[94472]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 95794 Aug 11 04:38:13 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9e7f17-a089-40a0-b19d-748c5d26ff13]: (2,) {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:38:13 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fdbf0b0-10fc-4bbb-991a-a5895d0c2df6]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:38:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4912d540-03eb-4502-9003-b62118d9c8b9 tempest-VolumesAdminNegativeTest-1912040958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3ea3a35e-670f-4d60-99a9-7ef8bb7592f2 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:38:13 devstack sudo[96114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3ea3a35e-670f-4d60-99a9-7ef8bb7592f2 Aug 11 04:38:13 devstack sudo[96114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:38:14 devstack sudo[96114]: pam_unix(sudo:session): session closed for user root Aug 11 04:38:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4912d540-03eb-4502-9003-b62118d9c8b9 tempest-VolumesAdminNegativeTest-1912040958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3ea3a35e-670f-4d60-99a9-7ef8bb7592f2" returned: 0 in 0.421s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:38:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4912d540-03eb-4502-9003-b62118d9c8b9 tempest-VolumesAdminNegativeTest-1912040958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3ea3a35e-670f-4d60-99a9-7ef8bb7592f2 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:38:14 devstack sudo[96123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3ea3a35e-670f-4d60-99a9-7ef8bb7592f2 Aug 11 04:38:14 devstack sudo[96123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:38:14 devstack sudo[96123]: pam_unix(sudo:session): session closed for user root Aug 11 04:38:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4912d540-03eb-4502-9003-b62118d9c8b9 tempest-VolumesAdminNegativeTest-1912040958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3ea3a35e-670f-4d60-99a9-7ef8bb7592f2" returned: 0 in 0.389s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:38:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4912d540-03eb-4502-9003-b62118d9c8b9 tempest-VolumesAdminNegativeTest-1912040958 None] Lock "cinder-quobyte-3ea3a35e-670f-4d60-99a9-7ef8bb7592f2" released by "delete_volume" :: held 2.753s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:38:14 devstack cinder-volume[94472]: WARNING cinder.quota [None req-4912d540-03eb-4502-9003-b62118d9c8b9 tempest-VolumesAdminNegativeTest-1912040958 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 11 04:38:14 devstack cinder-volume[94472]: WARNING cinder.quota [None req-4912d540-03eb-4502-9003-b62118d9c8b9 tempest-VolumesAdminNegativeTest-1912040958 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 11 04:38:14 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-4912d540-03eb-4502-9003-b62118d9c8b9 tempest-VolumesAdminNegativeTest-1912040958 None] Created reservations ['0fdc6533-a1c5-43db-ad45-28fe84d7dcc7', 'f28597b6-f2fa-4192-a405-1b6595c1a592', '38be6544-84d4-4b93-b427-2dbc3553069c', '6fb66dd5-62e1-48ca-9fda-a80ba687826e'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:38:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4912d540-03eb-4502-9003-b62118d9c8b9 tempest-VolumesAdminNegativeTest-1912040958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:38:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4912d540-03eb-4502-9003-b62118d9c8b9 tempest-VolumesAdminNegativeTest-1912040958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:38:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4912d540-03eb-4502-9003-b62118d9c8b9 tempest-VolumesAdminNegativeTest-1912040958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:38:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4912d540-03eb-4502-9003-b62118d9c8b9 tempest-VolumesAdminNegativeTest-1912040958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:38:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4912d540-03eb-4502-9003-b62118d9c8b9 tempest-VolumesAdminNegativeTest-1912040958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:38:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4912d540-03eb-4502-9003-b62118d9c8b9 tempest-VolumesAdminNegativeTest-1912040958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:38:14 devstack sudo[96126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:38:14 devstack sudo[96126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:38:15 devstack sudo[96126]: pam_unix(sudo:session): session closed for user root Aug 11 04:38:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4912d540-03eb-4502-9003-b62118d9c8b9 tempest-VolumesAdminNegativeTest-1912040958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.257s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:38:15 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-4912d540-03eb-4502-9003-b62118d9c8b9 tempest-VolumesAdminNegativeTest-1912040958 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:38:15 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-4912d540-03eb-4502-9003-b62118d9c8b9 tempest-VolumesAdminNegativeTest-1912040958 None] Deleted volume successfully. Aug 11 04:38:15 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4912d540-03eb-4502-9003-b62118d9c8b9 tempest-VolumesAdminNegativeTest-1912040958 None] Lock "cinder-3ea3a35e-670f-4d60-99a9-7ef8bb7592f2-delete_volume" released by "delete_volume" :: held 3.311s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:38:18 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-80a50378-5bee-4925-b0fc-847a51a62f39 req-ab85cdf7-795e-40bf-b98c-a276f19ada62 tempest-DeleteServersTestJSON-751150030 None] Terminate volume connection completed successfully. Aug 11 04:38:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-80a50378-5bee-4925-b0fc-847a51a62f39 req-ab85cdf7-795e-40bf-b98c-a276f19ada62 tempest-DeleteServersTestJSON-751150030 None] Deleting attachment 6928a5d3-b365-4e07-ae5c-b14a88215b88. {{(pid=94472) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 11 04:38:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9b4c6a0f-0fcb-4a80-97ed-3d96e67798a7 tempest-DeleteServersTestJSON-751150030 None] Acquiring lock "cinder-e7c96449-a4b6-4ca9-8d0f-7437cc90804b-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:38:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9b4c6a0f-0fcb-4a80-97ed-3d96e67798a7 tempest-DeleteServersTestJSON-751150030 None] Lock "cinder-e7c96449-a4b6-4ca9-8d0f-7437cc90804b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:38:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9b4c6a0f-0fcb-4a80-97ed-3d96e67798a7 tempest-DeleteServersTestJSON-751150030 None] Acquiring lock "cinder-quobyte-e7c96449-a4b6-4ca9-8d0f-7437cc90804b" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:38:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9b4c6a0f-0fcb-4a80-97ed-3d96e67798a7 tempest-DeleteServersTestJSON-751150030 None] Lock "cinder-quobyte-e7c96449-a4b6-4ca9-8d0f-7437cc90804b" acquired by "delete_volume" :: waited 0.016s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:38:20 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[4029a0a2-2599-4b0a-a9eb-781b6d3d82b8]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:38:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9b4c6a0f-0fcb-4a80-97ed-3d96e67798a7 tempest-DeleteServersTestJSON-751150030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e7c96449-a4b6-4ca9-8d0f-7437cc90804b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:38:20 devstack sudo[96213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e7c96449-a4b6-4ca9-8d0f-7437cc90804b Aug 11 04:38:20 devstack sudo[96213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:38:20 devstack sudo[96213]: pam_unix(sudo:session): session closed for user root Aug 11 04:38:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9b4c6a0f-0fcb-4a80-97ed-3d96e67798a7 tempest-DeleteServersTestJSON-751150030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e7c96449-a4b6-4ca9-8d0f-7437cc90804b" returned: 0 in 0.379s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:38:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9b4c6a0f-0fcb-4a80-97ed-3d96e67798a7 tempest-DeleteServersTestJSON-751150030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e7c96449-a4b6-4ca9-8d0f-7437cc90804b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:38:20 devstack sudo[96219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e7c96449-a4b6-4ca9-8d0f-7437cc90804b Aug 11 04:38:20 devstack sudo[96219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:38:20 devstack sudo[96219]: pam_unix(sudo:session): session closed for user root Aug 11 04:38:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9b4c6a0f-0fcb-4a80-97ed-3d96e67798a7 tempest-DeleteServersTestJSON-751150030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e7c96449-a4b6-4ca9-8d0f-7437cc90804b" returned: 0 in 0.254s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:38:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9b4c6a0f-0fcb-4a80-97ed-3d96e67798a7 tempest-DeleteServersTestJSON-751150030 None] Lock "cinder-quobyte-e7c96449-a4b6-4ca9-8d0f-7437cc90804b" released by "delete_volume" :: held 0.681s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:38:20 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-9b4c6a0f-0fcb-4a80-97ed-3d96e67798a7 tempest-DeleteServersTestJSON-751150030 None] Created reservations ['1ed12cb7-4529-4f7f-a172-e125d4d2c6df', '1bbb9319-0ec9-4ddf-8642-c09dc8a7b09f', 'bb44810d-97fb-4226-9e98-a32f36382111', 'ba28bd41-84b0-4665-a9c4-946a9cde4da6'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:38:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9b4c6a0f-0fcb-4a80-97ed-3d96e67798a7 tempest-DeleteServersTestJSON-751150030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:38:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9b4c6a0f-0fcb-4a80-97ed-3d96e67798a7 tempest-DeleteServersTestJSON-751150030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:38:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9b4c6a0f-0fcb-4a80-97ed-3d96e67798a7 tempest-DeleteServersTestJSON-751150030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:38:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9b4c6a0f-0fcb-4a80-97ed-3d96e67798a7 tempest-DeleteServersTestJSON-751150030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:38:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9b4c6a0f-0fcb-4a80-97ed-3d96e67798a7 tempest-DeleteServersTestJSON-751150030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:38:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9b4c6a0f-0fcb-4a80-97ed-3d96e67798a7 tempest-DeleteServersTestJSON-751150030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:38:20 devstack sudo[96222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:38:20 devstack sudo[96222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:38:21 devstack sudo[96222]: pam_unix(sudo:session): session closed for user root Aug 11 04:38:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9b4c6a0f-0fcb-4a80-97ed-3d96e67798a7 tempest-DeleteServersTestJSON-751150030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.264s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:38:21 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-9b4c6a0f-0fcb-4a80-97ed-3d96e67798a7 tempest-DeleteServersTestJSON-751150030 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:38:21 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-9b4c6a0f-0fcb-4a80-97ed-3d96e67798a7 tempest-DeleteServersTestJSON-751150030 None] Deleted volume successfully. Aug 11 04:38:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9b4c6a0f-0fcb-4a80-97ed-3d96e67798a7 tempest-DeleteServersTestJSON-751150030 None] Lock "cinder-e7c96449-a4b6-4ca9-8d0f-7437cc90804b-delete_volume" released by "delete_volume" :: held 1.224s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:38:25 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c532bb2-d34a-4818-8266-468a8b9dfd49 tempest-AttachVolumeNegativeTest-2108237366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:38:25 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7c532bb2-d34a-4818-8266-468a8b9dfd49 tempest-AttachVolumeNegativeTest-2108237366 None] Flow 'volume_create_manager' (bf413864-9acd-44ff-ab55-c958ed09aee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:38:25 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7c532bb2-d34a-4818-8266-468a8b9dfd49 tempest-AttachVolumeNegativeTest-2108237366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (501d1d15-e5a7-4302-a52f-aa0db167dd55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:38:25 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7c532bb2-d34a-4818-8266-468a8b9dfd49 tempest-AttachVolumeNegativeTest-2108237366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (501d1d15-e5a7-4302-a52f-aa0db167dd55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:38:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1037816283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=122fe640-a055-4401-9709-e8a311fefff1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a131d77a71664b3a89d1c522ada17ddd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:38:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:38:25Z,use_quota=True,user_id='91e0e000756a4389bb2bb1b08d8fa2e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:38:25 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7c532bb2-d34a-4818-8266-468a8b9dfd49 tempest-AttachVolumeNegativeTest-2108237366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa35752e-3d97-434a-b884-096f2fd627c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:38:25 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7c532bb2-d34a-4818-8266-468a8b9dfd49 tempest-AttachVolumeNegativeTest-2108237366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa35752e-3d97-434a-b884-096f2fd627c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:38:25 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7c532bb2-d34a-4818-8266-468a8b9dfd49 tempest-AttachVolumeNegativeTest-2108237366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (465eb725-8512-4a69-bbd7-5a28aeb02e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:38:25 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7c532bb2-d34a-4818-8266-468a8b9dfd49 tempest-AttachVolumeNegativeTest-2108237366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (465eb725-8512-4a69-bbd7-5a28aeb02e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '122fe640-a055-4401-9709-e8a311fefff1', 'volume_name': 'volume-122fe640-a055-4401-9709-e8a311fefff1', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:38:25 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7c532bb2-d34a-4818-8266-468a8b9dfd49 tempest-AttachVolumeNegativeTest-2108237366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93fd1e13-b333-47cd-a211-31e845e116e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:38:25 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7c532bb2-d34a-4818-8266-468a8b9dfd49 tempest-AttachVolumeNegativeTest-2108237366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93fd1e13-b333-47cd-a211-31e845e116e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:38:25 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7c532bb2-d34a-4818-8266-468a8b9dfd49 tempest-AttachVolumeNegativeTest-2108237366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dce4bb5a-e9f5-4934-a481-b58cf6162bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:38:25 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-7c532bb2-d34a-4818-8266-468a8b9dfd49 tempest-AttachVolumeNegativeTest-2108237366 None] Volume 122fe640-a055-4401-9709-e8a311fefff1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-122fe640-a055-4401-9709-e8a311fefff1', 'volume_size': 1} Aug 11 04:38:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7c532bb2-d34a-4818-8266-468a8b9dfd49 tempest-AttachVolumeNegativeTest-2108237366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:38:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7c532bb2-d34a-4818-8266-468a8b9dfd49 tempest-AttachVolumeNegativeTest-2108237366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:38:25 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7c532bb2-d34a-4818-8266-468a8b9dfd49 tempest-AttachVolumeNegativeTest-2108237366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:38:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1037816283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=122fe640-a055-4401-9709-e8a311fefff1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a131d77a71664b3a89d1c522ada17ddd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:38:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:38:25Z,use_quota=True,user_id='91e0e000756a4389bb2bb1b08d8fa2e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:38:25 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-7c532bb2-d34a-4818-8266-468a8b9dfd49 tempest-AttachVolumeNegativeTest-2108237366 None] Creating volume 122fe640-a055-4401-9709-e8a311fefff1 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:38:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7c532bb2-d34a-4818-8266-468a8b9dfd49 tempest-AttachVolumeNegativeTest-2108237366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:38:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7c532bb2-d34a-4818-8266-468a8b9dfd49 tempest-AttachVolumeNegativeTest-2108237366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:38:25 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7c532bb2-d34a-4818-8266-468a8b9dfd49 tempest-AttachVolumeNegativeTest-2108237366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:38:25 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7c532bb2-d34a-4818-8266-468a8b9dfd49 tempest-AttachVolumeNegativeTest-2108237366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:38:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7c532bb2-d34a-4818-8266-468a8b9dfd49 tempest-AttachVolumeNegativeTest-2108237366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:38:25 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7c532bb2-d34a-4818-8266-468a8b9dfd49 tempest-AttachVolumeNegativeTest-2108237366 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:38:25 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-7c532bb2-d34a-4818-8266-468a8b9dfd49 tempest-AttachVolumeNegativeTest-2108237366 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:38:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7c532bb2-d34a-4818-8266-468a8b9dfd49 tempest-AttachVolumeNegativeTest-2108237366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-122fe640-a055-4401-9709-e8a311fefff1 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:38:25 devstack sudo[96237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-122fe640-a055-4401-9709-e8a311fefff1 1073741824 Aug 11 04:38:25 devstack sudo[96237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:38:26 devstack sudo[96237]: pam_unix(sudo:session): session closed for user root Aug 11 04:38:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7c532bb2-d34a-4818-8266-468a8b9dfd49 tempest-AttachVolumeNegativeTest-2108237366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-122fe640-a055-4401-9709-e8a311fefff1 1073741824" returned: 0 in 0.533s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:38:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7c532bb2-d34a-4818-8266-468a8b9dfd49 tempest-AttachVolumeNegativeTest-2108237366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-122fe640-a055-4401-9709-e8a311fefff1 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:38:26 devstack sudo[96243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-122fe640-a055-4401-9709-e8a311fefff1 Aug 11 04:38:26 devstack sudo[96243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:38:26 devstack sudo[96243]: pam_unix(sudo:session): session closed for user root Aug 11 04:38:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7c532bb2-d34a-4818-8266-468a8b9dfd49 tempest-AttachVolumeNegativeTest-2108237366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-122fe640-a055-4401-9709-e8a311fefff1" returned: 0 in 0.245s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:38:26 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7c532bb2-d34a-4818-8266-468a8b9dfd49 tempest-AttachVolumeNegativeTest-2108237366 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:38:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7c532bb2-d34a-4818-8266-468a8b9dfd49 tempest-AttachVolumeNegativeTest-2108237366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:38:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7c532bb2-d34a-4818-8266-468a8b9dfd49 tempest-AttachVolumeNegativeTest-2108237366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dce4bb5a-e9f5-4934-a481-b58cf6162bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-122fe640-a055-4401-9709-e8a311fefff1', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:38:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7c532bb2-d34a-4818-8266-468a8b9dfd49 tempest-AttachVolumeNegativeTest-2108237366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8417b44b-ed25-4733-9ba3-6cc00094538e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:38:26 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-7c532bb2-d34a-4818-8266-468a8b9dfd49 tempest-AttachVolumeNegativeTest-2108237366 None] Volume volume-122fe640-a055-4401-9709-e8a311fefff1 (122fe640-a055-4401-9709-e8a311fefff1): created successfully Aug 11 04:38:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7c532bb2-d34a-4818-8266-468a8b9dfd49 tempest-AttachVolumeNegativeTest-2108237366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8417b44b-ed25-4733-9ba3-6cc00094538e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:38:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7c532bb2-d34a-4818-8266-468a8b9dfd49 tempest-AttachVolumeNegativeTest-2108237366 None] Flow 'volume_create_manager' (bf413864-9acd-44ff-ab55-c958ed09aee7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:38:26 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-7c532bb2-d34a-4818-8266-468a8b9dfd49 tempest-AttachVolumeNegativeTest-2108237366 None] Created volume successfully. Aug 11 04:38:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-49412328-0488-4b71-9ab4-3b1516a548bc req-77c2aa57-a1b9-47b7-8854-609d546ae186 tempest-AttachVolumeNegativeTest-2108237366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:38:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-49412328-0488-4b71-9ab4-3b1516a548bc req-77c2aa57-a1b9-47b7-8854-609d546ae186 tempest-AttachVolumeNegativeTest-2108237366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:38:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-49412328-0488-4b71-9ab4-3b1516a548bc req-77c2aa57-a1b9-47b7-8854-609d546ae186 tempest-AttachVolumeNegativeTest-2108237366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:38:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-49412328-0488-4b71-9ab4-3b1516a548bc req-77c2aa57-a1b9-47b7-8854-609d546ae186 tempest-AttachVolumeNegativeTest-2108237366 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd', 'name': 'volume-122fe640-a055-4401-9709-e8a311fefff1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '15b2a4ae-924f-4f3c-a27c-c08bd1e484e3', 'enforce_multipath': True} {{(pid=94472) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 11 04:38:28 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-49412328-0488-4b71-9ab4-3b1516a548bc req-77c2aa57-a1b9-47b7-8854-609d546ae186 tempest-AttachVolumeNegativeTest-2108237366 None] attachment_update completed successfully. Aug 11 04:38:38 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:UPDATE=22,cinder:SELECT=28,cinder:INSERT=5,cinder:DELETE=2 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:38:38 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=32,cinder:UPDATE=34,cinder:INSERT=6,cinder:DELETE=3 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:38:50 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-55a68758-2c19-4d44-92a2-c0ebea7906c8 tempest-BackendsCapabilitiesAdminTestsJSON-2084724986 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7576522827148, 'free_capacity_gb': 1775.7576522827148, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94472) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 11 04:38:50 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d7b694f8-fed5-4ac3-8a9a-752e9afff539 tempest-BackendsCapabilitiesAdminTestsJSON-2084724986 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7576522827148, 'free_capacity_gb': 1775.7576522827148, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94472) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 11 04:38:58 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 04:38:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:38:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:38:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:38:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:38:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:38:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:38:58 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=1 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:38:58 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:UPDATE=1 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:38:58 devstack sudo[96765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:38:58 devstack sudo[96765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:38:58 devstack sudo[96765]: pam_unix(sudo:session): session closed for user root Aug 11 04:38:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.478s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:38:58 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:38:58 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running periodic task VolumeManager._thread_info {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 04:38:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] thread count: 8 {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 11 04:38:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] thread info: [<_MainThread(MainThread, started 133315846115456)>, , , , , , , ] {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 11 04:39:01 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-609dfd63-def6-40af-b69b-22604114969d tempest-GroupSnapshotsTest-1060963943 None] Group tempest-GroupSnapshotsTest-Group-1144598743: creating Aug 11 04:39:01 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-609dfd63-def6-40af-b69b-22604114969d tempest-GroupSnapshotsTest-1060963943 None] Group tempest-GroupSnapshotsTest-Group-1144598743: created successfully Aug 11 04:39:01 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-609dfd63-def6-40af-b69b-22604114969d tempest-GroupSnapshotsTest-1060963943 None] Create group completed successfully. Aug 11 04:39:03 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-05345168-269e-4087-9d51-a610f0aeaef0 tempest-GroupSnapshotsTest-1060963943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:39:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-05345168-269e-4087-9d51-a610f0aeaef0 tempest-GroupSnapshotsTest-1060963943 None] Flow 'volume_create_manager' (9abc2ae7-d598-43ab-ab66-9cdb1597e252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:39:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-05345168-269e-4087-9d51-a610f0aeaef0 tempest-GroupSnapshotsTest-1060963943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (145c99d0-211a-403d-aabc-de8b0a9892c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:39:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-05345168-269e-4087-9d51-a610f0aeaef0 tempest-GroupSnapshotsTest-1060963943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (145c99d0-211a-403d-aabc-de8b0a9892c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:39:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-865649151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f9a55c29-44ff-4136-b325-dc4615f3b7c1,host='devstack@QuobyteHD#QuobyteHD',id=6f28b9a8-46bd-4ebc-be86-568ef20888a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91dee1da4e784a3a969e352513ea5c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:39:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:39:03Z,use_quota=True,user_id='008a888043964369942c83be353f327c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8123a145-7694-4965-ab2d-5de6a38c02bc),volume_type_id=8123a145-7694-4965-ab2d-5de6a38c02bc)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:39:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-05345168-269e-4087-9d51-a610f0aeaef0 tempest-GroupSnapshotsTest-1060963943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f4b3f90-1fb5-4089-9a18-5213ab050cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:39:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-05345168-269e-4087-9d51-a610f0aeaef0 tempest-GroupSnapshotsTest-1060963943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f4b3f90-1fb5-4089-9a18-5213ab050cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:39:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-05345168-269e-4087-9d51-a610f0aeaef0 tempest-GroupSnapshotsTest-1060963943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a18b6ea4-1ede-49a8-ab55-b7f4943fb175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:39:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-05345168-269e-4087-9d51-a610f0aeaef0 tempest-GroupSnapshotsTest-1060963943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a18b6ea4-1ede-49a8-ab55-b7f4943fb175) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f28b9a8-46bd-4ebc-be86-568ef20888a6', 'volume_name': 'volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:39:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-05345168-269e-4087-9d51-a610f0aeaef0 tempest-GroupSnapshotsTest-1060963943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4f4703a-6717-4ab5-b23f-2a96d6ce92db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:39:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-05345168-269e-4087-9d51-a610f0aeaef0 tempest-GroupSnapshotsTest-1060963943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4f4703a-6717-4ab5-b23f-2a96d6ce92db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:39:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-05345168-269e-4087-9d51-a610f0aeaef0 tempest-GroupSnapshotsTest-1060963943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47113376-b719-48ca-925f-bb8e87dbe6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:39:03 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-05345168-269e-4087-9d51-a610f0aeaef0 tempest-GroupSnapshotsTest-1060963943 None] Volume 6f28b9a8-46bd-4ebc-be86-568ef20888a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6', 'volume_size': 1} Aug 11 04:39:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-05345168-269e-4087-9d51-a610f0aeaef0 tempest-GroupSnapshotsTest-1060963943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:39:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-05345168-269e-4087-9d51-a610f0aeaef0 tempest-GroupSnapshotsTest-1060963943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:39:03 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-05345168-269e-4087-9d51-a610f0aeaef0 tempest-GroupSnapshotsTest-1060963943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f9a55c29-44ff-4136-b325-dc4615f3b7c1,created_at=2026-08-11T02:39:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-865649151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f9a55c29-44ff-4136-b325-dc4615f3b7c1,host='devstack@QuobyteHD#QuobyteHD',id=6f28b9a8-46bd-4ebc-be86-568ef20888a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91dee1da4e784a3a969e352513ea5c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:39:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:39:03Z,use_quota=True,user_id='008a888043964369942c83be353f327c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8123a145-7694-4965-ab2d-5de6a38c02bc),volume_type_id=8123a145-7694-4965-ab2d-5de6a38c02bc)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:39:03 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-05345168-269e-4087-9d51-a610f0aeaef0 tempest-GroupSnapshotsTest-1060963943 None] Creating volume 6f28b9a8-46bd-4ebc-be86-568ef20888a6 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:39:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-05345168-269e-4087-9d51-a610f0aeaef0 tempest-GroupSnapshotsTest-1060963943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:39:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-05345168-269e-4087-9d51-a610f0aeaef0 tempest-GroupSnapshotsTest-1060963943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:39:03 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-05345168-269e-4087-9d51-a610f0aeaef0 tempest-GroupSnapshotsTest-1060963943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:39:03 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-05345168-269e-4087-9d51-a610f0aeaef0 tempest-GroupSnapshotsTest-1060963943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:39:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-05345168-269e-4087-9d51-a610f0aeaef0 tempest-GroupSnapshotsTest-1060963943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:39:03 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-05345168-269e-4087-9d51-a610f0aeaef0 tempest-GroupSnapshotsTest-1060963943 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:39:03 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-05345168-269e-4087-9d51-a610f0aeaef0 tempest-GroupSnapshotsTest-1060963943 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:39:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-05345168-269e-4087-9d51-a610f0aeaef0 tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:39:03 devstack sudo[96830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6 1073741824 Aug 11 04:39:03 devstack sudo[96830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:39:04 devstack sudo[96830]: pam_unix(sudo:session): session closed for user root Aug 11 04:39:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-05345168-269e-4087-9d51-a610f0aeaef0 tempest-GroupSnapshotsTest-1060963943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6 1073741824" returned: 0 in 0.857s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:39:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-05345168-269e-4087-9d51-a610f0aeaef0 tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:39:04 devstack sudo[96838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6 Aug 11 04:39:04 devstack sudo[96838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:39:05 devstack sudo[96838]: pam_unix(sudo:session): session closed for user root Aug 11 04:39:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-05345168-269e-4087-9d51-a610f0aeaef0 tempest-GroupSnapshotsTest-1060963943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6" returned: 0 in 1.055s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:39:05 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-05345168-269e-4087-9d51-a610f0aeaef0 tempest-GroupSnapshotsTest-1060963943 None] <== create_volume: return (2025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:39:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-05345168-269e-4087-9d51-a610f0aeaef0 tempest-GroupSnapshotsTest-1060963943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.027s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:39:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-05345168-269e-4087-9d51-a610f0aeaef0 tempest-GroupSnapshotsTest-1060963943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47113376-b719-48ca-925f-bb8e87dbe6dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:39:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-05345168-269e-4087-9d51-a610f0aeaef0 tempest-GroupSnapshotsTest-1060963943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d70c30a-c34e-4719-aea5-20e555f198dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:39:05 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-05345168-269e-4087-9d51-a610f0aeaef0 tempest-GroupSnapshotsTest-1060963943 None] Volume volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6 (6f28b9a8-46bd-4ebc-be86-568ef20888a6): created successfully Aug 11 04:39:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-05345168-269e-4087-9d51-a610f0aeaef0 tempest-GroupSnapshotsTest-1060963943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d70c30a-c34e-4719-aea5-20e555f198dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:39:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-05345168-269e-4087-9d51-a610f0aeaef0 tempest-GroupSnapshotsTest-1060963943 None] Flow 'volume_create_manager' (9abc2ae7-d598-43ab-ab66-9cdb1597e252) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:39:05 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-05345168-269e-4087-9d51-a610f0aeaef0 tempest-GroupSnapshotsTest-1060963943 None] Created volume successfully. Aug 11 04:39:06 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-64f53a3f-39af-4901-a709-6be3b4821073 tempest-TaggedAttachmentsTest-453299645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:39:06 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-64f53a3f-39af-4901-a709-6be3b4821073 tempest-TaggedAttachmentsTest-453299645 None] Flow 'volume_create_manager' (2e042ffc-bba0-4d31-a08a-915d0e6adea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:39:06 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-64f53a3f-39af-4901-a709-6be3b4821073 tempest-TaggedAttachmentsTest-453299645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1abbd4e-269f-4dd1-b4fb-074a864063d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:39:06 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-64f53a3f-39af-4901-a709-6be3b4821073 tempest-TaggedAttachmentsTest-453299645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1abbd4e-269f-4dd1-b4fb-074a864063d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-929183154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51ffead1-a054-4a99-a998-e9aece77458c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a9949eb847e49d7baf65f89847e64c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:39:06Z,use_quota=True,user_id='87d5b08b6abe423b8ac6892ddae0bbe0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:39:06 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-64f53a3f-39af-4901-a709-6be3b4821073 tempest-TaggedAttachmentsTest-453299645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d7d38a7-34fd-4d3b-981b-e5deb75c6631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:39:06 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-64f53a3f-39af-4901-a709-6be3b4821073 tempest-TaggedAttachmentsTest-453299645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d7d38a7-34fd-4d3b-981b-e5deb75c6631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:39:06 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-64f53a3f-39af-4901-a709-6be3b4821073 tempest-TaggedAttachmentsTest-453299645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44803bfc-f8c5-483c-a6e7-62761541295c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:39:06 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-64f53a3f-39af-4901-a709-6be3b4821073 tempest-TaggedAttachmentsTest-453299645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44803bfc-f8c5-483c-a6e7-62761541295c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51ffead1-a054-4a99-a998-e9aece77458c', 'volume_name': 'volume-51ffead1-a054-4a99-a998-e9aece77458c', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:39:06 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-64f53a3f-39af-4901-a709-6be3b4821073 tempest-TaggedAttachmentsTest-453299645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27875bc2-0e37-4ed9-8b61-d8b9a16c9c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:39:06 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-64f53a3f-39af-4901-a709-6be3b4821073 tempest-TaggedAttachmentsTest-453299645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27875bc2-0e37-4ed9-8b61-d8b9a16c9c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:39:06 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-64f53a3f-39af-4901-a709-6be3b4821073 tempest-TaggedAttachmentsTest-453299645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (023757cd-bb8f-41f2-8d12-9f53afd1040d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:39:06 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-64f53a3f-39af-4901-a709-6be3b4821073 tempest-TaggedAttachmentsTest-453299645 None] Volume 51ffead1-a054-4a99-a998-e9aece77458c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51ffead1-a054-4a99-a998-e9aece77458c', 'volume_size': 1} Aug 11 04:39:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-64f53a3f-39af-4901-a709-6be3b4821073 tempest-TaggedAttachmentsTest-453299645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:39:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-64f53a3f-39af-4901-a709-6be3b4821073 tempest-TaggedAttachmentsTest-453299645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:39:06 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-64f53a3f-39af-4901-a709-6be3b4821073 tempest-TaggedAttachmentsTest-453299645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-929183154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51ffead1-a054-4a99-a998-e9aece77458c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a9949eb847e49d7baf65f89847e64c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:39:06Z,use_quota=True,user_id='87d5b08b6abe423b8ac6892ddae0bbe0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:39:06 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-64f53a3f-39af-4901-a709-6be3b4821073 tempest-TaggedAttachmentsTest-453299645 None] Creating volume 51ffead1-a054-4a99-a998-e9aece77458c {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:39:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-64f53a3f-39af-4901-a709-6be3b4821073 tempest-TaggedAttachmentsTest-453299645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:39:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-64f53a3f-39af-4901-a709-6be3b4821073 tempest-TaggedAttachmentsTest-453299645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:39:06 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-64f53a3f-39af-4901-a709-6be3b4821073 tempest-TaggedAttachmentsTest-453299645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:39:06 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-64f53a3f-39af-4901-a709-6be3b4821073 tempest-TaggedAttachmentsTest-453299645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:39:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-64f53a3f-39af-4901-a709-6be3b4821073 tempest-TaggedAttachmentsTest-453299645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:39:06 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-64f53a3f-39af-4901-a709-6be3b4821073 tempest-TaggedAttachmentsTest-453299645 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:39:06 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-64f53a3f-39af-4901-a709-6be3b4821073 tempest-TaggedAttachmentsTest-453299645 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:39:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-64f53a3f-39af-4901-a709-6be3b4821073 tempest-TaggedAttachmentsTest-453299645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-51ffead1-a054-4a99-a998-e9aece77458c 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:39:06 devstack sudo[96942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-51ffead1-a054-4a99-a998-e9aece77458c 1073741824 Aug 11 04:39:06 devstack sudo[96942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:39:07 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-b3a66ff1-b06b-4a68-8e6b-1a2466520302 tempest-GroupSnapshotsTest-1060963943 None] GroupSnapshot 226c9a75-3ded-4b84-9e9c-39f0b445222e: creating. Aug 11 04:39:07 devstack sudo[96942]: pam_unix(sudo:session): session closed for user root Aug 11 04:39:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-64f53a3f-39af-4901-a709-6be3b4821073 tempest-TaggedAttachmentsTest-453299645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-51ffead1-a054-4a99-a998-e9aece77458c 1073741824" returned: 0 in 1.399s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:39:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b3a66ff1-b06b-4a68-8e6b-1a2466520302 tempest-GroupSnapshotsTest-1060963943 None] Group snapshot 226c9a75-3ded-4b84-9e9c-39f0b445222e: creating. {{(pid=94472) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 11 04:39:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b3a66ff1-b06b-4a68-8e6b-1a2466520302 tempest-GroupSnapshotsTest-1060963943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:39:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-64f53a3f-39af-4901-a709-6be3b4821073 tempest-TaggedAttachmentsTest-453299645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-51ffead1-a054-4a99-a998-e9aece77458c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:39:08 devstack sudo[96985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-51ffead1-a054-4a99-a998-e9aece77458c Aug 11 04:39:08 devstack sudo[96985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:39:08 devstack sudo[96985]: pam_unix(sudo:session): session closed for user root Aug 11 04:39:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-64f53a3f-39af-4901-a709-6be3b4821073 tempest-TaggedAttachmentsTest-453299645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-51ffead1-a054-4a99-a998-e9aece77458c" returned: 0 in 0.473s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:39:08 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-64f53a3f-39af-4901-a709-6be3b4821073 tempest-TaggedAttachmentsTest-453299645 None] <== create_volume: return (2084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:39:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-64f53a3f-39af-4901-a709-6be3b4821073 tempest-TaggedAttachmentsTest-453299645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.091s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:39:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b3a66ff1-b06b-4a68-8e6b-1a2466520302 tempest-GroupSnapshotsTest-1060963943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.521s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:39:08 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-b3a66ff1-b06b-4a68-8e6b-1a2466520302 tempest-GroupSnapshotsTest-1060963943 None] Creating offline snapshot 0cde9bb8-027d-4915-bee1-da9dbf66c8cc of volume 6f28b9a8-46bd-4ebc-be86-568ef20888a6 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 04:39:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-64f53a3f-39af-4901-a709-6be3b4821073 tempest-TaggedAttachmentsTest-453299645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (023757cd-bb8f-41f2-8d12-9f53afd1040d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51ffead1-a054-4a99-a998-e9aece77458c', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:39:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-64f53a3f-39af-4901-a709-6be3b4821073 tempest-TaggedAttachmentsTest-453299645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3beff1c4-24c0-4082-af28-9bca097468fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:39:08 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9f9b9f-b7de-45d2-9266-ab7c5c96bf1a]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:39:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b3a66ff1-b06b-4a68-8e6b-1a2466520302 tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:39:08 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-64f53a3f-39af-4901-a709-6be3b4821073 tempest-TaggedAttachmentsTest-453299645 None] Volume volume-51ffead1-a054-4a99-a998-e9aece77458c (51ffead1-a054-4a99-a998-e9aece77458c): created successfully Aug 11 04:39:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-64f53a3f-39af-4901-a709-6be3b4821073 tempest-TaggedAttachmentsTest-453299645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3beff1c4-24c0-4082-af28-9bca097468fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:39:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-64f53a3f-39af-4901-a709-6be3b4821073 tempest-TaggedAttachmentsTest-453299645 None] Flow 'volume_create_manager' (2e042ffc-bba0-4d31-a08a-915d0e6adea9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:39:08 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-64f53a3f-39af-4901-a709-6be3b4821073 tempest-TaggedAttachmentsTest-453299645 None] Created volume successfully. Aug 11 04:39:08 devstack sudo[97001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6 Aug 11 04:39:08 devstack sudo[97001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:39:09 devstack sudo[97001]: pam_unix(sudo:session): session closed for user root Aug 11 04:39:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b3a66ff1-b06b-4a68-8e6b-1a2466520302 tempest-GroupSnapshotsTest-1060963943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6" returned: 0 in 0.808s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:39:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b3a66ff1-b06b-4a68-8e6b-1a2466520302 tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6.0cde9bb8-027d-4915-bee1-da9dbf66c8cc 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:39:09 devstack sudo[97037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6.0cde9bb8-027d-4915-bee1-da9dbf66c8cc 1G Aug 11 04:39:09 devstack sudo[97037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:39:10 devstack sudo[97037]: pam_unix(sudo:session): session closed for user root Aug 11 04:39:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b3a66ff1-b06b-4a68-8e6b-1a2466520302 tempest-GroupSnapshotsTest-1060963943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6.0cde9bb8-027d-4915-bee1-da9dbf66c8cc 1G" returned: 0 in 0.976s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:39:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b3a66ff1-b06b-4a68-8e6b-1a2466520302 tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6.0cde9bb8-027d-4915-bee1-da9dbf66c8cc {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:39:10 devstack sudo[97045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6.0cde9bb8-027d-4915-bee1-da9dbf66c8cc Aug 11 04:39:10 devstack sudo[97045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:39:11 devstack sudo[97045]: pam_unix(sudo:session): session closed for user root Aug 11 04:39:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b3a66ff1-b06b-4a68-8e6b-1a2466520302 tempest-GroupSnapshotsTest-1060963943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6.0cde9bb8-027d-4915-bee1-da9dbf66c8cc" returned: 0 in 1.051s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:39:11 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-b3a66ff1-b06b-4a68-8e6b-1a2466520302 tempest-GroupSnapshotsTest-1060963943 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6.0cde9bb8-027d-4915-bee1-da9dbf66c8cc is being set with open permissions: ugo+rw: NotImplementedError Aug 11 04:39:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b3a66ff1-b06b-4a68-8e6b-1a2466520302 tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6.0cde9bb8-027d-4915-bee1-da9dbf66c8cc {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:39:11 devstack sudo[97062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6.0cde9bb8-027d-4915-bee1-da9dbf66c8cc Aug 11 04:39:11 devstack sudo[97062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:39:12 devstack sudo[97062]: pam_unix(sudo:session): session closed for user root Aug 11 04:39:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b3a66ff1-b06b-4a68-8e6b-1a2466520302 tempest-GroupSnapshotsTest-1060963943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6.0cde9bb8-027d-4915-bee1-da9dbf66c8cc" returned: 0 in 0.895s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:39:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b3a66ff1-b06b-4a68-8e6b-1a2466520302 tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:39:12 devstack sudo[97067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6.info Aug 11 04:39:12 devstack sudo[97067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:39:13 devstack sudo[97067]: pam_unix(sudo:session): session closed for user root Aug 11 04:39:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b3a66ff1-b06b-4a68-8e6b-1a2466520302 tempest-GroupSnapshotsTest-1060963943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6.info" returned: 0 in 0.538s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:39:13 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-b3a66ff1-b06b-4a68-8e6b-1a2466520302 tempest-GroupSnapshotsTest-1060963943 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6.info is being set with open permissions: ugo+rw: NotImplementedError Aug 11 04:39:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b3a66ff1-b06b-4a68-8e6b-1a2466520302 tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:39:13 devstack sudo[97070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6.info Aug 11 04:39:13 devstack sudo[97070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:39:13 devstack sudo[97070]: pam_unix(sudo:session): session closed for user root Aug 11 04:39:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b3a66ff1-b06b-4a68-8e6b-1a2466520302 tempest-GroupSnapshotsTest-1060963943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6.info" returned: 0 in 0.527s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:39:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b3a66ff1-b06b-4a68-8e6b-1a2466520302 tempest-GroupSnapshotsTest-1060963943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.032s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:39:13 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-b3a66ff1-b06b-4a68-8e6b-1a2466520302 tempest-GroupSnapshotsTest-1060963943 None] group_snapshot 226c9a75-3ded-4b84-9e9c-39f0b445222e: created successfully Aug 11 04:39:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-024def37-cc50-4ce5-b96f-006865a1b910 tempest-GroupSnapshotsTest-1060963943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:39:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-024def37-cc50-4ce5-b96f-006865a1b910 tempest-GroupSnapshotsTest-1060963943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:39:16 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-024def37-cc50-4ce5-b96f-006865a1b910 tempest-GroupSnapshotsTest-1060963943 None] Acquiring lock "cinder-quobyte-0cde9bb8-027d-4915-bee1-da9dbf66c8cc-1c0ebe8f-1c0f-4771-a237-a4f1adac9c58" by "_create_volume_from_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:39:16 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-024def37-cc50-4ce5-b96f-006865a1b910 tempest-GroupSnapshotsTest-1060963943 None] Lock "cinder-quobyte-0cde9bb8-027d-4915-bee1-da9dbf66c8cc-1c0ebe8f-1c0f-4771-a237-a4f1adac9c58" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:39:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-024def37-cc50-4ce5-b96f-006865a1b910 tempest-GroupSnapshotsTest-1060963943 None] Creating volume 1c0ebe8f-1c0f-4771-a237-a4f1adac9c58 from snapshot 0cde9bb8-027d-4915-bee1-da9dbf66c8cc {{(pid=94472) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 11 04:39:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-024def37-cc50-4ce5-b96f-006865a1b910 tempest-GroupSnapshotsTest-1060963943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:39:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-024def37-cc50-4ce5-b96f-006865a1b910 tempest-GroupSnapshotsTest-1060963943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:39:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-024def37-cc50-4ce5-b96f-006865a1b910 tempest-GroupSnapshotsTest-1060963943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:39:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-024def37-cc50-4ce5-b96f-006865a1b910 tempest-GroupSnapshotsTest-1060963943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:39:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-024def37-cc50-4ce5-b96f-006865a1b910 tempest-GroupSnapshotsTest-1060963943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:39:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-024def37-cc50-4ce5-b96f-006865a1b910 tempest-GroupSnapshotsTest-1060963943 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:39:16 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-024def37-cc50-4ce5-b96f-006865a1b910 tempest-GroupSnapshotsTest-1060963943 None] Acquiring lock "cinder-quobyte-1c0ebe8f-1c0f-4771-a237-a4f1adac9c58" by "_copy_volume_from_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:39:16 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-024def37-cc50-4ce5-b96f-006865a1b910 tempest-GroupSnapshotsTest-1060963943 None] Lock "cinder-quobyte-1c0ebe8f-1c0f-4771-a237-a4f1adac9c58" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:39:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-024def37-cc50-4ce5-b96f-006865a1b910 tempest-GroupSnapshotsTest-1060963943 None] snapshot: 0cde9bb8-027d-4915-bee1-da9dbf66c8cc, volume: 1c0ebe8f-1c0f-4771-a237-a4f1adac9c58, {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 11 04:39:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-024def37-cc50-4ce5-b96f-006865a1b910 tempest-GroupSnapshotsTest-1060963943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:39:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-024def37-cc50-4ce5-b96f-006865a1b910 tempest-GroupSnapshotsTest-1060963943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:39:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-024def37-cc50-4ce5-b96f-006865a1b910 tempest-GroupSnapshotsTest-1060963943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:39:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-024def37-cc50-4ce5-b96f-006865a1b910 tempest-GroupSnapshotsTest-1060963943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:39:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-024def37-cc50-4ce5-b96f-006865a1b910 tempest-GroupSnapshotsTest-1060963943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:39:16 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede2cc86-cccb-4446-81f5-bb4b15f7682d]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:39:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-024def37-cc50-4ce5-b96f-006865a1b910 tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6.0cde9bb8-027d-4915-bee1-da9dbf66c8cc {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:39:16 devstack sudo[97121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6.0cde9bb8-027d-4915-bee1-da9dbf66c8cc Aug 11 04:39:16 devstack sudo[97121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:39:17 devstack sudo[97121]: pam_unix(sudo:session): session closed for user root Aug 11 04:39:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-024def37-cc50-4ce5-b96f-006865a1b910 tempest-GroupSnapshotsTest-1060963943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6.0cde9bb8-027d-4915-bee1-da9dbf66c8cc" returned: 0 in 0.708s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:39:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-024def37-cc50-4ce5-b96f-006865a1b910 tempest-GroupSnapshotsTest-1060963943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:39:17 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[51295dbf-5786-4589-835f-25b365b9be9c]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:39:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-024def37-cc50-4ce5-b96f-006865a1b910 tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:39:17 devstack sudo[97135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6 Aug 11 04:39:17 devstack sudo[97135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:39:17 devstack sudo[97135]: pam_unix(sudo:session): session closed for user root Aug 11 04:39:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-024def37-cc50-4ce5-b96f-006865a1b910 tempest-GroupSnapshotsTest-1060963943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6" returned: 0 in 0.592s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:39:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-024def37-cc50-4ce5-b96f-006865a1b910 tempest-GroupSnapshotsTest-1060963943 None] will copy from snapshot at /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6 {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 11 04:39:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-024def37-cc50-4ce5-b96f-006865a1b910 tempest-GroupSnapshotsTest-1060963943 None] Creating direct copy from snapshot {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 11 04:39:17 devstack cinder-volume[94472]: DEBUG cinder.utils [None req-024def37-cc50-4ce5-b96f-006865a1b910 tempest-GroupSnapshotsTest-1060963943 None] Path /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1c0ebe8f-1c0f-4771-a237-a4f1adac9c58 not found in is_blk_device check {{(pid=94472) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 11 04:39:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-024def37-cc50-4ce5-b96f-006865a1b910 tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1c0ebe8f-1c0f-4771-a237-a4f1adac9c58 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:39:17 devstack sudo[97150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1c0ebe8f-1c0f-4771-a237-a4f1adac9c58 Aug 11 04:39:17 devstack sudo[97150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:39:26 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=14,cinder:UPDATE=9,cinder:INSERT=3,cinder:DELETE=2 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:39:26 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:UPDATE=9,cinder:SELECT=14 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:39:27 devstack sudo[97150]: pam_unix(sudo:session): session closed for user root Aug 11 04:39:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-024def37-cc50-4ce5-b96f-006865a1b910 tempest-GroupSnapshotsTest-1060963943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1c0ebe8f-1c0f-4771-a237-a4f1adac9c58" returned: 0 in 10.000s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:39:27 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-024def37-cc50-4ce5-b96f-006865a1b910 tempest-GroupSnapshotsTest-1060963943 None] Image conversion details: src /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6, size 1024.00 MB, duration 10.00 sec, destination /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1c0ebe8f-1c0f-4771-a237-a4f1adac9c58 {{(pid=94472) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 11 04:39:27 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-024def37-cc50-4ce5-b96f-006865a1b910 tempest-GroupSnapshotsTest-1060963943 None] Converted 1024.00 MB image at 102.39 MB/s Aug 11 04:39:27 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-024def37-cc50-4ce5-b96f-006865a1b910 tempest-GroupSnapshotsTest-1060963943 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1c0ebe8f-1c0f-4771-a237-a4f1adac9c58 is being set with open permissions: ugo+rw: NotImplementedError Aug 11 04:39:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-024def37-cc50-4ce5-b96f-006865a1b910 tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1c0ebe8f-1c0f-4771-a237-a4f1adac9c58 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:39:27 devstack sudo[97255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1c0ebe8f-1c0f-4771-a237-a4f1adac9c58 Aug 11 04:39:28 devstack sudo[97255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:39:28 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-a926f5c1-7897-4fd4-9c29-208946be161f tempest-ServerRescueNegativeTestJSON-922243851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:39:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a926f5c1-7897-4fd4-9c29-208946be161f tempest-ServerRescueNegativeTestJSON-922243851 None] Flow 'volume_create_manager' (9618f2cc-04c7-4824-a5b8-83a41e0a4bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:39:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a926f5c1-7897-4fd4-9c29-208946be161f tempest-ServerRescueNegativeTestJSON-922243851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (300b5eb3-fe8b-4bfa-b44a-5412ec73b97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:39:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a926f5c1-7897-4fd4-9c29-208946be161f tempest-ServerRescueNegativeTestJSON-922243851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (300b5eb3-fe8b-4bfa-b44a-5412ec73b97c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:39:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1439467193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd20625a-a15e-4ec8-9033-a7bb738b0d0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25e04213980e48dc9da403f8ff4707d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:39:28Z,use_quota=True,user_id='8d0d6eb776674d0487fac42108b85995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:39:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a926f5c1-7897-4fd4-9c29-208946be161f tempest-ServerRescueNegativeTestJSON-922243851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (967de28a-c572-4e5c-97ff-fb5a8f3c1bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:39:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a926f5c1-7897-4fd4-9c29-208946be161f tempest-ServerRescueNegativeTestJSON-922243851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (967de28a-c572-4e5c-97ff-fb5a8f3c1bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:39:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a926f5c1-7897-4fd4-9c29-208946be161f tempest-ServerRescueNegativeTestJSON-922243851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cabe87e2-d2ff-4fb9-9b46-9c023870c8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:39:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a926f5c1-7897-4fd4-9c29-208946be161f tempest-ServerRescueNegativeTestJSON-922243851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cabe87e2-d2ff-4fb9-9b46-9c023870c8d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd20625a-a15e-4ec8-9033-a7bb738b0d0d', 'volume_name': 'volume-cd20625a-a15e-4ec8-9033-a7bb738b0d0d', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:39:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a926f5c1-7897-4fd4-9c29-208946be161f tempest-ServerRescueNegativeTestJSON-922243851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b15725e-5166-4c06-b651-b9debe0905b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:39:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a926f5c1-7897-4fd4-9c29-208946be161f tempest-ServerRescueNegativeTestJSON-922243851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b15725e-5166-4c06-b651-b9debe0905b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:39:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a926f5c1-7897-4fd4-9c29-208946be161f tempest-ServerRescueNegativeTestJSON-922243851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bdae088-d979-4683-b8e2-628104e608b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:39:28 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-a926f5c1-7897-4fd4-9c29-208946be161f tempest-ServerRescueNegativeTestJSON-922243851 None] Volume cd20625a-a15e-4ec8-9033-a7bb738b0d0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd20625a-a15e-4ec8-9033-a7bb738b0d0d', 'volume_size': 1} Aug 11 04:39:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a926f5c1-7897-4fd4-9c29-208946be161f tempest-ServerRescueNegativeTestJSON-922243851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:39:28 devstack sudo[97255]: pam_unix(sudo:session): session closed for user root Aug 11 04:39:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-024def37-cc50-4ce5-b96f-006865a1b910 tempest-GroupSnapshotsTest-1060963943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1c0ebe8f-1c0f-4771-a237-a4f1adac9c58" returned: 0 in 0.687s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:39:28 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-024def37-cc50-4ce5-b96f-006865a1b910 tempest-GroupSnapshotsTest-1060963943 None] Lock "cinder-quobyte-1c0ebe8f-1c0f-4771-a237-a4f1adac9c58" released by "_copy_volume_from_snapshot" :: held 12.231s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:39:28 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-024def37-cc50-4ce5-b96f-006865a1b910 tempest-GroupSnapshotsTest-1060963943 None] Lock "cinder-quobyte-0cde9bb8-027d-4915-bee1-da9dbf66c8cc-1c0ebe8f-1c0f-4771-a237-a4f1adac9c58" released by "_create_volume_from_snapshot" :: held 12.339s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:39:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-024def37-cc50-4ce5-b96f-006865a1b910 tempest-GroupSnapshotsTest-1060963943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.381s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:39:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a926f5c1-7897-4fd4-9c29-208946be161f tempest-ServerRescueNegativeTestJSON-922243851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.125s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:39:28 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a926f5c1-7897-4fd4-9c29-208946be161f tempest-ServerRescueNegativeTestJSON-922243851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:39:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1439467193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd20625a-a15e-4ec8-9033-a7bb738b0d0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25e04213980e48dc9da403f8ff4707d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:39:28Z,use_quota=True,user_id='8d0d6eb776674d0487fac42108b85995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:39:28 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-a926f5c1-7897-4fd4-9c29-208946be161f tempest-ServerRescueNegativeTestJSON-922243851 None] Creating volume cd20625a-a15e-4ec8-9033-a7bb738b0d0d {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:39:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a926f5c1-7897-4fd4-9c29-208946be161f tempest-ServerRescueNegativeTestJSON-922243851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:39:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a926f5c1-7897-4fd4-9c29-208946be161f tempest-ServerRescueNegativeTestJSON-922243851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:39:28 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a926f5c1-7897-4fd4-9c29-208946be161f tempest-ServerRescueNegativeTestJSON-922243851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:39:28 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a926f5c1-7897-4fd4-9c29-208946be161f tempest-ServerRescueNegativeTestJSON-922243851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:39:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a926f5c1-7897-4fd4-9c29-208946be161f tempest-ServerRescueNegativeTestJSON-922243851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:39:28 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a926f5c1-7897-4fd4-9c29-208946be161f tempest-ServerRescueNegativeTestJSON-922243851 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:39:28 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-a926f5c1-7897-4fd4-9c29-208946be161f tempest-ServerRescueNegativeTestJSON-922243851 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:39:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a926f5c1-7897-4fd4-9c29-208946be161f tempest-ServerRescueNegativeTestJSON-922243851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cd20625a-a15e-4ec8-9033-a7bb738b0d0d 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:39:28 devstack sudo[97260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cd20625a-a15e-4ec8-9033-a7bb738b0d0d 1073741824 Aug 11 04:39:28 devstack sudo[97260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:39:28 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-024def37-cc50-4ce5-b96f-006865a1b910 tempest-GroupSnapshotsTest-1060963943 None] Create group from source-snapshot-226c9a75-3ded-4b84-9e9c-39f0b445222e completed successfully. Aug 11 04:39:29 devstack sudo[97260]: pam_unix(sudo:session): session closed for user root Aug 11 04:39:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a926f5c1-7897-4fd4-9c29-208946be161f tempest-ServerRescueNegativeTestJSON-922243851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cd20625a-a15e-4ec8-9033-a7bb738b0d0d 1073741824" returned: 0 in 0.736s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:39:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a926f5c1-7897-4fd4-9c29-208946be161f tempest-ServerRescueNegativeTestJSON-922243851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cd20625a-a15e-4ec8-9033-a7bb738b0d0d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:39:29 devstack sudo[97265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cd20625a-a15e-4ec8-9033-a7bb738b0d0d Aug 11 04:39:29 devstack sudo[97265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:39:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d801320b-8056-4ba6-84e6-c4af599aa4ac tempest-GroupSnapshotsTest-1060963943 None] Acquiring lock "cinder-quobyte-1c0ebe8f-1c0f-4771-a237-a4f1adac9c58" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:39:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d801320b-8056-4ba6-84e6-c4af599aa4ac tempest-GroupSnapshotsTest-1060963943 None] Lock "cinder-quobyte-1c0ebe8f-1c0f-4771-a237-a4f1adac9c58" acquired by "delete_volume" :: waited 0.052s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:39:30 devstack sudo[97265]: pam_unix(sudo:session): session closed for user root Aug 11 04:39:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a926f5c1-7897-4fd4-9c29-208946be161f tempest-ServerRescueNegativeTestJSON-922243851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cd20625a-a15e-4ec8-9033-a7bb738b0d0d" returned: 0 in 0.849s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:39:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a926f5c1-7897-4fd4-9c29-208946be161f tempest-ServerRescueNegativeTestJSON-922243851 None] <== create_volume: return (1665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:39:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a926f5c1-7897-4fd4-9c29-208946be161f tempest-ServerRescueNegativeTestJSON-922243851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.671s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:39:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a926f5c1-7897-4fd4-9c29-208946be161f tempest-ServerRescueNegativeTestJSON-922243851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bdae088-d979-4683-b8e2-628104e608b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd20625a-a15e-4ec8-9033-a7bb738b0d0d', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:39:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a926f5c1-7897-4fd4-9c29-208946be161f tempest-ServerRescueNegativeTestJSON-922243851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (090b7176-030d-4b4a-8be4-07a479e483bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:39:30 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5eccd01-0271-486e-9097-d54b679a0483]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:39:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d801320b-8056-4ba6-84e6-c4af599aa4ac tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1c0ebe8f-1c0f-4771-a237-a4f1adac9c58 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:39:30 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-a926f5c1-7897-4fd4-9c29-208946be161f tempest-ServerRescueNegativeTestJSON-922243851 None] Volume volume-cd20625a-a15e-4ec8-9033-a7bb738b0d0d (cd20625a-a15e-4ec8-9033-a7bb738b0d0d): created successfully Aug 11 04:39:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a926f5c1-7897-4fd4-9c29-208946be161f tempest-ServerRescueNegativeTestJSON-922243851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (090b7176-030d-4b4a-8be4-07a479e483bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:39:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a926f5c1-7897-4fd4-9c29-208946be161f tempest-ServerRescueNegativeTestJSON-922243851 None] Flow 'volume_create_manager' (9618f2cc-04c7-4824-a5b8-83a41e0a4bff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:39:30 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-a926f5c1-7897-4fd4-9c29-208946be161f tempest-ServerRescueNegativeTestJSON-922243851 None] Created volume successfully. Aug 11 04:39:30 devstack sudo[97300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1c0ebe8f-1c0f-4771-a237-a4f1adac9c58 Aug 11 04:39:30 devstack sudo[97300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:39:31 devstack sudo[97300]: pam_unix(sudo:session): session closed for user root Aug 11 04:39:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d801320b-8056-4ba6-84e6-c4af599aa4ac tempest-GroupSnapshotsTest-1060963943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1c0ebe8f-1c0f-4771-a237-a4f1adac9c58" returned: 0 in 0.941s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:39:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d801320b-8056-4ba6-84e6-c4af599aa4ac tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1c0ebe8f-1c0f-4771-a237-a4f1adac9c58 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:39:31 devstack sudo[97329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1c0ebe8f-1c0f-4771-a237-a4f1adac9c58 Aug 11 04:39:31 devstack sudo[97329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:39:32 devstack sudo[97329]: pam_unix(sudo:session): session closed for user root Aug 11 04:39:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d801320b-8056-4ba6-84e6-c4af599aa4ac tempest-GroupSnapshotsTest-1060963943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1c0ebe8f-1c0f-4771-a237-a4f1adac9c58" returned: 0 in 0.665s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:39:32 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d801320b-8056-4ba6-84e6-c4af599aa4ac tempest-GroupSnapshotsTest-1060963943 None] Lock "cinder-quobyte-1c0ebe8f-1c0f-4771-a237-a4f1adac9c58" released by "delete_volume" :: held 1.752s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:39:32 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-d801320b-8056-4ba6-84e6-c4af599aa4ac tempest-GroupSnapshotsTest-1060963943 None] Created reservations ['3a17db48-5228-43b5-bc3e-b4c422cd449c'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:39:32 devstack cinder-volume[94472]: WARNING cinder.quota [None req-d801320b-8056-4ba6-84e6-c4af599aa4ac tempest-GroupSnapshotsTest-1060963943 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1651851370 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1651851370, it is now deprecated. Please use the default quota class for default quota. Aug 11 04:39:32 devstack cinder-volume[94472]: WARNING cinder.quota [None req-d801320b-8056-4ba6-84e6-c4af599aa4ac tempest-GroupSnapshotsTest-1060963943 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1651851370 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1651851370, it is now deprecated. Please use the default quota class for default quota. Aug 11 04:39:32 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-d801320b-8056-4ba6-84e6-c4af599aa4ac tempest-GroupSnapshotsTest-1060963943 None] Created reservations ['b509be86-0b65-48d9-9d71-5dc3f490c863', '093a61f1-cc9e-45cd-bc9c-b936bc08029f', '420521c8-c020-4279-8070-a77add8a7b44', '5690ec56-ef21-4ca1-8acb-669964714d3f'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:39:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d801320b-8056-4ba6-84e6-c4af599aa4ac tempest-GroupSnapshotsTest-1060963943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:39:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d801320b-8056-4ba6-84e6-c4af599aa4ac tempest-GroupSnapshotsTest-1060963943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:39:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d801320b-8056-4ba6-84e6-c4af599aa4ac tempest-GroupSnapshotsTest-1060963943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:39:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d801320b-8056-4ba6-84e6-c4af599aa4ac tempest-GroupSnapshotsTest-1060963943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:39:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d801320b-8056-4ba6-84e6-c4af599aa4ac tempest-GroupSnapshotsTest-1060963943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:39:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d801320b-8056-4ba6-84e6-c4af599aa4ac tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:39:32 devstack sudo[97371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:39:32 devstack sudo[97371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:39:33 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-8973a7bd-35ae-473e-af3a-ff9c5b44d00e tempest-GroupSnapshotsTest-1060963943 None] group_snapshot 226c9a75-3ded-4b84-9e9c-39f0b445222e: deleting Aug 11 04:39:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8973a7bd-35ae-473e-af3a-ff9c5b44d00e tempest-GroupSnapshotsTest-1060963943 None] group_snapshot 226c9a75-3ded-4b84-9e9c-39f0b445222e: deleting {{(pid=94472) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 11 04:39:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8973a7bd-35ae-473e-af3a-ff9c5b44d00e tempest-GroupSnapshotsTest-1060963943 None] Acquiring lock "cinder-quobyte-6f28b9a8-46bd-4ebc-be86-568ef20888a6" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:39:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8973a7bd-35ae-473e-af3a-ff9c5b44d00e tempest-GroupSnapshotsTest-1060963943 None] Lock "cinder-quobyte-6f28b9a8-46bd-4ebc-be86-568ef20888a6" acquired by "delete_snapshot" :: waited 0.044s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:39:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8973a7bd-35ae-473e-af3a-ff9c5b44d00e tempest-GroupSnapshotsTest-1060963943 None] Acquiring lock "cinder-quobyte-0cde9bb8-027d-4915-bee1-da9dbf66c8cc" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:39:33 devstack sudo[97371]: pam_unix(sudo:session): session closed for user root Aug 11 04:39:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d801320b-8056-4ba6-84e6-c4af599aa4ac tempest-GroupSnapshotsTest-1060963943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.856s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:39:33 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-d801320b-8056-4ba6-84e6-c4af599aa4ac tempest-GroupSnapshotsTest-1060963943 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:39:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8973a7bd-35ae-473e-af3a-ff9c5b44d00e tempest-GroupSnapshotsTest-1060963943 None] Lock "cinder-quobyte-0cde9bb8-027d-4915-bee1-da9dbf66c8cc" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:39:33 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-8973a7bd-35ae-473e-af3a-ff9c5b44d00e tempest-GroupSnapshotsTest-1060963943 None] Deleting offline snapshot 0cde9bb8-027d-4915-bee1-da9dbf66c8cc of volume 6f28b9a8-46bd-4ebc-be86-568ef20888a6 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 04:39:33 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-8973a7bd-35ae-473e-af3a-ff9c5b44d00e tempest-GroupSnapshotsTest-1060963943 None] snapshot_file for this snap is: volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6.0cde9bb8-027d-4915-bee1-da9dbf66c8cc {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 04:39:33 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-d801320b-8056-4ba6-84e6-c4af599aa4ac tempest-GroupSnapshotsTest-1060963943 None] Delete group completed successfully. Aug 11 04:39:33 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c85e7d-aafd-4aa5-90b2-bb9b38072c07]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:39:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8973a7bd-35ae-473e-af3a-ff9c5b44d00e tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6.0cde9bb8-027d-4915-bee1-da9dbf66c8cc {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:39:33 devstack sudo[97393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6.0cde9bb8-027d-4915-bee1-da9dbf66c8cc Aug 11 04:39:33 devstack sudo[97393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:39:34 devstack sudo[97393]: pam_unix(sudo:session): session closed for user root Aug 11 04:39:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8973a7bd-35ae-473e-af3a-ff9c5b44d00e tempest-GroupSnapshotsTest-1060963943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6.0cde9bb8-027d-4915-bee1-da9dbf66c8cc" returned: 0 in 1.009s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:39:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-8973a7bd-35ae-473e-af3a-ff9c5b44d00e tempest-GroupSnapshotsTest-1060963943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:39:34 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5cb467-3f1f-432b-b87a-8e50c9d01678]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:39:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8973a7bd-35ae-473e-af3a-ff9c5b44d00e tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:39:35 devstack sudo[97403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6 Aug 11 04:39:35 devstack sudo[97403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:39:36 devstack sudo[97403]: pam_unix(sudo:session): session closed for user root Aug 11 04:39:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8973a7bd-35ae-473e-af3a-ff9c5b44d00e tempest-GroupSnapshotsTest-1060963943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6" returned: 0 in 1.320s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:39:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8973a7bd-35ae-473e-af3a-ff9c5b44d00e tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6.0cde9bb8-027d-4915-bee1-da9dbf66c8cc {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:39:36 devstack sudo[97445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6.0cde9bb8-027d-4915-bee1-da9dbf66c8cc Aug 11 04:39:36 devstack sudo[97445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:39:37 devstack sudo[97445]: pam_unix(sudo:session): session closed for user root Aug 11 04:39:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8973a7bd-35ae-473e-af3a-ff9c5b44d00e tempest-GroupSnapshotsTest-1060963943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6.0cde9bb8-027d-4915-bee1-da9dbf66c8cc" returned: 0 in 0.934s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:39:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8973a7bd-35ae-473e-af3a-ff9c5b44d00e tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6.0cde9bb8-027d-4915-bee1-da9dbf66c8cc {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:39:37 devstack sudo[97463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6.0cde9bb8-027d-4915-bee1-da9dbf66c8cc Aug 11 04:39:37 devstack sudo[97463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:39:37 devstack sudo[97463]: pam_unix(sudo:session): session closed for user root Aug 11 04:39:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8973a7bd-35ae-473e-af3a-ff9c5b44d00e tempest-GroupSnapshotsTest-1060963943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6.0cde9bb8-027d-4915-bee1-da9dbf66c8cc" returned: 0 in 0.468s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:39:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8973a7bd-35ae-473e-af3a-ff9c5b44d00e tempest-GroupSnapshotsTest-1060963943 None] Lock "cinder-quobyte-0cde9bb8-027d-4915-bee1-da9dbf66c8cc" released by "_delete_snapshot" :: held 3.956s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:39:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8973a7bd-35ae-473e-af3a-ff9c5b44d00e tempest-GroupSnapshotsTest-1060963943 None] Lock "cinder-quobyte-6f28b9a8-46bd-4ebc-be86-568ef20888a6" released by "delete_snapshot" :: held 4.021s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:39:37 devstack cinder-volume[94472]: WARNING cinder.quota [None req-8973a7bd-35ae-473e-af3a-ff9c5b44d00e tempest-GroupSnapshotsTest-1060963943 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1651851370 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1651851370, it is now deprecated. Please use the default quota class for default quota. Aug 11 04:39:37 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-8973a7bd-35ae-473e-af3a-ff9c5b44d00e tempest-GroupSnapshotsTest-1060963943 None] Created reservations ['ed8e4aea-dc2b-4425-8ac3-218ac4e7f670', '373227b1-e2ec-47ac-b9b6-c69bef279e10', 'ee4e1636-6c1d-44c4-9152-4f3f9e6ab0e6', 'ce4a8fa7-8a13-465c-ae32-ae1eb76b24a9'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:39:37 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-8973a7bd-35ae-473e-af3a-ff9c5b44d00e tempest-GroupSnapshotsTest-1060963943 None] group_snapshot 226c9a75-3ded-4b84-9e9c-39f0b445222e: deleted successfully Aug 11 04:39:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-340cc88b-7491-49d8-ab16-6df63a538f81 tempest-GroupSnapshotsTest-1060963943 None] Acquiring lock "cinder-quobyte-6f28b9a8-46bd-4ebc-be86-568ef20888a6" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:39:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-340cc88b-7491-49d8-ab16-6df63a538f81 tempest-GroupSnapshotsTest-1060963943 None] Lock "cinder-quobyte-6f28b9a8-46bd-4ebc-be86-568ef20888a6" acquired by "delete_volume" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:39:39 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83dc9bf-d9d8-45d6-bdc4-fa02b3e78ea6]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:39:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-340cc88b-7491-49d8-ab16-6df63a538f81 tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:39:39 devstack sudo[97507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6 Aug 11 04:39:39 devstack sudo[97507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:39:39 devstack sudo[97507]: pam_unix(sudo:session): session closed for user root Aug 11 04:39:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-340cc88b-7491-49d8-ab16-6df63a538f81 tempest-GroupSnapshotsTest-1060963943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6" returned: 0 in 0.678s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:39:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-340cc88b-7491-49d8-ab16-6df63a538f81 tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:39:39 devstack sudo[97513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6 Aug 11 04:39:39 devstack sudo[97513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:39:40 devstack sudo[97513]: pam_unix(sudo:session): session closed for user root Aug 11 04:39:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-340cc88b-7491-49d8-ab16-6df63a538f81 tempest-GroupSnapshotsTest-1060963943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6f28b9a8-46bd-4ebc-be86-568ef20888a6" returned: 0 in 0.342s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:39:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-340cc88b-7491-49d8-ab16-6df63a538f81 tempest-GroupSnapshotsTest-1060963943 None] Lock "cinder-quobyte-6f28b9a8-46bd-4ebc-be86-568ef20888a6" released by "delete_volume" :: held 1.151s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:39:40 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-340cc88b-7491-49d8-ab16-6df63a538f81 tempest-GroupSnapshotsTest-1060963943 None] Created reservations ['05f09c5d-ad97-4ed8-acf9-a2626a7452b4'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:39:40 devstack cinder-volume[94472]: WARNING cinder.db.api [None req-340cc88b-7491-49d8-ab16-6df63a538f81 tempest-GroupSnapshotsTest-1060963943 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1651851370'] Aug 11 04:39:40 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-340cc88b-7491-49d8-ab16-6df63a538f81 tempest-GroupSnapshotsTest-1060963943 None] Created reservations ['ea8e258a-4288-45e4-b43c-6e7b957f642d', '1202687d-be05-44f7-b35a-65e0cf42b636', '626760b9-8884-4762-93ec-e8c0c653668e', '56375ac3-8037-44f2-92ee-36e8690fc381'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:39:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-340cc88b-7491-49d8-ab16-6df63a538f81 tempest-GroupSnapshotsTest-1060963943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:39:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-340cc88b-7491-49d8-ab16-6df63a538f81 tempest-GroupSnapshotsTest-1060963943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:39:40 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-340cc88b-7491-49d8-ab16-6df63a538f81 tempest-GroupSnapshotsTest-1060963943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:39:40 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-340cc88b-7491-49d8-ab16-6df63a538f81 tempest-GroupSnapshotsTest-1060963943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:39:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-340cc88b-7491-49d8-ab16-6df63a538f81 tempest-GroupSnapshotsTest-1060963943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:39:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-340cc88b-7491-49d8-ab16-6df63a538f81 tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:39:40 devstack sudo[97517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:39:40 devstack sudo[97517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:39:40 devstack sudo[97517]: pam_unix(sudo:session): session closed for user root Aug 11 04:39:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-340cc88b-7491-49d8-ab16-6df63a538f81 tempest-GroupSnapshotsTest-1060963943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.328s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:39:40 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-340cc88b-7491-49d8-ab16-6df63a538f81 tempest-GroupSnapshotsTest-1060963943 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:39:40 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-340cc88b-7491-49d8-ab16-6df63a538f81 tempest-GroupSnapshotsTest-1060963943 None] Delete group completed successfully. Aug 11 04:39:42 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-37b16131-e105-4902-a676-a18c83031325 req-8d90d549-3d32-437d-ba6a-dd4fc505565c tempest-AttachVolumeNegativeTest-2108237366 None] Terminate volume connection completed successfully. Aug 11 04:39:42 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-37b16131-e105-4902-a676-a18c83031325 req-8d90d549-3d32-437d-ba6a-dd4fc505565c tempest-AttachVolumeNegativeTest-2108237366 None] Deleting attachment 15b2a4ae-924f-4f3c-a27c-c08bd1e484e3. {{(pid=94472) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 11 04:39:42 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-ba487945-9331-4895-900e-1178a5484f83 tempest-GroupSnapshotsTest-1060963943 None] Group tempest-GroupSnapshotsTest-Group-1912814434: creating Aug 11 04:39:42 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-ba487945-9331-4895-900e-1178a5484f83 tempest-GroupSnapshotsTest-1060963943 None] Group tempest-GroupSnapshotsTest-Group-1912814434: created successfully Aug 11 04:39:42 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-ba487945-9331-4895-900e-1178a5484f83 tempest-GroupSnapshotsTest-1060963943 None] Create group completed successfully. Aug 11 04:39:45 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f388174-ae22-46d1-9efd-2a95615dc858 tempest-GroupSnapshotsTest-1060963943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:39:45 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6f388174-ae22-46d1-9efd-2a95615dc858 tempest-GroupSnapshotsTest-1060963943 None] Flow 'volume_create_manager' (b448e8b0-94ba-4d1a-9c07-b559f4c036bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:39:45 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6f388174-ae22-46d1-9efd-2a95615dc858 tempest-GroupSnapshotsTest-1060963943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81efd4c5-3499-409d-ab02-76a8b2b20ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:39:45 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6f388174-ae22-46d1-9efd-2a95615dc858 tempest-GroupSnapshotsTest-1060963943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81efd4c5-3499-409d-ab02-76a8b2b20ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:39:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-468809278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cbf15d86-f303-459b-91ce-5e64c645f04c,host='devstack@QuobyteHD#QuobyteHD',id=a199f5f4-9377-4210-96aa-f046371a5c9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91dee1da4e784a3a969e352513ea5c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:39:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:39:45Z,use_quota=True,user_id='008a888043964369942c83be353f327c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45ee98c3-177b-439d-a7aa-a321ef16feb9),volume_type_id=45ee98c3-177b-439d-a7aa-a321ef16feb9)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:39:45 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6f388174-ae22-46d1-9efd-2a95615dc858 tempest-GroupSnapshotsTest-1060963943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cac4beb4-16db-4651-af2a-50a10044e29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:39:45 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6f388174-ae22-46d1-9efd-2a95615dc858 tempest-GroupSnapshotsTest-1060963943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cac4beb4-16db-4651-af2a-50a10044e29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:39:45 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6f388174-ae22-46d1-9efd-2a95615dc858 tempest-GroupSnapshotsTest-1060963943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3ae3656-1d30-485c-bf24-2f34f48d8ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:39:45 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6f388174-ae22-46d1-9efd-2a95615dc858 tempest-GroupSnapshotsTest-1060963943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3ae3656-1d30-485c-bf24-2f34f48d8ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a199f5f4-9377-4210-96aa-f046371a5c9b', 'volume_name': 'volume-a199f5f4-9377-4210-96aa-f046371a5c9b', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:39:45 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6f388174-ae22-46d1-9efd-2a95615dc858 tempest-GroupSnapshotsTest-1060963943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a74784bc-9432-4ab6-b6d9-4009cf6a1e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:39:45 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6f388174-ae22-46d1-9efd-2a95615dc858 tempest-GroupSnapshotsTest-1060963943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a74784bc-9432-4ab6-b6d9-4009cf6a1e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:39:45 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6f388174-ae22-46d1-9efd-2a95615dc858 tempest-GroupSnapshotsTest-1060963943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bef16ef7-181f-4835-b932-753c4b4310bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:39:45 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-6f388174-ae22-46d1-9efd-2a95615dc858 tempest-GroupSnapshotsTest-1060963943 None] Volume a199f5f4-9377-4210-96aa-f046371a5c9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a199f5f4-9377-4210-96aa-f046371a5c9b', 'volume_size': 1} Aug 11 04:39:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6f388174-ae22-46d1-9efd-2a95615dc858 tempest-GroupSnapshotsTest-1060963943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:39:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6f388174-ae22-46d1-9efd-2a95615dc858 tempest-GroupSnapshotsTest-1060963943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:39:45 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6f388174-ae22-46d1-9efd-2a95615dc858 tempest-GroupSnapshotsTest-1060963943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=cbf15d86-f303-459b-91ce-5e64c645f04c,created_at=2026-08-11T02:39:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-468809278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cbf15d86-f303-459b-91ce-5e64c645f04c,host='devstack@QuobyteHD#QuobyteHD',id=a199f5f4-9377-4210-96aa-f046371a5c9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91dee1da4e784a3a969e352513ea5c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:39:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:39:45Z,use_quota=True,user_id='008a888043964369942c83be353f327c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45ee98c3-177b-439d-a7aa-a321ef16feb9),volume_type_id=45ee98c3-177b-439d-a7aa-a321ef16feb9)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:39:45 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-6f388174-ae22-46d1-9efd-2a95615dc858 tempest-GroupSnapshotsTest-1060963943 None] Creating volume a199f5f4-9377-4210-96aa-f046371a5c9b {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:39:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6f388174-ae22-46d1-9efd-2a95615dc858 tempest-GroupSnapshotsTest-1060963943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:39:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6f388174-ae22-46d1-9efd-2a95615dc858 tempest-GroupSnapshotsTest-1060963943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:39:45 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6f388174-ae22-46d1-9efd-2a95615dc858 tempest-GroupSnapshotsTest-1060963943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:39:45 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6f388174-ae22-46d1-9efd-2a95615dc858 tempest-GroupSnapshotsTest-1060963943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:39:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6f388174-ae22-46d1-9efd-2a95615dc858 tempest-GroupSnapshotsTest-1060963943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:39:45 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6f388174-ae22-46d1-9efd-2a95615dc858 tempest-GroupSnapshotsTest-1060963943 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:39:45 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-6f388174-ae22-46d1-9efd-2a95615dc858 tempest-GroupSnapshotsTest-1060963943 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:39:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6f388174-ae22-46d1-9efd-2a95615dc858 tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a199f5f4-9377-4210-96aa-f046371a5c9b 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:39:45 devstack sudo[97600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a199f5f4-9377-4210-96aa-f046371a5c9b 1073741824 Aug 11 04:39:45 devstack sudo[97600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:39:46 devstack sudo[97600]: pam_unix(sudo:session): session closed for user root Aug 11 04:39:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6f388174-ae22-46d1-9efd-2a95615dc858 tempest-GroupSnapshotsTest-1060963943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a199f5f4-9377-4210-96aa-f046371a5c9b 1073741824" returned: 0 in 1.159s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:39:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6f388174-ae22-46d1-9efd-2a95615dc858 tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a199f5f4-9377-4210-96aa-f046371a5c9b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:39:46 devstack sudo[97616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a199f5f4-9377-4210-96aa-f046371a5c9b Aug 11 04:39:46 devstack sudo[97616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:39:47 devstack sudo[97616]: pam_unix(sudo:session): session closed for user root Aug 11 04:39:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6f388174-ae22-46d1-9efd-2a95615dc858 tempest-GroupSnapshotsTest-1060963943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a199f5f4-9377-4210-96aa-f046371a5c9b" returned: 0 in 0.608s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:39:47 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6f388174-ae22-46d1-9efd-2a95615dc858 tempest-GroupSnapshotsTest-1060963943 None] <== create_volume: return (1919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:39:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6f388174-ae22-46d1-9efd-2a95615dc858 tempest-GroupSnapshotsTest-1060963943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.922s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:39:47 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6f388174-ae22-46d1-9efd-2a95615dc858 tempest-GroupSnapshotsTest-1060963943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bef16ef7-181f-4835-b932-753c4b4310bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a199f5f4-9377-4210-96aa-f046371a5c9b', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:39:47 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6f388174-ae22-46d1-9efd-2a95615dc858 tempest-GroupSnapshotsTest-1060963943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6af50a9d-d593-44ee-b4be-71efea74648f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:39:47 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-6f388174-ae22-46d1-9efd-2a95615dc858 tempest-GroupSnapshotsTest-1060963943 None] Volume volume-a199f5f4-9377-4210-96aa-f046371a5c9b (a199f5f4-9377-4210-96aa-f046371a5c9b): created successfully Aug 11 04:39:47 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6f388174-ae22-46d1-9efd-2a95615dc858 tempest-GroupSnapshotsTest-1060963943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6af50a9d-d593-44ee-b4be-71efea74648f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:39:47 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6f388174-ae22-46d1-9efd-2a95615dc858 tempest-GroupSnapshotsTest-1060963943 None] Flow 'volume_create_manager' (b448e8b0-94ba-4d1a-9c07-b559f4c036bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:39:47 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-6f388174-ae22-46d1-9efd-2a95615dc858 tempest-GroupSnapshotsTest-1060963943 None] Created volume successfully. Aug 11 04:39:48 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e0f31af9-e42e-4a53-8cfb-be17a5a815e7 tempest-ServerRescueNegativeTestJSON-922243851 None] Acquiring lock "cinder-cd20625a-a15e-4ec8-9033-a7bb738b0d0d-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:39:48 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e0f31af9-e42e-4a53-8cfb-be17a5a815e7 tempest-ServerRescueNegativeTestJSON-922243851 None] Lock "cinder-cd20625a-a15e-4ec8-9033-a7bb738b0d0d-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:39:48 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e0f31af9-e42e-4a53-8cfb-be17a5a815e7 tempest-ServerRescueNegativeTestJSON-922243851 None] Acquiring lock "cinder-quobyte-cd20625a-a15e-4ec8-9033-a7bb738b0d0d" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:39:48 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e0f31af9-e42e-4a53-8cfb-be17a5a815e7 tempest-ServerRescueNegativeTestJSON-922243851 None] Lock "cinder-quobyte-cd20625a-a15e-4ec8-9033-a7bb738b0d0d" acquired by "delete_volume" :: waited 0.042s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:39:48 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf45013-1a89-43c2-b4b4-a4d3a8af9c29]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:39:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e0f31af9-e42e-4a53-8cfb-be17a5a815e7 tempest-ServerRescueNegativeTestJSON-922243851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cd20625a-a15e-4ec8-9033-a7bb738b0d0d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:39:49 devstack sudo[97668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cd20625a-a15e-4ec8-9033-a7bb738b0d0d Aug 11 04:39:49 devstack sudo[97668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:39:49 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-4aae32ce-ae40-4b18-beca-33feb8a30d61 tempest-GroupSnapshotsTest-1060963943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:39:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4aae32ce-ae40-4b18-beca-33feb8a30d61 tempest-GroupSnapshotsTest-1060963943 None] Flow 'volume_create_manager' (16c868f1-01f5-4bec-ace8-80fb8652f036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:39:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4aae32ce-ae40-4b18-beca-33feb8a30d61 tempest-GroupSnapshotsTest-1060963943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af670f84-ba9b-441e-830a-bc2b8b834a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:39:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4aae32ce-ae40-4b18-beca-33feb8a30d61 tempest-GroupSnapshotsTest-1060963943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af670f84-ba9b-441e-830a-bc2b8b834a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:39:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1141816172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cbf15d86-f303-459b-91ce-5e64c645f04c,host='devstack@QuobyteHD#QuobyteHD',id=e31a8307-2ad7-4cc0-a7eb-f451721b8e96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91dee1da4e784a3a969e352513ea5c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:39:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:39:49Z,use_quota=True,user_id='008a888043964369942c83be353f327c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45ee98c3-177b-439d-a7aa-a321ef16feb9),volume_type_id=45ee98c3-177b-439d-a7aa-a321ef16feb9)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:39:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4aae32ce-ae40-4b18-beca-33feb8a30d61 tempest-GroupSnapshotsTest-1060963943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eac63f23-dc2e-4e68-9f33-b26405b8a039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:39:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4aae32ce-ae40-4b18-beca-33feb8a30d61 tempest-GroupSnapshotsTest-1060963943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eac63f23-dc2e-4e68-9f33-b26405b8a039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:39:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4aae32ce-ae40-4b18-beca-33feb8a30d61 tempest-GroupSnapshotsTest-1060963943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37a2ac15-e4b1-484a-ab48-491eefe9cbb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:39:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4aae32ce-ae40-4b18-beca-33feb8a30d61 tempest-GroupSnapshotsTest-1060963943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37a2ac15-e4b1-484a-ab48-491eefe9cbb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e31a8307-2ad7-4cc0-a7eb-f451721b8e96', 'volume_name': 'volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:39:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4aae32ce-ae40-4b18-beca-33feb8a30d61 tempest-GroupSnapshotsTest-1060963943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7763259-d7ce-41db-b6d9-ba34492c1691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:39:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4aae32ce-ae40-4b18-beca-33feb8a30d61 tempest-GroupSnapshotsTest-1060963943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7763259-d7ce-41db-b6d9-ba34492c1691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:39:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4aae32ce-ae40-4b18-beca-33feb8a30d61 tempest-GroupSnapshotsTest-1060963943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0af3482d-3a93-4826-86a3-c43b1934a29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:39:49 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-4aae32ce-ae40-4b18-beca-33feb8a30d61 tempest-GroupSnapshotsTest-1060963943 None] Volume e31a8307-2ad7-4cc0-a7eb-f451721b8e96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96', 'volume_size': 1} Aug 11 04:39:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4aae32ce-ae40-4b18-beca-33feb8a30d61 tempest-GroupSnapshotsTest-1060963943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:39:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4aae32ce-ae40-4b18-beca-33feb8a30d61 tempest-GroupSnapshotsTest-1060963943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:39:49 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4aae32ce-ae40-4b18-beca-33feb8a30d61 tempest-GroupSnapshotsTest-1060963943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=cbf15d86-f303-459b-91ce-5e64c645f04c,created_at=2026-08-11T02:39:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1141816172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cbf15d86-f303-459b-91ce-5e64c645f04c,host='devstack@QuobyteHD#QuobyteHD',id=e31a8307-2ad7-4cc0-a7eb-f451721b8e96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91dee1da4e784a3a969e352513ea5c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:39:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:39:49Z,use_quota=True,user_id='008a888043964369942c83be353f327c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45ee98c3-177b-439d-a7aa-a321ef16feb9),volume_type_id=45ee98c3-177b-439d-a7aa-a321ef16feb9)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:39:49 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-4aae32ce-ae40-4b18-beca-33feb8a30d61 tempest-GroupSnapshotsTest-1060963943 None] Creating volume e31a8307-2ad7-4cc0-a7eb-f451721b8e96 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:39:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4aae32ce-ae40-4b18-beca-33feb8a30d61 tempest-GroupSnapshotsTest-1060963943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:39:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4aae32ce-ae40-4b18-beca-33feb8a30d61 tempest-GroupSnapshotsTest-1060963943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:39:49 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4aae32ce-ae40-4b18-beca-33feb8a30d61 tempest-GroupSnapshotsTest-1060963943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:39:49 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4aae32ce-ae40-4b18-beca-33feb8a30d61 tempest-GroupSnapshotsTest-1060963943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:39:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4aae32ce-ae40-4b18-beca-33feb8a30d61 tempest-GroupSnapshotsTest-1060963943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:39:49 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4aae32ce-ae40-4b18-beca-33feb8a30d61 tempest-GroupSnapshotsTest-1060963943 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:39:49 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-4aae32ce-ae40-4b18-beca-33feb8a30d61 tempest-GroupSnapshotsTest-1060963943 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:39:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4aae32ce-ae40-4b18-beca-33feb8a30d61 tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:39:49 devstack sudo[97671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96 1073741824 Aug 11 04:39:49 devstack sudo[97671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:39:49 devstack sudo[97668]: pam_unix(sudo:session): session closed for user root Aug 11 04:39:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e0f31af9-e42e-4a53-8cfb-be17a5a815e7 tempest-ServerRescueNegativeTestJSON-922243851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cd20625a-a15e-4ec8-9033-a7bb738b0d0d" returned: 0 in 0.850s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:39:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e0f31af9-e42e-4a53-8cfb-be17a5a815e7 tempest-ServerRescueNegativeTestJSON-922243851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cd20625a-a15e-4ec8-9033-a7bb738b0d0d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:39:49 devstack sudo[97675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cd20625a-a15e-4ec8-9033-a7bb738b0d0d Aug 11 04:39:49 devstack sudo[97675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:39:50 devstack sudo[97675]: pam_unix(sudo:session): session closed for user root Aug 11 04:39:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e0f31af9-e42e-4a53-8cfb-be17a5a815e7 tempest-ServerRescueNegativeTestJSON-922243851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cd20625a-a15e-4ec8-9033-a7bb738b0d0d" returned: 0 in 0.340s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:39:50 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e0f31af9-e42e-4a53-8cfb-be17a5a815e7 tempest-ServerRescueNegativeTestJSON-922243851 None] Lock "cinder-quobyte-cd20625a-a15e-4ec8-9033-a7bb738b0d0d" released by "delete_volume" :: held 1.275s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:39:50 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-e0f31af9-e42e-4a53-8cfb-be17a5a815e7 tempest-ServerRescueNegativeTestJSON-922243851 None] Created reservations ['e75c4fd3-e4b0-4435-8318-58f1123da686', '93daf1fd-f196-43dc-81a3-546eb700012f', '75206fec-0fb4-41e8-ab84-be7eece60d14', '1cb0d7df-b5f7-41e2-8e9d-310bd6028a74'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:39:50 devstack sudo[97671]: pam_unix(sudo:session): session closed for user root Aug 11 04:39:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4aae32ce-ae40-4b18-beca-33feb8a30d61 tempest-GroupSnapshotsTest-1060963943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96 1073741824" returned: 0 in 0.725s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:39:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e0f31af9-e42e-4a53-8cfb-be17a5a815e7 tempest-ServerRescueNegativeTestJSON-922243851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:39:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e0f31af9-e42e-4a53-8cfb-be17a5a815e7 tempest-ServerRescueNegativeTestJSON-922243851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:39:50 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e0f31af9-e42e-4a53-8cfb-be17a5a815e7 tempest-ServerRescueNegativeTestJSON-922243851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:39:50 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e0f31af9-e42e-4a53-8cfb-be17a5a815e7 tempest-ServerRescueNegativeTestJSON-922243851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:39:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e0f31af9-e42e-4a53-8cfb-be17a5a815e7 tempest-ServerRescueNegativeTestJSON-922243851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:39:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e0f31af9-e42e-4a53-8cfb-be17a5a815e7 tempest-ServerRescueNegativeTestJSON-922243851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:39:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4aae32ce-ae40-4b18-beca-33feb8a30d61 tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:39:50 devstack sudo[97681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:39:50 devstack sudo[97681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:39:50 devstack sudo[97682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96 Aug 11 04:39:50 devstack sudo[97682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:39:50 devstack sudo[97681]: pam_unix(sudo:session): session closed for user root Aug 11 04:39:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e0f31af9-e42e-4a53-8cfb-be17a5a815e7 tempest-ServerRescueNegativeTestJSON-922243851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.271s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:39:50 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-e0f31af9-e42e-4a53-8cfb-be17a5a815e7 tempest-ServerRescueNegativeTestJSON-922243851 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:39:50 devstack sudo[97682]: pam_unix(sudo:session): session closed for user root Aug 11 04:39:50 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-e0f31af9-e42e-4a53-8cfb-be17a5a815e7 tempest-ServerRescueNegativeTestJSON-922243851 None] Deleted volume successfully. Aug 11 04:39:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4aae32ce-ae40-4b18-beca-33feb8a30d61 tempest-GroupSnapshotsTest-1060963943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96" returned: 0 in 0.271s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:39:50 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4aae32ce-ae40-4b18-beca-33feb8a30d61 tempest-GroupSnapshotsTest-1060963943 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:39:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4aae32ce-ae40-4b18-beca-33feb8a30d61 tempest-GroupSnapshotsTest-1060963943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:39:50 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4aae32ce-ae40-4b18-beca-33feb8a30d61 tempest-GroupSnapshotsTest-1060963943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0af3482d-3a93-4826-86a3-c43b1934a29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:39:50 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4aae32ce-ae40-4b18-beca-33feb8a30d61 tempest-GroupSnapshotsTest-1060963943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95b2ce69-59c2-4383-8d74-f7d4b3b3d611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:39:50 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e0f31af9-e42e-4a53-8cfb-be17a5a815e7 tempest-ServerRescueNegativeTestJSON-922243851 None] Lock "cinder-cd20625a-a15e-4ec8-9033-a7bb738b0d0d-delete_volume" released by "delete_volume" :: held 1.881s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:39:50 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-4aae32ce-ae40-4b18-beca-33feb8a30d61 tempest-GroupSnapshotsTest-1060963943 None] Volume volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96 (e31a8307-2ad7-4cc0-a7eb-f451721b8e96): created successfully Aug 11 04:39:50 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4aae32ce-ae40-4b18-beca-33feb8a30d61 tempest-GroupSnapshotsTest-1060963943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95b2ce69-59c2-4383-8d74-f7d4b3b3d611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:39:50 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4aae32ce-ae40-4b18-beca-33feb8a30d61 tempest-GroupSnapshotsTest-1060963943 None] Flow 'volume_create_manager' (16c868f1-01f5-4bec-ace8-80fb8652f036) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:39:50 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-4aae32ce-ae40-4b18-beca-33feb8a30d61 tempest-GroupSnapshotsTest-1060963943 None] Created volume successfully. Aug 11 04:39:52 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-c206f853-ea2f-4620-aae6-988dec28cb1b tempest-GroupSnapshotsTest-1060963943 None] Update group completed successfully. Aug 11 04:39:53 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-9964f8db-e055-49f1-a132-703c0067ec0c tempest-GroupSnapshotsTest-1060963943 None] Update group completed successfully. Aug 11 04:39:54 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-0dfec17e-a816-4079-a9fb-e8e0e49f6acb tempest-GroupSnapshotsTest-1060963943 None] Update group completed successfully. Aug 11 04:39:56 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-86b2c1ae-e6f7-4b28-ad10-20ea328021f9 tempest-GroupSnapshotsTest-1060963943 None] Update group completed successfully. Aug 11 04:39:57 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-769daa48-a33c-482c-b8c0-12ca9d120ed1 tempest-GroupSnapshotsTest-1060963943 None] GroupSnapshot aaf26b8b-56f0-40fb-9954-2e2259e3d0ca: creating. Aug 11 04:39:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-769daa48-a33c-482c-b8c0-12ca9d120ed1 tempest-GroupSnapshotsTest-1060963943 None] Group snapshot aaf26b8b-56f0-40fb-9954-2e2259e3d0ca: creating. {{(pid=94472) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 11 04:39:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-769daa48-a33c-482c-b8c0-12ca9d120ed1 tempest-GroupSnapshotsTest-1060963943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:39:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-769daa48-a33c-482c-b8c0-12ca9d120ed1 tempest-GroupSnapshotsTest-1060963943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:39:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-769daa48-a33c-482c-b8c0-12ca9d120ed1 tempest-GroupSnapshotsTest-1060963943 None] Creating offline snapshot 8885d7e0-7b96-4266-9e9d-88e63835fc6b of volume a199f5f4-9377-4210-96aa-f046371a5c9b {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 04:39:58 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9a9f1c-91f9-4d99-9c18-3e7245902479]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:39:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-769daa48-a33c-482c-b8c0-12ca9d120ed1 tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a199f5f4-9377-4210-96aa-f046371a5c9b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:39:58 devstack sudo[97769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a199f5f4-9377-4210-96aa-f046371a5c9b Aug 11 04:39:58 devstack sudo[97769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:39:58 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 04:39:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:39:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:39:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:39:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:39:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:39:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:39:58 devstack sudo[97776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:39:58 devstack sudo[97776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:39:58 devstack sudo[97769]: pam_unix(sudo:session): session closed for user root Aug 11 04:39:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-769daa48-a33c-482c-b8c0-12ca9d120ed1 tempest-GroupSnapshotsTest-1060963943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a199f5f4-9377-4210-96aa-f046371a5c9b" returned: 0 in 0.748s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:39:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-769daa48-a33c-482c-b8c0-12ca9d120ed1 tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a199f5f4-9377-4210-96aa-f046371a5c9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a199f5f4-9377-4210-96aa-f046371a5c9b.8885d7e0-7b96-4266-9e9d-88e63835fc6b 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:39:58 devstack sudo[97781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a199f5f4-9377-4210-96aa-f046371a5c9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a199f5f4-9377-4210-96aa-f046371a5c9b.8885d7e0-7b96-4266-9e9d-88e63835fc6b 1G Aug 11 04:39:58 devstack sudo[97781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:39:58 devstack sudo[97776]: pam_unix(sudo:session): session closed for user root Aug 11 04:39:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.408s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:39:58 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:39:59 devstack sudo[97781]: pam_unix(sudo:session): session closed for user root Aug 11 04:39:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-769daa48-a33c-482c-b8c0-12ca9d120ed1 tempest-GroupSnapshotsTest-1060963943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a199f5f4-9377-4210-96aa-f046371a5c9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a199f5f4-9377-4210-96aa-f046371a5c9b.8885d7e0-7b96-4266-9e9d-88e63835fc6b 1G" returned: 0 in 0.485s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:39:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-769daa48-a33c-482c-b8c0-12ca9d120ed1 tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a199f5f4-9377-4210-96aa-f046371a5c9b -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a199f5f4-9377-4210-96aa-f046371a5c9b.8885d7e0-7b96-4266-9e9d-88e63835fc6b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:39:59 devstack sudo[97788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a199f5f4-9377-4210-96aa-f046371a5c9b -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a199f5f4-9377-4210-96aa-f046371a5c9b.8885d7e0-7b96-4266-9e9d-88e63835fc6b Aug 11 04:39:59 devstack sudo[97788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:39:59 devstack sudo[97788]: pam_unix(sudo:session): session closed for user root Aug 11 04:39:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-769daa48-a33c-482c-b8c0-12ca9d120ed1 tempest-GroupSnapshotsTest-1060963943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a199f5f4-9377-4210-96aa-f046371a5c9b -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a199f5f4-9377-4210-96aa-f046371a5c9b.8885d7e0-7b96-4266-9e9d-88e63835fc6b" returned: 0 in 0.428s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:39:59 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-769daa48-a33c-482c-b8c0-12ca9d120ed1 tempest-GroupSnapshotsTest-1060963943 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a199f5f4-9377-4210-96aa-f046371a5c9b.8885d7e0-7b96-4266-9e9d-88e63835fc6b is being set with open permissions: ugo+rw: NotImplementedError Aug 11 04:39:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-769daa48-a33c-482c-b8c0-12ca9d120ed1 tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a199f5f4-9377-4210-96aa-f046371a5c9b.8885d7e0-7b96-4266-9e9d-88e63835fc6b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:39:59 devstack sudo[97796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a199f5f4-9377-4210-96aa-f046371a5c9b.8885d7e0-7b96-4266-9e9d-88e63835fc6b Aug 11 04:39:59 devstack sudo[97796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:00 devstack sudo[97796]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-769daa48-a33c-482c-b8c0-12ca9d120ed1 tempest-GroupSnapshotsTest-1060963943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a199f5f4-9377-4210-96aa-f046371a5c9b.8885d7e0-7b96-4266-9e9d-88e63835fc6b" returned: 0 in 0.334s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-769daa48-a33c-482c-b8c0-12ca9d120ed1 tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a199f5f4-9377-4210-96aa-f046371a5c9b.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:00 devstack sudo[97801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a199f5f4-9377-4210-96aa-f046371a5c9b.info Aug 11 04:40:00 devstack sudo[97801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:00 devstack sudo[97801]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-769daa48-a33c-482c-b8c0-12ca9d120ed1 tempest-GroupSnapshotsTest-1060963943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a199f5f4-9377-4210-96aa-f046371a5c9b.info" returned: 0 in 0.294s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:00 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-769daa48-a33c-482c-b8c0-12ca9d120ed1 tempest-GroupSnapshotsTest-1060963943 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a199f5f4-9377-4210-96aa-f046371a5c9b.info is being set with open permissions: ugo+rw: NotImplementedError Aug 11 04:40:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-769daa48-a33c-482c-b8c0-12ca9d120ed1 tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a199f5f4-9377-4210-96aa-f046371a5c9b.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:00 devstack sudo[97804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a199f5f4-9377-4210-96aa-f046371a5c9b.info Aug 11 04:40:00 devstack sudo[97804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:00 devstack sudo[97804]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-769daa48-a33c-482c-b8c0-12ca9d120ed1 tempest-GroupSnapshotsTest-1060963943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a199f5f4-9377-4210-96aa-f046371a5c9b.info" returned: 0 in 0.289s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-769daa48-a33c-482c-b8c0-12ca9d120ed1 tempest-GroupSnapshotsTest-1060963943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.714s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:40:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-769daa48-a33c-482c-b8c0-12ca9d120ed1 tempest-GroupSnapshotsTest-1060963943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:40:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-769daa48-a33c-482c-b8c0-12ca9d120ed1 tempest-GroupSnapshotsTest-1060963943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:40:00 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-769daa48-a33c-482c-b8c0-12ca9d120ed1 tempest-GroupSnapshotsTest-1060963943 None] Creating offline snapshot e4738330-1d2c-4b6a-8ebc-5f5180c03ba3 of volume e31a8307-2ad7-4cc0-a7eb-f451721b8e96 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 04:40:00 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[2209c616-68eb-49db-a78b-8c32d02ecd1f]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:40:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-769daa48-a33c-482c-b8c0-12ca9d120ed1 tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:00 devstack sudo[97807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96 Aug 11 04:40:00 devstack sudo[97807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:01 devstack sudo[97807]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-769daa48-a33c-482c-b8c0-12ca9d120ed1 tempest-GroupSnapshotsTest-1060963943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96" returned: 0 in 0.431s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-769daa48-a33c-482c-b8c0-12ca9d120ed1 tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96.e4738330-1d2c-4b6a-8ebc-5f5180c03ba3 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:01 devstack sudo[97813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96.e4738330-1d2c-4b6a-8ebc-5f5180c03ba3 1G Aug 11 04:40:01 devstack sudo[97813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:01 devstack sudo[97813]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-769daa48-a33c-482c-b8c0-12ca9d120ed1 tempest-GroupSnapshotsTest-1060963943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96.e4738330-1d2c-4b6a-8ebc-5f5180c03ba3 1G" returned: 0 in 0.478s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-769daa48-a33c-482c-b8c0-12ca9d120ed1 tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96.e4738330-1d2c-4b6a-8ebc-5f5180c03ba3 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:01 devstack sudo[97819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96.e4738330-1d2c-4b6a-8ebc-5f5180c03ba3 Aug 11 04:40:01 devstack sudo[97819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:02 devstack sudo[97819]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-769daa48-a33c-482c-b8c0-12ca9d120ed1 tempest-GroupSnapshotsTest-1060963943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96.e4738330-1d2c-4b6a-8ebc-5f5180c03ba3" returned: 0 in 0.415s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:02 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-769daa48-a33c-482c-b8c0-12ca9d120ed1 tempest-GroupSnapshotsTest-1060963943 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96.e4738330-1d2c-4b6a-8ebc-5f5180c03ba3 is being set with open permissions: ugo+rw: NotImplementedError Aug 11 04:40:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-769daa48-a33c-482c-b8c0-12ca9d120ed1 tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96.e4738330-1d2c-4b6a-8ebc-5f5180c03ba3 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:02 devstack sudo[97825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96.e4738330-1d2c-4b6a-8ebc-5f5180c03ba3 Aug 11 04:40:02 devstack sudo[97825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:02 devstack sudo[97825]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-769daa48-a33c-482c-b8c0-12ca9d120ed1 tempest-GroupSnapshotsTest-1060963943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96.e4738330-1d2c-4b6a-8ebc-5f5180c03ba3" returned: 0 in 0.341s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-769daa48-a33c-482c-b8c0-12ca9d120ed1 tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:02 devstack sudo[97830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96.info Aug 11 04:40:02 devstack sudo[97830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:02 devstack sudo[97830]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-769daa48-a33c-482c-b8c0-12ca9d120ed1 tempest-GroupSnapshotsTest-1060963943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96.info" returned: 0 in 0.472s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:02 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-769daa48-a33c-482c-b8c0-12ca9d120ed1 tempest-GroupSnapshotsTest-1060963943 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96.info is being set with open permissions: ugo+rw: NotImplementedError Aug 11 04:40:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-769daa48-a33c-482c-b8c0-12ca9d120ed1 tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:02 devstack sudo[97869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96.info Aug 11 04:40:02 devstack sudo[97869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:03 devstack sudo[97869]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-769daa48-a33c-482c-b8c0-12ca9d120ed1 tempest-GroupSnapshotsTest-1060963943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96.info" returned: 0 in 0.303s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-769daa48-a33c-482c-b8c0-12ca9d120ed1 tempest-GroupSnapshotsTest-1060963943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.564s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:40:03 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-769daa48-a33c-482c-b8c0-12ca9d120ed1 tempest-GroupSnapshotsTest-1060963943 None] group_snapshot aaf26b8b-56f0-40fb-9954-2e2259e3d0ca: created successfully Aug 11 04:40:04 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-93f50e38-3aef-44b9-8ea0-b057fa0d281b tempest-GroupSnapshotsTest-1060963943 None] group_snapshot aaf26b8b-56f0-40fb-9954-2e2259e3d0ca: deleting Aug 11 04:40:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-93f50e38-3aef-44b9-8ea0-b057fa0d281b tempest-GroupSnapshotsTest-1060963943 None] group_snapshot aaf26b8b-56f0-40fb-9954-2e2259e3d0ca: deleting {{(pid=94472) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 11 04:40:04 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-93f50e38-3aef-44b9-8ea0-b057fa0d281b tempest-GroupSnapshotsTest-1060963943 None] Acquiring lock "cinder-quobyte-a199f5f4-9377-4210-96aa-f046371a5c9b" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:40:04 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-93f50e38-3aef-44b9-8ea0-b057fa0d281b tempest-GroupSnapshotsTest-1060963943 None] Lock "cinder-quobyte-a199f5f4-9377-4210-96aa-f046371a5c9b" acquired by "delete_snapshot" :: waited 0.050s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:40:04 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-93f50e38-3aef-44b9-8ea0-b057fa0d281b tempest-GroupSnapshotsTest-1060963943 None] Acquiring lock "cinder-quobyte-8885d7e0-7b96-4266-9e9d-88e63835fc6b" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:40:05 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-93f50e38-3aef-44b9-8ea0-b057fa0d281b tempest-GroupSnapshotsTest-1060963943 None] Lock "cinder-quobyte-8885d7e0-7b96-4266-9e9d-88e63835fc6b" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:40:05 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-93f50e38-3aef-44b9-8ea0-b057fa0d281b tempest-GroupSnapshotsTest-1060963943 None] Deleting offline snapshot 8885d7e0-7b96-4266-9e9d-88e63835fc6b of volume a199f5f4-9377-4210-96aa-f046371a5c9b {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 04:40:05 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-93f50e38-3aef-44b9-8ea0-b057fa0d281b tempest-GroupSnapshotsTest-1060963943 None] snapshot_file for this snap is: volume-a199f5f4-9377-4210-96aa-f046371a5c9b.8885d7e0-7b96-4266-9e9d-88e63835fc6b {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 04:40:05 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb81655d-4f74-4792-9f15-e283198c89f0]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:40:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-93f50e38-3aef-44b9-8ea0-b057fa0d281b tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a199f5f4-9377-4210-96aa-f046371a5c9b.8885d7e0-7b96-4266-9e9d-88e63835fc6b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:05 devstack sudo[97954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a199f5f4-9377-4210-96aa-f046371a5c9b.8885d7e0-7b96-4266-9e9d-88e63835fc6b Aug 11 04:40:05 devstack sudo[97954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:06 devstack sudo[97954]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-93f50e38-3aef-44b9-8ea0-b057fa0d281b tempest-GroupSnapshotsTest-1060963943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a199f5f4-9377-4210-96aa-f046371a5c9b.8885d7e0-7b96-4266-9e9d-88e63835fc6b" returned: 0 in 1.009s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:06 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-93f50e38-3aef-44b9-8ea0-b057fa0d281b tempest-GroupSnapshotsTest-1060963943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a199f5f4-9377-4210-96aa-f046371a5c9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:40:06 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ec2c95-962c-4935-9d23-0e25a3491706]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:40:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-93f50e38-3aef-44b9-8ea0-b057fa0d281b tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a199f5f4-9377-4210-96aa-f046371a5c9b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:06 devstack sudo[97976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a199f5f4-9377-4210-96aa-f046371a5c9b Aug 11 04:40:06 devstack sudo[97976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:07 devstack sudo[97976]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-93f50e38-3aef-44b9-8ea0-b057fa0d281b tempest-GroupSnapshotsTest-1060963943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a199f5f4-9377-4210-96aa-f046371a5c9b" returned: 0 in 1.105s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-93f50e38-3aef-44b9-8ea0-b057fa0d281b tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a199f5f4-9377-4210-96aa-f046371a5c9b.8885d7e0-7b96-4266-9e9d-88e63835fc6b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:07 devstack sudo[98028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a199f5f4-9377-4210-96aa-f046371a5c9b.8885d7e0-7b96-4266-9e9d-88e63835fc6b Aug 11 04:40:07 devstack sudo[98028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-b77cdbcb-446e-4c9d-b431-e6e2cd99aa24 req-03ec92d7-9207-475f-ab6f-1ca121df16fb tempest-TaggedAttachmentsTest-453299645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:40:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-b77cdbcb-446e-4c9d-b431-e6e2cd99aa24 req-03ec92d7-9207-475f-ab6f-1ca121df16fb tempest-TaggedAttachmentsTest-453299645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:40:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-b77cdbcb-446e-4c9d-b431-e6e2cd99aa24 req-03ec92d7-9207-475f-ab6f-1ca121df16fb tempest-TaggedAttachmentsTest-453299645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:40:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-b77cdbcb-446e-4c9d-b431-e6e2cd99aa24 req-03ec92d7-9207-475f-ab6f-1ca121df16fb tempest-TaggedAttachmentsTest-453299645 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd', 'name': 'volume-51ffead1-a054-4a99-a998-e9aece77458c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3803c223-5b75-4820-bde0-ed07fc71adcf', 'enforce_multipath': True} {{(pid=94472) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 11 04:40:07 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-b77cdbcb-446e-4c9d-b431-e6e2cd99aa24 req-03ec92d7-9207-475f-ab6f-1ca121df16fb tempest-TaggedAttachmentsTest-453299645 None] attachment_update completed successfully. Aug 11 04:40:07 devstack sudo[98028]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-93f50e38-3aef-44b9-8ea0-b057fa0d281b tempest-GroupSnapshotsTest-1060963943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a199f5f4-9377-4210-96aa-f046371a5c9b.8885d7e0-7b96-4266-9e9d-88e63835fc6b" returned: 0 in 0.670s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-93f50e38-3aef-44b9-8ea0-b057fa0d281b tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a199f5f4-9377-4210-96aa-f046371a5c9b.8885d7e0-7b96-4266-9e9d-88e63835fc6b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:08 devstack sudo[98040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a199f5f4-9377-4210-96aa-f046371a5c9b.8885d7e0-7b96-4266-9e9d-88e63835fc6b Aug 11 04:40:08 devstack sudo[98040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:08 devstack sudo[98040]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-93f50e38-3aef-44b9-8ea0-b057fa0d281b tempest-GroupSnapshotsTest-1060963943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a199f5f4-9377-4210-96aa-f046371a5c9b.8885d7e0-7b96-4266-9e9d-88e63835fc6b" returned: 0 in 0.442s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:08 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-93f50e38-3aef-44b9-8ea0-b057fa0d281b tempest-GroupSnapshotsTest-1060963943 None] Lock "cinder-quobyte-8885d7e0-7b96-4266-9e9d-88e63835fc6b" released by "_delete_snapshot" :: held 3.462s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:40:08 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-93f50e38-3aef-44b9-8ea0-b057fa0d281b tempest-GroupSnapshotsTest-1060963943 None] Lock "cinder-quobyte-a199f5f4-9377-4210-96aa-f046371a5c9b" released by "delete_snapshot" :: held 3.528s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:40:08 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-93f50e38-3aef-44b9-8ea0-b057fa0d281b tempest-GroupSnapshotsTest-1060963943 None] Acquiring lock "cinder-quobyte-e31a8307-2ad7-4cc0-a7eb-f451721b8e96" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:40:08 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-93f50e38-3aef-44b9-8ea0-b057fa0d281b tempest-GroupSnapshotsTest-1060963943 None] Lock "cinder-quobyte-e31a8307-2ad7-4cc0-a7eb-f451721b8e96" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:40:08 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-93f50e38-3aef-44b9-8ea0-b057fa0d281b tempest-GroupSnapshotsTest-1060963943 None] Acquiring lock "cinder-quobyte-e4738330-1d2c-4b6a-8ebc-5f5180c03ba3" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:40:08 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-93f50e38-3aef-44b9-8ea0-b057fa0d281b tempest-GroupSnapshotsTest-1060963943 None] Lock "cinder-quobyte-e4738330-1d2c-4b6a-8ebc-5f5180c03ba3" acquired by "_delete_snapshot" :: waited 0.052s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:40:08 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-93f50e38-3aef-44b9-8ea0-b057fa0d281b tempest-GroupSnapshotsTest-1060963943 None] Deleting offline snapshot e4738330-1d2c-4b6a-8ebc-5f5180c03ba3 of volume e31a8307-2ad7-4cc0-a7eb-f451721b8e96 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 04:40:08 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-93f50e38-3aef-44b9-8ea0-b057fa0d281b tempest-GroupSnapshotsTest-1060963943 None] snapshot_file for this snap is: volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96.e4738330-1d2c-4b6a-8ebc-5f5180c03ba3 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 04:40:08 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d7788a-7df3-43a3-9235-8a50ea8d1484]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:40:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-93f50e38-3aef-44b9-8ea0-b057fa0d281b tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96.e4738330-1d2c-4b6a-8ebc-5f5180c03ba3 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:08 devstack sudo[98426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96.e4738330-1d2c-4b6a-8ebc-5f5180c03ba3 Aug 11 04:40:08 devstack sudo[98426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:09 devstack sudo[98426]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-93f50e38-3aef-44b9-8ea0-b057fa0d281b tempest-GroupSnapshotsTest-1060963943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96.e4738330-1d2c-4b6a-8ebc-5f5180c03ba3" returned: 0 in 0.701s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-93f50e38-3aef-44b9-8ea0-b057fa0d281b tempest-GroupSnapshotsTest-1060963943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:40:09 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfba167f-e8ff-4380-a267-e3ba9a6b0fe6]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:40:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-93f50e38-3aef-44b9-8ea0-b057fa0d281b tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:09 devstack sudo[98433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96 Aug 11 04:40:09 devstack sudo[98433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:10 devstack sudo[98433]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-93f50e38-3aef-44b9-8ea0-b057fa0d281b tempest-GroupSnapshotsTest-1060963943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96" returned: 0 in 0.707s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-93f50e38-3aef-44b9-8ea0-b057fa0d281b tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96.e4738330-1d2c-4b6a-8ebc-5f5180c03ba3 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:10 devstack sudo[98444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96.e4738330-1d2c-4b6a-8ebc-5f5180c03ba3 Aug 11 04:40:10 devstack sudo[98444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:10 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd64b1d8-2c62-41de-b01c-62dcaec20426 tempest-VolumesTestJSON-1334354754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:40:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cd64b1d8-2c62-41de-b01c-62dcaec20426 tempest-VolumesTestJSON-1334354754 None] Flow 'volume_create_manager' (0f5c1226-7802-4871-a0a6-df2ecf01b35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:40:10 devstack sudo[98444]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cd64b1d8-2c62-41de-b01c-62dcaec20426 tempest-VolumesTestJSON-1334354754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef306e1f-40c6-4e1d-9976-efcb3b128f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:40:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-93f50e38-3aef-44b9-8ea0-b057fa0d281b tempest-GroupSnapshotsTest-1060963943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96.e4738330-1d2c-4b6a-8ebc-5f5180c03ba3" returned: 0 in 0.563s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-93f50e38-3aef-44b9-8ea0-b057fa0d281b tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96.e4738330-1d2c-4b6a-8ebc-5f5180c03ba3 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:10 devstack sudo[98451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96.e4738330-1d2c-4b6a-8ebc-5f5180c03ba3 Aug 11 04:40:10 devstack sudo[98451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cd64b1d8-2c62-41de-b01c-62dcaec20426 tempest-VolumesTestJSON-1334354754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef306e1f-40c6-4e1d-9976-efcb3b128f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:40:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1080842794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4967e48-0916-4ad9-9e58-c17ddffb06c0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e9a6d2d4d7ab47078978cf0568dd6ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:40:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:40:11Z,use_quota=True,user_id='446538cdc0454c74966f428e428cdfa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:40:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cd64b1d8-2c62-41de-b01c-62dcaec20426 tempest-VolumesTestJSON-1334354754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (772f40d7-db0d-4102-ae0a-1bfa1f672b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:40:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cd64b1d8-2c62-41de-b01c-62dcaec20426 tempest-VolumesTestJSON-1334354754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (772f40d7-db0d-4102-ae0a-1bfa1f672b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:40:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cd64b1d8-2c62-41de-b01c-62dcaec20426 tempest-VolumesTestJSON-1334354754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a6eddc3-dd98-408b-987f-95774073b84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:40:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cd64b1d8-2c62-41de-b01c-62dcaec20426 tempest-VolumesTestJSON-1334354754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a6eddc3-dd98-408b-987f-95774073b84c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4967e48-0916-4ad9-9e58-c17ddffb06c0', 'volume_name': 'volume-c4967e48-0916-4ad9-9e58-c17ddffb06c0', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:40:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cd64b1d8-2c62-41de-b01c-62dcaec20426 tempest-VolumesTestJSON-1334354754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c96d6c28-cd6a-4d9f-94d3-67246db99805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:40:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cd64b1d8-2c62-41de-b01c-62dcaec20426 tempest-VolumesTestJSON-1334354754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c96d6c28-cd6a-4d9f-94d3-67246db99805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:40:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cd64b1d8-2c62-41de-b01c-62dcaec20426 tempest-VolumesTestJSON-1334354754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81135063-e277-48bb-9da6-41fe0a7935d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:40:10 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-cd64b1d8-2c62-41de-b01c-62dcaec20426 tempest-VolumesTestJSON-1334354754 None] Volume c4967e48-0916-4ad9-9e58-c17ddffb06c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4967e48-0916-4ad9-9e58-c17ddffb06c0', 'volume_size': 1} Aug 11 04:40:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-cd64b1d8-2c62-41de-b01c-62dcaec20426 tempest-VolumesTestJSON-1334354754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:40:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-cd64b1d8-2c62-41de-b01c-62dcaec20426 tempest-VolumesTestJSON-1334354754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:40:10 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-cd64b1d8-2c62-41de-b01c-62dcaec20426 tempest-VolumesTestJSON-1334354754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:40:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1080842794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4967e48-0916-4ad9-9e58-c17ddffb06c0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e9a6d2d4d7ab47078978cf0568dd6ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:40:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:40:11Z,use_quota=True,user_id='446538cdc0454c74966f428e428cdfa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:40:10 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-cd64b1d8-2c62-41de-b01c-62dcaec20426 tempest-VolumesTestJSON-1334354754 None] Creating volume c4967e48-0916-4ad9-9e58-c17ddffb06c0 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:40:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-cd64b1d8-2c62-41de-b01c-62dcaec20426 tempest-VolumesTestJSON-1334354754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:40:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-cd64b1d8-2c62-41de-b01c-62dcaec20426 tempest-VolumesTestJSON-1334354754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:40:10 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-cd64b1d8-2c62-41de-b01c-62dcaec20426 tempest-VolumesTestJSON-1334354754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:40:10 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-cd64b1d8-2c62-41de-b01c-62dcaec20426 tempest-VolumesTestJSON-1334354754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:40:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-cd64b1d8-2c62-41de-b01c-62dcaec20426 tempest-VolumesTestJSON-1334354754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:40:10 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-cd64b1d8-2c62-41de-b01c-62dcaec20426 tempest-VolumesTestJSON-1334354754 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:40:10 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-cd64b1d8-2c62-41de-b01c-62dcaec20426 tempest-VolumesTestJSON-1334354754 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:40:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cd64b1d8-2c62-41de-b01c-62dcaec20426 tempest-VolumesTestJSON-1334354754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c4967e48-0916-4ad9-9e58-c17ddffb06c0 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:10 devstack sudo[98453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c4967e48-0916-4ad9-9e58-c17ddffb06c0 1073741824 Aug 11 04:40:10 devstack sudo[98453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:11 devstack sudo[98451]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-93f50e38-3aef-44b9-8ea0-b057fa0d281b tempest-GroupSnapshotsTest-1060963943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96.e4738330-1d2c-4b6a-8ebc-5f5180c03ba3" returned: 0 in 0.295s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-93f50e38-3aef-44b9-8ea0-b057fa0d281b tempest-GroupSnapshotsTest-1060963943 None] Lock "cinder-quobyte-e4738330-1d2c-4b6a-8ebc-5f5180c03ba3" released by "_delete_snapshot" :: held 2.424s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:40:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-93f50e38-3aef-44b9-8ea0-b057fa0d281b tempest-GroupSnapshotsTest-1060963943 None] Lock "cinder-quobyte-e31a8307-2ad7-4cc0-a7eb-f451721b8e96" released by "delete_snapshot" :: held 2.489s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:40:11 devstack cinder-volume[94472]: WARNING cinder.quota [None req-93f50e38-3aef-44b9-8ea0-b057fa0d281b tempest-GroupSnapshotsTest-1060963943 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-203292802 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-203292802, it is now deprecated. Please use the default quota class for default quota. Aug 11 04:40:11 devstack cinder-volume[94472]: WARNING cinder.quota [None req-93f50e38-3aef-44b9-8ea0-b057fa0d281b tempest-GroupSnapshotsTest-1060963943 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-203292802 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-203292802, it is now deprecated. Please use the default quota class for default quota. Aug 11 04:40:11 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-93f50e38-3aef-44b9-8ea0-b057fa0d281b tempest-GroupSnapshotsTest-1060963943 None] Created reservations ['4f39d248-5f72-4f08-826f-b788ff3350ad', '1f23a61d-ac09-4d6f-a738-7cf3a934f3ad', 'e99ec3d9-1fb6-4029-a6f0-3947749b823e', '142cdec1-c830-4875-a598-3c8bfd683be9'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:40:11 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-93f50e38-3aef-44b9-8ea0-b057fa0d281b tempest-GroupSnapshotsTest-1060963943 None] Created reservations ['6f19ff41-898f-4346-8d41-065b119d9b76', '96769dd9-1eef-42ea-ae0c-2608532ac6ef', 'eb4f8da3-b234-4b9a-bdc3-b56a37a34959', 'd6d8ed51-f437-4287-8d25-2cb64282ba7f'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:40:11 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-93f50e38-3aef-44b9-8ea0-b057fa0d281b tempest-GroupSnapshotsTest-1060963943 None] group_snapshot aaf26b8b-56f0-40fb-9954-2e2259e3d0ca: deleted successfully Aug 11 04:40:11 devstack sudo[98453]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cd64b1d8-2c62-41de-b01c-62dcaec20426 tempest-VolumesTestJSON-1334354754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c4967e48-0916-4ad9-9e58-c17ddffb06c0 1073741824" returned: 0 in 0.702s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cd64b1d8-2c62-41de-b01c-62dcaec20426 tempest-VolumesTestJSON-1334354754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c4967e48-0916-4ad9-9e58-c17ddffb06c0 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:11 devstack sudo[98461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c4967e48-0916-4ad9-9e58-c17ddffb06c0 Aug 11 04:40:11 devstack sudo[98461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:11 devstack sudo[98461]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cd64b1d8-2c62-41de-b01c-62dcaec20426 tempest-VolumesTestJSON-1334354754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c4967e48-0916-4ad9-9e58-c17ddffb06c0" returned: 0 in 0.267s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-cd64b1d8-2c62-41de-b01c-62dcaec20426 tempest-VolumesTestJSON-1334354754 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:40:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-cd64b1d8-2c62-41de-b01c-62dcaec20426 tempest-VolumesTestJSON-1334354754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:40:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cd64b1d8-2c62-41de-b01c-62dcaec20426 tempest-VolumesTestJSON-1334354754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81135063-e277-48bb-9da6-41fe0a7935d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4967e48-0916-4ad9-9e58-c17ddffb06c0', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:40:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cd64b1d8-2c62-41de-b01c-62dcaec20426 tempest-VolumesTestJSON-1334354754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20cbb0a0-806b-4644-b98b-7f687eca8080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:40:11 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-cd64b1d8-2c62-41de-b01c-62dcaec20426 tempest-VolumesTestJSON-1334354754 None] Volume volume-c4967e48-0916-4ad9-9e58-c17ddffb06c0 (c4967e48-0916-4ad9-9e58-c17ddffb06c0): created successfully Aug 11 04:40:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cd64b1d8-2c62-41de-b01c-62dcaec20426 tempest-VolumesTestJSON-1334354754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20cbb0a0-806b-4644-b98b-7f687eca8080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:40:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cd64b1d8-2c62-41de-b01c-62dcaec20426 tempest-VolumesTestJSON-1334354754 None] Flow 'volume_create_manager' (0f5c1226-7802-4871-a0a6-df2ecf01b35d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:40:11 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-cd64b1d8-2c62-41de-b01c-62dcaec20426 tempest-VolumesTestJSON-1334354754 None] Created volume successfully. Aug 11 04:40:12 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-3e108ebf-d45e-4858-8169-8f739997bf81 req-716ea2b6-3f8e-44ae-a054-0c3d9b13bb90 tempest-TaggedAttachmentsTest-453299645 None] Terminate volume connection completed successfully. Aug 11 04:40:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-3e108ebf-d45e-4858-8169-8f739997bf81 req-716ea2b6-3f8e-44ae-a054-0c3d9b13bb90 tempest-TaggedAttachmentsTest-453299645 None] Deleting attachment 3803c223-5b75-4820-bde0-ed07fc71adcf. {{(pid=94472) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 11 04:40:12 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6434031c-e76b-47a4-88d4-911e4f6a3894 tempest-GroupSnapshotsTest-1060963943 None] Acquiring lock "cinder-quobyte-a199f5f4-9377-4210-96aa-f046371a5c9b" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:40:12 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6434031c-e76b-47a4-88d4-911e4f6a3894 tempest-GroupSnapshotsTest-1060963943 None] Lock "cinder-quobyte-a199f5f4-9377-4210-96aa-f046371a5c9b" acquired by "delete_volume" :: waited 0.020s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:40:12 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[72228cb2-4905-489c-9ff5-608278f7763d]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:40:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6434031c-e76b-47a4-88d4-911e4f6a3894 tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a199f5f4-9377-4210-96aa-f046371a5c9b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:12 devstack sudo[98495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a199f5f4-9377-4210-96aa-f046371a5c9b Aug 11 04:40:12 devstack sudo[98495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:13 devstack sudo[98495]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6434031c-e76b-47a4-88d4-911e4f6a3894 tempest-GroupSnapshotsTest-1060963943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a199f5f4-9377-4210-96aa-f046371a5c9b" returned: 0 in 0.563s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6434031c-e76b-47a4-88d4-911e4f6a3894 tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a199f5f4-9377-4210-96aa-f046371a5c9b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:13 devstack sudo[98501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a199f5f4-9377-4210-96aa-f046371a5c9b Aug 11 04:40:13 devstack sudo[98501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:13 devstack sudo[98501]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6434031c-e76b-47a4-88d4-911e4f6a3894 tempest-GroupSnapshotsTest-1060963943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a199f5f4-9377-4210-96aa-f046371a5c9b" returned: 0 in 0.685s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:13 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6434031c-e76b-47a4-88d4-911e4f6a3894 tempest-GroupSnapshotsTest-1060963943 None] Lock "cinder-quobyte-a199f5f4-9377-4210-96aa-f046371a5c9b" released by "delete_volume" :: held 1.339s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:40:13 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6434031c-e76b-47a4-88d4-911e4f6a3894 tempest-GroupSnapshotsTest-1060963943 None] Acquiring lock "cinder-quobyte-e31a8307-2ad7-4cc0-a7eb-f451721b8e96" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:40:13 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6434031c-e76b-47a4-88d4-911e4f6a3894 tempest-GroupSnapshotsTest-1060963943 None] Lock "cinder-quobyte-e31a8307-2ad7-4cc0-a7eb-f451721b8e96" acquired by "delete_volume" :: waited 0.032s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:40:13 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff322572-870d-473a-81cf-7e12005b957f]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:40:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6434031c-e76b-47a4-88d4-911e4f6a3894 tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:14 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-52226170-f7b5-407a-8624-6373fd9cc4e9 tempest-VolumesTestJSON-1334354754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:40:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-52226170-f7b5-407a-8624-6373fd9cc4e9 tempest-VolumesTestJSON-1334354754 None] Flow 'volume_create_manager' (2ac55033-5f76-476f-ae81-33c04e24a005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:40:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-52226170-f7b5-407a-8624-6373fd9cc4e9 tempest-VolumesTestJSON-1334354754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f9cf1e7-e563-4943-b96d-feac72065cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:40:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-52226170-f7b5-407a-8624-6373fd9cc4e9 tempest-VolumesTestJSON-1334354754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f9cf1e7-e563-4943-b96d-feac72065cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:40:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-454392070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f82625c-7d21-4a5d-b6c9-974cc01f018e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e9a6d2d4d7ab47078978cf0568dd6ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:40:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:40:14Z,use_quota=True,user_id='446538cdc0454c74966f428e428cdfa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:40:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-52226170-f7b5-407a-8624-6373fd9cc4e9 tempest-VolumesTestJSON-1334354754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95ef8884-b397-4100-8344-04af21896f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:40:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-52226170-f7b5-407a-8624-6373fd9cc4e9 tempest-VolumesTestJSON-1334354754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95ef8884-b397-4100-8344-04af21896f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:40:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-52226170-f7b5-407a-8624-6373fd9cc4e9 tempest-VolumesTestJSON-1334354754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8e51642-ac22-4971-875b-d2970b012d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:40:14 devstack sudo[98521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96 Aug 11 04:40:14 devstack sudo[98521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-52226170-f7b5-407a-8624-6373fd9cc4e9 tempest-VolumesTestJSON-1334354754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8e51642-ac22-4971-875b-d2970b012d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f82625c-7d21-4a5d-b6c9-974cc01f018e', 'volume_name': 'volume-5f82625c-7d21-4a5d-b6c9-974cc01f018e', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:40:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-52226170-f7b5-407a-8624-6373fd9cc4e9 tempest-VolumesTestJSON-1334354754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9f89fa3-b0da-4b28-9a02-edd8a54a6bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:40:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-52226170-f7b5-407a-8624-6373fd9cc4e9 tempest-VolumesTestJSON-1334354754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9f89fa3-b0da-4b28-9a02-edd8a54a6bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:40:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-52226170-f7b5-407a-8624-6373fd9cc4e9 tempest-VolumesTestJSON-1334354754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f562e5a5-6ba6-48e8-824a-57b470df28e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:40:14 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-52226170-f7b5-407a-8624-6373fd9cc4e9 tempest-VolumesTestJSON-1334354754 None] Volume 5f82625c-7d21-4a5d-b6c9-974cc01f018e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f82625c-7d21-4a5d-b6c9-974cc01f018e', 'volume_size': 1} Aug 11 04:40:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-52226170-f7b5-407a-8624-6373fd9cc4e9 tempest-VolumesTestJSON-1334354754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:40:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-52226170-f7b5-407a-8624-6373fd9cc4e9 tempest-VolumesTestJSON-1334354754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:40:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-52226170-f7b5-407a-8624-6373fd9cc4e9 tempest-VolumesTestJSON-1334354754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:40:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-454392070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f82625c-7d21-4a5d-b6c9-974cc01f018e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e9a6d2d4d7ab47078978cf0568dd6ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:40:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:40:14Z,use_quota=True,user_id='446538cdc0454c74966f428e428cdfa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:40:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-52226170-f7b5-407a-8624-6373fd9cc4e9 tempest-VolumesTestJSON-1334354754 None] Creating volume 5f82625c-7d21-4a5d-b6c9-974cc01f018e {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:40:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-52226170-f7b5-407a-8624-6373fd9cc4e9 tempest-VolumesTestJSON-1334354754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:40:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-52226170-f7b5-407a-8624-6373fd9cc4e9 tempest-VolumesTestJSON-1334354754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:40:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-52226170-f7b5-407a-8624-6373fd9cc4e9 tempest-VolumesTestJSON-1334354754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:40:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-52226170-f7b5-407a-8624-6373fd9cc4e9 tempest-VolumesTestJSON-1334354754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:40:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-52226170-f7b5-407a-8624-6373fd9cc4e9 tempest-VolumesTestJSON-1334354754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:40:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-52226170-f7b5-407a-8624-6373fd9cc4e9 tempest-VolumesTestJSON-1334354754 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:40:14 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-52226170-f7b5-407a-8624-6373fd9cc4e9 tempest-VolumesTestJSON-1334354754 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:40:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-52226170-f7b5-407a-8624-6373fd9cc4e9 tempest-VolumesTestJSON-1334354754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5f82625c-7d21-4a5d-b6c9-974cc01f018e 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:14 devstack sudo[98524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5f82625c-7d21-4a5d-b6c9-974cc01f018e 1073741824 Aug 11 04:40:14 devstack sudo[98524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:14 devstack sudo[98521]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6434031c-e76b-47a4-88d4-911e4f6a3894 tempest-GroupSnapshotsTest-1060963943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96" returned: 0 in 0.497s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6434031c-e76b-47a4-88d4-911e4f6a3894 tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:14 devstack sudo[98531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96 Aug 11 04:40:14 devstack sudo[98531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:14 devstack sudo[98524]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-52226170-f7b5-407a-8624-6373fd9cc4e9 tempest-VolumesTestJSON-1334354754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5f82625c-7d21-4a5d-b6c9-974cc01f018e 1073741824" returned: 0 in 0.567s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-52226170-f7b5-407a-8624-6373fd9cc4e9 tempest-VolumesTestJSON-1334354754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5f82625c-7d21-4a5d-b6c9-974cc01f018e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:14 devstack sudo[98538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5f82625c-7d21-4a5d-b6c9-974cc01f018e Aug 11 04:40:14 devstack sudo[98531]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:14 devstack sudo[98538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6434031c-e76b-47a4-88d4-911e4f6a3894 tempest-GroupSnapshotsTest-1060963943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e31a8307-2ad7-4cc0-a7eb-f451721b8e96" returned: 0 in 0.375s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6434031c-e76b-47a4-88d4-911e4f6a3894 tempest-GroupSnapshotsTest-1060963943 None] Lock "cinder-quobyte-e31a8307-2ad7-4cc0-a7eb-f451721b8e96" released by "delete_volume" :: held 0.973s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:40:14 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-6434031c-e76b-47a4-88d4-911e4f6a3894 tempest-GroupSnapshotsTest-1060963943 None] Created reservations ['fd8db11b-ccde-4252-b688-517361e34cc3'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:40:15 devstack cinder-volume[94472]: WARNING cinder.quota [None req-6434031c-e76b-47a4-88d4-911e4f6a3894 tempest-GroupSnapshotsTest-1060963943 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-203292802 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-203292802, it is now deprecated. Please use the default quota class for default quota. Aug 11 04:40:15 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-6434031c-e76b-47a4-88d4-911e4f6a3894 tempest-GroupSnapshotsTest-1060963943 None] Created reservations ['77aebd2b-fc7d-477a-9470-f4e68b9832f5', '1af17fa2-4fda-4fc8-90cd-39ef1c5a4b4e', 'b3f0cab4-d01a-44a7-8ae0-e75ed8bd0878', '28b2a927-b2a2-4b32-8f21-b28e4c8efc39'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:40:15 devstack sudo[98538]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-52226170-f7b5-407a-8624-6373fd9cc4e9 tempest-VolumesTestJSON-1334354754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5f82625c-7d21-4a5d-b6c9-974cc01f018e" returned: 0 in 0.451s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-52226170-f7b5-407a-8624-6373fd9cc4e9 tempest-VolumesTestJSON-1334354754 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:40:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-52226170-f7b5-407a-8624-6373fd9cc4e9 tempest-VolumesTestJSON-1334354754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:40:15 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-52226170-f7b5-407a-8624-6373fd9cc4e9 tempest-VolumesTestJSON-1334354754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f562e5a5-6ba6-48e8-824a-57b470df28e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f82625c-7d21-4a5d-b6c9-974cc01f018e', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:40:15 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-52226170-f7b5-407a-8624-6373fd9cc4e9 tempest-VolumesTestJSON-1334354754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b76e26f2-9b42-42dc-ae4d-566df0ee798a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:40:15 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-52226170-f7b5-407a-8624-6373fd9cc4e9 tempest-VolumesTestJSON-1334354754 None] Volume volume-5f82625c-7d21-4a5d-b6c9-974cc01f018e (5f82625c-7d21-4a5d-b6c9-974cc01f018e): created successfully Aug 11 04:40:15 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-52226170-f7b5-407a-8624-6373fd9cc4e9 tempest-VolumesTestJSON-1334354754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b76e26f2-9b42-42dc-ae4d-566df0ee798a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:40:15 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-52226170-f7b5-407a-8624-6373fd9cc4e9 tempest-VolumesTestJSON-1334354754 None] Flow 'volume_create_manager' (2ac55033-5f76-476f-ae81-33c04e24a005) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:40:15 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-52226170-f7b5-407a-8624-6373fd9cc4e9 tempest-VolumesTestJSON-1334354754 None] Created volume successfully. Aug 11 04:40:15 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-6434031c-e76b-47a4-88d4-911e4f6a3894 tempest-GroupSnapshotsTest-1060963943 None] Created reservations ['52e8a0bd-9f93-4583-a218-5af2693c9b86', 'bb11f694-7966-4083-8f72-dca384a34889', '0373f19a-c220-4e1c-bc9c-e4e996949361', 'cde06904-950b-484c-8928-51cd142d6538'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:40:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6434031c-e76b-47a4-88d4-911e4f6a3894 tempest-GroupSnapshotsTest-1060963943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:40:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6434031c-e76b-47a4-88d4-911e4f6a3894 tempest-GroupSnapshotsTest-1060963943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:40:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6434031c-e76b-47a4-88d4-911e4f6a3894 tempest-GroupSnapshotsTest-1060963943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:40:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6434031c-e76b-47a4-88d4-911e4f6a3894 tempest-GroupSnapshotsTest-1060963943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:40:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6434031c-e76b-47a4-88d4-911e4f6a3894 tempest-GroupSnapshotsTest-1060963943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:40:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6434031c-e76b-47a4-88d4-911e4f6a3894 tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:15 devstack sudo[98541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:40:15 devstack sudo[98541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:15 devstack sudo[98541]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6434031c-e76b-47a4-88d4-911e4f6a3894 tempest-GroupSnapshotsTest-1060963943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.404s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:15 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-6434031c-e76b-47a4-88d4-911e4f6a3894 tempest-GroupSnapshotsTest-1060963943 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:40:15 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-6434031c-e76b-47a4-88d4-911e4f6a3894 tempest-GroupSnapshotsTest-1060963943 None] Delete group completed successfully. Aug 11 04:40:16 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-6541400d-bb0c-41ef-9cff-073b91d1d236 tempest-VolumesTestJSON-1334354754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:40:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6541400d-bb0c-41ef-9cff-073b91d1d236 tempest-VolumesTestJSON-1334354754 None] Flow 'volume_create_manager' (c2fb369a-f5f3-4823-aa25-b6b12b498ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:40:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6541400d-bb0c-41ef-9cff-073b91d1d236 tempest-VolumesTestJSON-1334354754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4b2b0c6-fed8-4112-a0b9-170673e30c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:40:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6541400d-bb0c-41ef-9cff-073b91d1d236 tempest-VolumesTestJSON-1334354754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4b2b0c6-fed8-4112-a0b9-170673e30c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-65592963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bde11acd-eef9-4324-9e07-6eca04b216e2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e9a6d2d4d7ab47078978cf0568dd6ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:40:17Z,use_quota=True,user_id='446538cdc0454c74966f428e428cdfa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:40:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6541400d-bb0c-41ef-9cff-073b91d1d236 tempest-VolumesTestJSON-1334354754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af4a1768-9d0b-4519-8d30-cd39f8b93e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:40:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6541400d-bb0c-41ef-9cff-073b91d1d236 tempest-VolumesTestJSON-1334354754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af4a1768-9d0b-4519-8d30-cd39f8b93e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:40:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6541400d-bb0c-41ef-9cff-073b91d1d236 tempest-VolumesTestJSON-1334354754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb5519c6-3f04-411b-a78b-ed62645b1b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:40:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6541400d-bb0c-41ef-9cff-073b91d1d236 tempest-VolumesTestJSON-1334354754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb5519c6-3f04-411b-a78b-ed62645b1b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bde11acd-eef9-4324-9e07-6eca04b216e2', 'volume_name': 'volume-bde11acd-eef9-4324-9e07-6eca04b216e2', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:40:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6541400d-bb0c-41ef-9cff-073b91d1d236 tempest-VolumesTestJSON-1334354754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06acfc20-80b2-4746-96a6-fc0a1f6507b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:40:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6541400d-bb0c-41ef-9cff-073b91d1d236 tempest-VolumesTestJSON-1334354754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06acfc20-80b2-4746-96a6-fc0a1f6507b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:40:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6541400d-bb0c-41ef-9cff-073b91d1d236 tempest-VolumesTestJSON-1334354754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ecd15ba-e0b9-4a83-939b-70bfb3b933cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:40:16 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-6541400d-bb0c-41ef-9cff-073b91d1d236 tempest-VolumesTestJSON-1334354754 None] Volume bde11acd-eef9-4324-9e07-6eca04b216e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bde11acd-eef9-4324-9e07-6eca04b216e2', 'volume_size': 1} Aug 11 04:40:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6541400d-bb0c-41ef-9cff-073b91d1d236 tempest-VolumesTestJSON-1334354754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:40:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6541400d-bb0c-41ef-9cff-073b91d1d236 tempest-VolumesTestJSON-1334354754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:40:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6541400d-bb0c-41ef-9cff-073b91d1d236 tempest-VolumesTestJSON-1334354754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-65592963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bde11acd-eef9-4324-9e07-6eca04b216e2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e9a6d2d4d7ab47078978cf0568dd6ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:40:17Z,use_quota=True,user_id='446538cdc0454c74966f428e428cdfa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:40:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-6541400d-bb0c-41ef-9cff-073b91d1d236 tempest-VolumesTestJSON-1334354754 None] Creating volume bde11acd-eef9-4324-9e07-6eca04b216e2 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:40:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6541400d-bb0c-41ef-9cff-073b91d1d236 tempest-VolumesTestJSON-1334354754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:40:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6541400d-bb0c-41ef-9cff-073b91d1d236 tempest-VolumesTestJSON-1334354754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:40:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6541400d-bb0c-41ef-9cff-073b91d1d236 tempest-VolumesTestJSON-1334354754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:40:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6541400d-bb0c-41ef-9cff-073b91d1d236 tempest-VolumesTestJSON-1334354754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:40:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6541400d-bb0c-41ef-9cff-073b91d1d236 tempest-VolumesTestJSON-1334354754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:40:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6541400d-bb0c-41ef-9cff-073b91d1d236 tempest-VolumesTestJSON-1334354754 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:40:16 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-6541400d-bb0c-41ef-9cff-073b91d1d236 tempest-VolumesTestJSON-1334354754 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:40:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6541400d-bb0c-41ef-9cff-073b91d1d236 tempest-VolumesTestJSON-1334354754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-bde11acd-eef9-4324-9e07-6eca04b216e2 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:16 devstack sudo[98547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-bde11acd-eef9-4324-9e07-6eca04b216e2 1073741824 Aug 11 04:40:16 devstack sudo[98547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:17 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-ad8e5781-021d-4db9-afca-61f9097fa61c tempest-GroupSnapshotsTest-1060963943 None] Group tempest-GroupSnapshotsTest-Group-529112320: creating Aug 11 04:40:17 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-ad8e5781-021d-4db9-afca-61f9097fa61c tempest-GroupSnapshotsTest-1060963943 None] Group tempest-GroupSnapshotsTest-Group-529112320: created successfully Aug 11 04:40:17 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-ad8e5781-021d-4db9-afca-61f9097fa61c tempest-GroupSnapshotsTest-1060963943 None] Create group completed successfully. Aug 11 04:40:17 devstack sudo[98547]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6541400d-bb0c-41ef-9cff-073b91d1d236 tempest-VolumesTestJSON-1334354754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-bde11acd-eef9-4324-9e07-6eca04b216e2 1073741824" returned: 0 in 0.840s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6541400d-bb0c-41ef-9cff-073b91d1d236 tempest-VolumesTestJSON-1334354754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-bde11acd-eef9-4324-9e07-6eca04b216e2 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:17 devstack sudo[98555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-bde11acd-eef9-4324-9e07-6eca04b216e2 Aug 11 04:40:17 devstack sudo[98555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:18 devstack sudo[98555]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6541400d-bb0c-41ef-9cff-073b91d1d236 tempest-VolumesTestJSON-1334354754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-bde11acd-eef9-4324-9e07-6eca04b216e2" returned: 0 in 0.583s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:18 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6541400d-bb0c-41ef-9cff-073b91d1d236 tempest-VolumesTestJSON-1334354754 None] <== create_volume: return (1546ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:40:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6541400d-bb0c-41ef-9cff-073b91d1d236 tempest-VolumesTestJSON-1334354754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.579s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:40:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6541400d-bb0c-41ef-9cff-073b91d1d236 tempest-VolumesTestJSON-1334354754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ecd15ba-e0b9-4a83-939b-70bfb3b933cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bde11acd-eef9-4324-9e07-6eca04b216e2', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:40:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6541400d-bb0c-41ef-9cff-073b91d1d236 tempest-VolumesTestJSON-1334354754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea35897d-50fa-420c-9843-9ef89b7f9196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:40:18 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-6541400d-bb0c-41ef-9cff-073b91d1d236 tempest-VolumesTestJSON-1334354754 None] Volume volume-bde11acd-eef9-4324-9e07-6eca04b216e2 (bde11acd-eef9-4324-9e07-6eca04b216e2): created successfully Aug 11 04:40:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6541400d-bb0c-41ef-9cff-073b91d1d236 tempest-VolumesTestJSON-1334354754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea35897d-50fa-420c-9843-9ef89b7f9196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:40:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6541400d-bb0c-41ef-9cff-073b91d1d236 tempest-VolumesTestJSON-1334354754 None] Flow 'volume_create_manager' (c2fb369a-f5f3-4823-aa25-b6b12b498ac4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:40:18 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-6541400d-bb0c-41ef-9cff-073b91d1d236 tempest-VolumesTestJSON-1334354754 None] Created volume successfully. Aug 11 04:40:19 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd90b545-b4fb-4554-b5f4-a00bfe66013b tempest-GroupSnapshotsTest-1060963943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:40:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bd90b545-b4fb-4554-b5f4-a00bfe66013b tempest-GroupSnapshotsTest-1060963943 None] Flow 'volume_create_manager' (4fa39d87-0972-4a6a-a248-8296ba32f0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:40:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bd90b545-b4fb-4554-b5f4-a00bfe66013b tempest-GroupSnapshotsTest-1060963943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48e65993-3c92-4a4f-8f50-fd818a56cc98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:40:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bd90b545-b4fb-4554-b5f4-a00bfe66013b tempest-GroupSnapshotsTest-1060963943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48e65993-3c92-4a4f-8f50-fd818a56cc98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:40:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-427423467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b2cb5a3c-9c4e-4fbe-94da-ef850594c241,host='devstack@QuobyteHD#QuobyteHD',id=5bf5dbd1-ed38-4b09-9e50-080ae31c66c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91dee1da4e784a3a969e352513ea5c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:40:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:40:19Z,use_quota=True,user_id='008a888043964369942c83be353f327c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f854c79-0972-49d9-a30c-3d29606cd01e),volume_type_id=9f854c79-0972-49d9-a30c-3d29606cd01e)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:40:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bd90b545-b4fb-4554-b5f4-a00bfe66013b tempest-GroupSnapshotsTest-1060963943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f185e92-d94e-4643-95bd-27e60e69fa63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:40:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bd90b545-b4fb-4554-b5f4-a00bfe66013b tempest-GroupSnapshotsTest-1060963943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f185e92-d94e-4643-95bd-27e60e69fa63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:40:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bd90b545-b4fb-4554-b5f4-a00bfe66013b tempest-GroupSnapshotsTest-1060963943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96e8d47c-22a4-4f3c-ac21-22d6ba4396dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:40:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bd90b545-b4fb-4554-b5f4-a00bfe66013b tempest-GroupSnapshotsTest-1060963943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96e8d47c-22a4-4f3c-ac21-22d6ba4396dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bf5dbd1-ed38-4b09-9e50-080ae31c66c5', 'volume_name': 'volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:40:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bd90b545-b4fb-4554-b5f4-a00bfe66013b tempest-GroupSnapshotsTest-1060963943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6bd0697-bcf4-4078-8cd2-e7442c5c2861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:40:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bd90b545-b4fb-4554-b5f4-a00bfe66013b tempest-GroupSnapshotsTest-1060963943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6bd0697-bcf4-4078-8cd2-e7442c5c2861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:40:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bd90b545-b4fb-4554-b5f4-a00bfe66013b tempest-GroupSnapshotsTest-1060963943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02fd594a-4297-4b88-9dd3-3a174ef40c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:40:19 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-bd90b545-b4fb-4554-b5f4-a00bfe66013b tempest-GroupSnapshotsTest-1060963943 None] Volume 5bf5dbd1-ed38-4b09-9e50-080ae31c66c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5', 'volume_size': 1} Aug 11 04:40:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bd90b545-b4fb-4554-b5f4-a00bfe66013b tempest-GroupSnapshotsTest-1060963943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:40:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bd90b545-b4fb-4554-b5f4-a00bfe66013b tempest-GroupSnapshotsTest-1060963943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:40:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-bd90b545-b4fb-4554-b5f4-a00bfe66013b tempest-GroupSnapshotsTest-1060963943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b2cb5a3c-9c4e-4fbe-94da-ef850594c241,created_at=2026-08-11T02:40:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-427423467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b2cb5a3c-9c4e-4fbe-94da-ef850594c241,host='devstack@QuobyteHD#QuobyteHD',id=5bf5dbd1-ed38-4b09-9e50-080ae31c66c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91dee1da4e784a3a969e352513ea5c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:40:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:40:19Z,use_quota=True,user_id='008a888043964369942c83be353f327c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f854c79-0972-49d9-a30c-3d29606cd01e),volume_type_id=9f854c79-0972-49d9-a30c-3d29606cd01e)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:40:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-bd90b545-b4fb-4554-b5f4-a00bfe66013b tempest-GroupSnapshotsTest-1060963943 None] Creating volume 5bf5dbd1-ed38-4b09-9e50-080ae31c66c5 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:40:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bd90b545-b4fb-4554-b5f4-a00bfe66013b tempest-GroupSnapshotsTest-1060963943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:40:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bd90b545-b4fb-4554-b5f4-a00bfe66013b tempest-GroupSnapshotsTest-1060963943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:40:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-bd90b545-b4fb-4554-b5f4-a00bfe66013b tempest-GroupSnapshotsTest-1060963943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:40:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-bd90b545-b4fb-4554-b5f4-a00bfe66013b tempest-GroupSnapshotsTest-1060963943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:40:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bd90b545-b4fb-4554-b5f4-a00bfe66013b tempest-GroupSnapshotsTest-1060963943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:40:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-bd90b545-b4fb-4554-b5f4-a00bfe66013b tempest-GroupSnapshotsTest-1060963943 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:40:19 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-bd90b545-b4fb-4554-b5f4-a00bfe66013b tempest-GroupSnapshotsTest-1060963943 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:40:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bd90b545-b4fb-4554-b5f4-a00bfe66013b tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:19 devstack sudo[98604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5 1073741824 Aug 11 04:40:19 devstack sudo[98604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f85ec808-8667-41f5-af08-a4ea2cc226cd tempest-VolumesTestJSON-1334354754 None] Acquiring lock "cinder-bde11acd-eef9-4324-9e07-6eca04b216e2-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:40:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f85ec808-8667-41f5-af08-a4ea2cc226cd tempest-VolumesTestJSON-1334354754 None] Lock "cinder-bde11acd-eef9-4324-9e07-6eca04b216e2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:40:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f85ec808-8667-41f5-af08-a4ea2cc226cd tempest-VolumesTestJSON-1334354754 None] Acquiring lock "cinder-quobyte-bde11acd-eef9-4324-9e07-6eca04b216e2" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:40:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f85ec808-8667-41f5-af08-a4ea2cc226cd tempest-VolumesTestJSON-1334354754 None] Lock "cinder-quobyte-bde11acd-eef9-4324-9e07-6eca04b216e2" acquired by "delete_volume" :: waited 0.036s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:40:20 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[01076e26-8198-465b-9d04-546b1a6677bf]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:40:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f85ec808-8667-41f5-af08-a4ea2cc226cd tempest-VolumesTestJSON-1334354754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-bde11acd-eef9-4324-9e07-6eca04b216e2 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:20 devstack sudo[98604]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bd90b545-b4fb-4554-b5f4-a00bfe66013b tempest-GroupSnapshotsTest-1060963943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5 1073741824" returned: 0 in 0.729s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bd90b545-b4fb-4554-b5f4-a00bfe66013b tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:20 devstack sudo[98612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5 Aug 11 04:40:20 devstack sudo[98612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:20 devstack sudo[98611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-bde11acd-eef9-4324-9e07-6eca04b216e2 Aug 11 04:40:20 devstack sudo[98611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:20 devstack sudo[98612]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bd90b545-b4fb-4554-b5f4-a00bfe66013b tempest-GroupSnapshotsTest-1060963943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5" returned: 0 in 0.434s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-bd90b545-b4fb-4554-b5f4-a00bfe66013b tempest-GroupSnapshotsTest-1060963943 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:40:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bd90b545-b4fb-4554-b5f4-a00bfe66013b tempest-GroupSnapshotsTest-1060963943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.229s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:40:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bd90b545-b4fb-4554-b5f4-a00bfe66013b tempest-GroupSnapshotsTest-1060963943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02fd594a-4297-4b88-9dd3-3a174ef40c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:40:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bd90b545-b4fb-4554-b5f4-a00bfe66013b tempest-GroupSnapshotsTest-1060963943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bff277b-e629-4083-8316-c41d09c1258f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:40:20 devstack sudo[98611]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f85ec808-8667-41f5-af08-a4ea2cc226cd tempest-VolumesTestJSON-1334354754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-bde11acd-eef9-4324-9e07-6eca04b216e2" returned: 0 in 0.601s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f85ec808-8667-41f5-af08-a4ea2cc226cd tempest-VolumesTestJSON-1334354754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-bde11acd-eef9-4324-9e07-6eca04b216e2 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:20 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-bd90b545-b4fb-4554-b5f4-a00bfe66013b tempest-GroupSnapshotsTest-1060963943 None] Volume volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5 (5bf5dbd1-ed38-4b09-9e50-080ae31c66c5): created successfully Aug 11 04:40:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bd90b545-b4fb-4554-b5f4-a00bfe66013b tempest-GroupSnapshotsTest-1060963943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bff277b-e629-4083-8316-c41d09c1258f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:40:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bd90b545-b4fb-4554-b5f4-a00bfe66013b tempest-GroupSnapshotsTest-1060963943 None] Flow 'volume_create_manager' (4fa39d87-0972-4a6a-a248-8296ba32f0a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:40:20 devstack sudo[98620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-bde11acd-eef9-4324-9e07-6eca04b216e2 Aug 11 04:40:20 devstack sudo[98620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:20 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-bd90b545-b4fb-4554-b5f4-a00bfe66013b tempest-GroupSnapshotsTest-1060963943 None] Created volume successfully. Aug 11 04:40:21 devstack sudo[98620]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f85ec808-8667-41f5-af08-a4ea2cc226cd tempest-VolumesTestJSON-1334354754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-bde11acd-eef9-4324-9e07-6eca04b216e2" returned: 0 in 0.294s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f85ec808-8667-41f5-af08-a4ea2cc226cd tempest-VolumesTestJSON-1334354754 None] Lock "cinder-quobyte-bde11acd-eef9-4324-9e07-6eca04b216e2" released by "delete_volume" :: held 0.939s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:40:21 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-f85ec808-8667-41f5-af08-a4ea2cc226cd tempest-VolumesTestJSON-1334354754 None] Created reservations ['c0a1f2e1-01e1-456c-80d1-0d79d21b5510', '3e933f13-9ab9-4d77-9dd1-fafb7d4a1e7d', '46d863d9-2df5-4b4a-bd1f-ae2a33e76b57', 'de097b22-9312-4f80-a908-93609eb2c2dd'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:40:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f85ec808-8667-41f5-af08-a4ea2cc226cd tempest-VolumesTestJSON-1334354754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:40:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f85ec808-8667-41f5-af08-a4ea2cc226cd tempest-VolumesTestJSON-1334354754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:40:21 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f85ec808-8667-41f5-af08-a4ea2cc226cd tempest-VolumesTestJSON-1334354754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:40:21 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f85ec808-8667-41f5-af08-a4ea2cc226cd tempest-VolumesTestJSON-1334354754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:40:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f85ec808-8667-41f5-af08-a4ea2cc226cd tempest-VolumesTestJSON-1334354754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:40:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f85ec808-8667-41f5-af08-a4ea2cc226cd tempest-VolumesTestJSON-1334354754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:21 devstack sudo[98624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:40:21 devstack sudo[98624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-95e8583b-0f6a-42c4-8f6f-951dd23cf19d tempest-VolumesTestJSON-1334354754 None] Acquiring lock "cinder-5f82625c-7d21-4a5d-b6c9-974cc01f018e-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:40:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-95e8583b-0f6a-42c4-8f6f-951dd23cf19d tempest-VolumesTestJSON-1334354754 None] Lock "cinder-5f82625c-7d21-4a5d-b6c9-974cc01f018e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:40:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-95e8583b-0f6a-42c4-8f6f-951dd23cf19d tempest-VolumesTestJSON-1334354754 None] Acquiring lock "cinder-quobyte-5f82625c-7d21-4a5d-b6c9-974cc01f018e" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:40:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-95e8583b-0f6a-42c4-8f6f-951dd23cf19d tempest-VolumesTestJSON-1334354754 None] Lock "cinder-quobyte-5f82625c-7d21-4a5d-b6c9-974cc01f018e" acquired by "delete_volume" :: waited 0.017s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:40:21 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e8db6d-d08d-4506-b56a-571710d5254f]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:40:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-95e8583b-0f6a-42c4-8f6f-951dd23cf19d tempest-VolumesTestJSON-1334354754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5f82625c-7d21-4a5d-b6c9-974cc01f018e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:21 devstack sudo[98624]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f85ec808-8667-41f5-af08-a4ea2cc226cd tempest-VolumesTestJSON-1334354754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.258s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:21 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-f85ec808-8667-41f5-af08-a4ea2cc226cd tempest-VolumesTestJSON-1334354754 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:40:21 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-f85ec808-8667-41f5-af08-a4ea2cc226cd tempest-VolumesTestJSON-1334354754 None] Deleted volume successfully. Aug 11 04:40:21 devstack sudo[98626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5f82625c-7d21-4a5d-b6c9-974cc01f018e Aug 11 04:40:21 devstack sudo[98626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f85ec808-8667-41f5-af08-a4ea2cc226cd tempest-VolumesTestJSON-1334354754 None] Lock "cinder-bde11acd-eef9-4324-9e07-6eca04b216e2-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:40:21 devstack sudo[98626]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-95e8583b-0f6a-42c4-8f6f-951dd23cf19d tempest-VolumesTestJSON-1334354754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5f82625c-7d21-4a5d-b6c9-974cc01f018e" returned: 0 in 0.384s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-95e8583b-0f6a-42c4-8f6f-951dd23cf19d tempest-VolumesTestJSON-1334354754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5f82625c-7d21-4a5d-b6c9-974cc01f018e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:21 devstack sudo[98632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5f82625c-7d21-4a5d-b6c9-974cc01f018e Aug 11 04:40:21 devstack sudo[98632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:22 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-a898fade-710d-40eb-b60e-3811c0ffb878 tempest-GroupSnapshotsTest-1060963943 None] GroupSnapshot 60e249e8-3e0c-425e-a551-88faf0d1004b: creating. Aug 11 04:40:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a898fade-710d-40eb-b60e-3811c0ffb878 tempest-GroupSnapshotsTest-1060963943 None] Group snapshot 60e249e8-3e0c-425e-a551-88faf0d1004b: creating. {{(pid=94472) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 11 04:40:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a898fade-710d-40eb-b60e-3811c0ffb878 tempest-GroupSnapshotsTest-1060963943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:40:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a898fade-710d-40eb-b60e-3811c0ffb878 tempest-GroupSnapshotsTest-1060963943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:40:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-a898fade-710d-40eb-b60e-3811c0ffb878 tempest-GroupSnapshotsTest-1060963943 None] Creating offline snapshot b6857b3e-645d-49ee-ae01-9a9d2e98b5a3 of volume 5bf5dbd1-ed38-4b09-9e50-080ae31c66c5 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 04:40:22 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac62baf-5e5f-46c2-83ab-2a5a46e4a896]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:40:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a898fade-710d-40eb-b60e-3811c0ffb878 tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:22 devstack sudo[98632]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-95e8583b-0f6a-42c4-8f6f-951dd23cf19d tempest-VolumesTestJSON-1334354754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5f82625c-7d21-4a5d-b6c9-974cc01f018e" returned: 0 in 0.289s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-95e8583b-0f6a-42c4-8f6f-951dd23cf19d tempest-VolumesTestJSON-1334354754 None] Lock "cinder-quobyte-5f82625c-7d21-4a5d-b6c9-974cc01f018e" released by "delete_volume" :: held 0.725s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:40:22 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-95e8583b-0f6a-42c4-8f6f-951dd23cf19d tempest-VolumesTestJSON-1334354754 None] Created reservations ['52fbb3fe-992f-4c0c-9d7b-a59aa8ff7fb0', '205003e3-a2ec-4270-a795-8f84776b622c', '0dd2082c-91ec-4bee-9fc6-14863f880688', 'a0343b5b-2215-424d-8c26-494a40bebd43'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:40:22 devstack sudo[98635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5 Aug 11 04:40:22 devstack sudo[98635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-95e8583b-0f6a-42c4-8f6f-951dd23cf19d tempest-VolumesTestJSON-1334354754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:40:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-95e8583b-0f6a-42c4-8f6f-951dd23cf19d tempest-VolumesTestJSON-1334354754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:40:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-95e8583b-0f6a-42c4-8f6f-951dd23cf19d tempest-VolumesTestJSON-1334354754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:40:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-95e8583b-0f6a-42c4-8f6f-951dd23cf19d tempest-VolumesTestJSON-1334354754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:40:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-95e8583b-0f6a-42c4-8f6f-951dd23cf19d tempest-VolumesTestJSON-1334354754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:40:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-95e8583b-0f6a-42c4-8f6f-951dd23cf19d tempest-VolumesTestJSON-1334354754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:22 devstack sudo[98637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:40:22 devstack sudo[98637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:22 devstack sudo[98635]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e9969f8a-ee59-44e8-b80f-5a8f4cbb76ef tempest-VolumesTestJSON-1334354754 None] Acquiring lock "cinder-c4967e48-0916-4ad9-9e58-c17ddffb06c0-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:40:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a898fade-710d-40eb-b60e-3811c0ffb878 tempest-GroupSnapshotsTest-1060963943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5" returned: 0 in 0.456s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a898fade-710d-40eb-b60e-3811c0ffb878 tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5.b6857b3e-645d-49ee-ae01-9a9d2e98b5a3 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:22 devstack sudo[98637]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-95e8583b-0f6a-42c4-8f6f-951dd23cf19d tempest-VolumesTestJSON-1334354754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.286s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:22 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-95e8583b-0f6a-42c4-8f6f-951dd23cf19d tempest-VolumesTestJSON-1334354754 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:40:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e9969f8a-ee59-44e8-b80f-5a8f4cbb76ef tempest-VolumesTestJSON-1334354754 None] Lock "cinder-c4967e48-0916-4ad9-9e58-c17ddffb06c0-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:40:22 devstack sudo[98644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5.b6857b3e-645d-49ee-ae01-9a9d2e98b5a3 1G Aug 11 04:40:22 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-95e8583b-0f6a-42c4-8f6f-951dd23cf19d tempest-VolumesTestJSON-1334354754 None] Deleted volume successfully. Aug 11 04:40:22 devstack sudo[98644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-95e8583b-0f6a-42c4-8f6f-951dd23cf19d tempest-VolumesTestJSON-1334354754 None] Lock "cinder-5f82625c-7d21-4a5d-b6c9-974cc01f018e-delete_volume" released by "delete_volume" :: held 1.290s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:40:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e9969f8a-ee59-44e8-b80f-5a8f4cbb76ef tempest-VolumesTestJSON-1334354754 None] Acquiring lock "cinder-quobyte-c4967e48-0916-4ad9-9e58-c17ddffb06c0" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:40:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e9969f8a-ee59-44e8-b80f-5a8f4cbb76ef tempest-VolumesTestJSON-1334354754 None] Lock "cinder-quobyte-c4967e48-0916-4ad9-9e58-c17ddffb06c0" acquired by "delete_volume" :: waited 0.014s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:40:22 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d020eed-589c-43fc-97df-a5333a2b2b30]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:40:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e9969f8a-ee59-44e8-b80f-5a8f4cbb76ef tempest-VolumesTestJSON-1334354754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c4967e48-0916-4ad9-9e58-c17ddffb06c0 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:22 devstack sudo[98646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c4967e48-0916-4ad9-9e58-c17ddffb06c0 Aug 11 04:40:22 devstack sudo[98646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:23 devstack sudo[98644]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a898fade-710d-40eb-b60e-3811c0ffb878 tempest-GroupSnapshotsTest-1060963943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5.b6857b3e-645d-49ee-ae01-9a9d2e98b5a3 1G" returned: 0 in 0.522s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a898fade-710d-40eb-b60e-3811c0ffb878 tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5.b6857b3e-645d-49ee-ae01-9a9d2e98b5a3 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:23 devstack sudo[98658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5.b6857b3e-645d-49ee-ae01-9a9d2e98b5a3 Aug 11 04:40:23 devstack sudo[98658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:23 devstack sudo[98646]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e9969f8a-ee59-44e8-b80f-5a8f4cbb76ef tempest-VolumesTestJSON-1334354754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c4967e48-0916-4ad9-9e58-c17ddffb06c0" returned: 0 in 0.439s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e9969f8a-ee59-44e8-b80f-5a8f4cbb76ef tempest-VolumesTestJSON-1334354754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c4967e48-0916-4ad9-9e58-c17ddffb06c0 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:23 devstack sudo[98663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c4967e48-0916-4ad9-9e58-c17ddffb06c0 Aug 11 04:40:23 devstack sudo[98663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:23 devstack sudo[98663]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e9969f8a-ee59-44e8-b80f-5a8f4cbb76ef tempest-VolumesTestJSON-1334354754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c4967e48-0916-4ad9-9e58-c17ddffb06c0" returned: 0 in 0.242s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:23 devstack sudo[98658]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e9969f8a-ee59-44e8-b80f-5a8f4cbb76ef tempest-VolumesTestJSON-1334354754 None] Lock "cinder-quobyte-c4967e48-0916-4ad9-9e58-c17ddffb06c0" released by "delete_volume" :: held 0.743s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:40:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a898fade-710d-40eb-b60e-3811c0ffb878 tempest-GroupSnapshotsTest-1060963943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5.b6857b3e-645d-49ee-ae01-9a9d2e98b5a3" returned: 0 in 0.327s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:23 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-a898fade-710d-40eb-b60e-3811c0ffb878 tempest-GroupSnapshotsTest-1060963943 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5.b6857b3e-645d-49ee-ae01-9a9d2e98b5a3 is being set with open permissions: ugo+rw: NotImplementedError Aug 11 04:40:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a898fade-710d-40eb-b60e-3811c0ffb878 tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5.b6857b3e-645d-49ee-ae01-9a9d2e98b5a3 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:23 devstack sudo[98669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5.b6857b3e-645d-49ee-ae01-9a9d2e98b5a3 Aug 11 04:40:23 devstack sudo[98669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:23 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-e9969f8a-ee59-44e8-b80f-5a8f4cbb76ef tempest-VolumesTestJSON-1334354754 None] Created reservations ['e6ed5e78-5b61-4f00-b12d-b69abae38b66', '72dac9f3-fac8-426d-bdba-069c2963dd82', '3819539d-1ee4-48ef-971f-ecfa788b9eca', 'bea4bcca-0245-47da-a070-60a2821937c6'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:40:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e9969f8a-ee59-44e8-b80f-5a8f4cbb76ef tempest-VolumesTestJSON-1334354754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:40:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e9969f8a-ee59-44e8-b80f-5a8f4cbb76ef tempest-VolumesTestJSON-1334354754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:40:23 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e9969f8a-ee59-44e8-b80f-5a8f4cbb76ef tempest-VolumesTestJSON-1334354754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:40:23 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e9969f8a-ee59-44e8-b80f-5a8f4cbb76ef tempest-VolumesTestJSON-1334354754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:40:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e9969f8a-ee59-44e8-b80f-5a8f4cbb76ef tempest-VolumesTestJSON-1334354754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:40:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e9969f8a-ee59-44e8-b80f-5a8f4cbb76ef tempest-VolumesTestJSON-1334354754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:23 devstack sudo[98672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:40:23 devstack sudo[98672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:23 devstack sudo[98669]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a898fade-710d-40eb-b60e-3811c0ffb878 tempest-GroupSnapshotsTest-1060963943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5.b6857b3e-645d-49ee-ae01-9a9d2e98b5a3" returned: 0 in 0.402s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a898fade-710d-40eb-b60e-3811c0ffb878 tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:24 devstack sudo[98676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5.info Aug 11 04:40:24 devstack sudo[98676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:24 devstack sudo[98672]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e9969f8a-ee59-44e8-b80f-5a8f4cbb76ef tempest-VolumesTestJSON-1334354754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.364s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:24 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-e9969f8a-ee59-44e8-b80f-5a8f4cbb76ef tempest-VolumesTestJSON-1334354754 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:40:24 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-e9969f8a-ee59-44e8-b80f-5a8f4cbb76ef tempest-VolumesTestJSON-1334354754 None] Deleted volume successfully. Aug 11 04:40:24 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e9969f8a-ee59-44e8-b80f-5a8f4cbb76ef tempest-VolumesTestJSON-1334354754 None] Lock "cinder-c4967e48-0916-4ad9-9e58-c17ddffb06c0-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:40:24 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fa31b646-e240-4520-b418-71accf1a349f tempest-TaggedAttachmentsTest-453299645 None] Acquiring lock "cinder-51ffead1-a054-4a99-a998-e9aece77458c-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:40:24 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fa31b646-e240-4520-b418-71accf1a349f tempest-TaggedAttachmentsTest-453299645 None] Lock "cinder-51ffead1-a054-4a99-a998-e9aece77458c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:40:24 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fa31b646-e240-4520-b418-71accf1a349f tempest-TaggedAttachmentsTest-453299645 None] Acquiring lock "cinder-quobyte-51ffead1-a054-4a99-a998-e9aece77458c" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:40:24 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fa31b646-e240-4520-b418-71accf1a349f tempest-TaggedAttachmentsTest-453299645 None] Lock "cinder-quobyte-51ffead1-a054-4a99-a998-e9aece77458c" acquired by "delete_volume" :: waited 0.025s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:40:24 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d38b00e-381b-458c-88db-f18810af0b1f]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:40:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fa31b646-e240-4520-b418-71accf1a349f tempest-TaggedAttachmentsTest-453299645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-51ffead1-a054-4a99-a998-e9aece77458c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:24 devstack sudo[98676]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a898fade-710d-40eb-b60e-3811c0ffb878 tempest-GroupSnapshotsTest-1060963943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5.info" returned: 0 in 0.376s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:24 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-a898fade-710d-40eb-b60e-3811c0ffb878 tempest-GroupSnapshotsTest-1060963943 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5.info is being set with open permissions: ugo+rw: NotImplementedError Aug 11 04:40:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a898fade-710d-40eb-b60e-3811c0ffb878 tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:24 devstack sudo[98680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5.info Aug 11 04:40:24 devstack sudo[98680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:24 devstack sudo[98679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-51ffead1-a054-4a99-a998-e9aece77458c Aug 11 04:40:24 devstack sudo[98679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:24 devstack sudo[98680]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a898fade-710d-40eb-b60e-3811c0ffb878 tempest-GroupSnapshotsTest-1060963943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5.info" returned: 0 in 0.301s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a898fade-710d-40eb-b60e-3811c0ffb878 tempest-GroupSnapshotsTest-1060963943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.511s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:40:24 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-a898fade-710d-40eb-b60e-3811c0ffb878 tempest-GroupSnapshotsTest-1060963943 None] group_snapshot 60e249e8-3e0c-425e-a551-88faf0d1004b: created successfully Aug 11 04:40:24 devstack sudo[98679]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fa31b646-e240-4520-b418-71accf1a349f tempest-TaggedAttachmentsTest-453299645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-51ffead1-a054-4a99-a998-e9aece77458c" returned: 0 in 0.498s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fa31b646-e240-4520-b418-71accf1a349f tempest-TaggedAttachmentsTest-453299645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-51ffead1-a054-4a99-a998-e9aece77458c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:24 devstack sudo[98687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-51ffead1-a054-4a99-a998-e9aece77458c Aug 11 04:40:24 devstack sudo[98687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:25 devstack sudo[98687]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fa31b646-e240-4520-b418-71accf1a349f tempest-TaggedAttachmentsTest-453299645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-51ffead1-a054-4a99-a998-e9aece77458c" returned: 0 in 0.269s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fa31b646-e240-4520-b418-71accf1a349f tempest-TaggedAttachmentsTest-453299645 None] Lock "cinder-quobyte-51ffead1-a054-4a99-a998-e9aece77458c" released by "delete_volume" :: held 0.839s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:40:25 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-fa31b646-e240-4520-b418-71accf1a349f tempest-TaggedAttachmentsTest-453299645 None] Created reservations ['1ba96b43-3280-4e02-aaa4-324a5c65cafe', '947746b5-153b-437f-aa50-679d08fa84f0', '68e34af9-5421-47f4-a3bc-cb34b2f3fb36', '8e7c2097-cd5d-4c2d-8226-1d9b50bbc567'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:40:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fa31b646-e240-4520-b418-71accf1a349f tempest-TaggedAttachmentsTest-453299645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:40:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fa31b646-e240-4520-b418-71accf1a349f tempest-TaggedAttachmentsTest-453299645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:40:25 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-fa31b646-e240-4520-b418-71accf1a349f tempest-TaggedAttachmentsTest-453299645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:40:25 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-fa31b646-e240-4520-b418-71accf1a349f tempest-TaggedAttachmentsTest-453299645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:40:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fa31b646-e240-4520-b418-71accf1a349f tempest-TaggedAttachmentsTest-453299645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:40:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fa31b646-e240-4520-b418-71accf1a349f tempest-TaggedAttachmentsTest-453299645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:25 devstack sudo[98690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:40:25 devstack sudo[98690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:25 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-4e8e101c-b211-480f-8feb-b43e7b79a202 tempest-GroupSnapshotsTest-1060963943 None] group_snapshot 60e249e8-3e0c-425e-a551-88faf0d1004b: deleting Aug 11 04:40:25 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4e8e101c-b211-480f-8feb-b43e7b79a202 tempest-GroupSnapshotsTest-1060963943 None] group_snapshot 60e249e8-3e0c-425e-a551-88faf0d1004b: deleting {{(pid=94472) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 11 04:40:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4e8e101c-b211-480f-8feb-b43e7b79a202 tempest-GroupSnapshotsTest-1060963943 None] Acquiring lock "cinder-quobyte-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:40:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4e8e101c-b211-480f-8feb-b43e7b79a202 tempest-GroupSnapshotsTest-1060963943 None] Lock "cinder-quobyte-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:40:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4e8e101c-b211-480f-8feb-b43e7b79a202 tempest-GroupSnapshotsTest-1060963943 None] Acquiring lock "cinder-quobyte-b6857b3e-645d-49ee-ae01-9a9d2e98b5a3" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:40:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4e8e101c-b211-480f-8feb-b43e7b79a202 tempest-GroupSnapshotsTest-1060963943 None] Lock "cinder-quobyte-b6857b3e-645d-49ee-ae01-9a9d2e98b5a3" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:40:25 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-4e8e101c-b211-480f-8feb-b43e7b79a202 tempest-GroupSnapshotsTest-1060963943 None] Deleting offline snapshot b6857b3e-645d-49ee-ae01-9a9d2e98b5a3 of volume 5bf5dbd1-ed38-4b09-9e50-080ae31c66c5 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 04:40:25 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-4e8e101c-b211-480f-8feb-b43e7b79a202 tempest-GroupSnapshotsTest-1060963943 None] snapshot_file for this snap is: volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5.b6857b3e-645d-49ee-ae01-9a9d2e98b5a3 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 04:40:25 devstack sudo[98690]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fa31b646-e240-4520-b418-71accf1a349f tempest-TaggedAttachmentsTest-453299645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.604s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:25 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-fa31b646-e240-4520-b418-71accf1a349f tempest-TaggedAttachmentsTest-453299645 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:40:25 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b312bc-4434-46ab-89fd-9e68515316aa]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:40:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4e8e101c-b211-480f-8feb-b43e7b79a202 tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5.b6857b3e-645d-49ee-ae01-9a9d2e98b5a3 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:25 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-fa31b646-e240-4520-b418-71accf1a349f tempest-TaggedAttachmentsTest-453299645 None] Deleted volume successfully. Aug 11 04:40:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fa31b646-e240-4520-b418-71accf1a349f tempest-TaggedAttachmentsTest-453299645 None] Lock "cinder-51ffead1-a054-4a99-a998-e9aece77458c-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:40:26 devstack sudo[98693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5.b6857b3e-645d-49ee-ae01-9a9d2e98b5a3 Aug 11 04:40:26 devstack sudo[98693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:26 devstack sudo[98693]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4e8e101c-b211-480f-8feb-b43e7b79a202 tempest-GroupSnapshotsTest-1060963943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5.b6857b3e-645d-49ee-ae01-9a9d2e98b5a3" returned: 0 in 0.436s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:26 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-4e8e101c-b211-480f-8feb-b43e7b79a202 tempest-GroupSnapshotsTest-1060963943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:40:26 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[506885ff-aa00-4234-95c2-821de379ee09]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:40:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4e8e101c-b211-480f-8feb-b43e7b79a202 tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:26 devstack sudo[98698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5 Aug 11 04:40:26 devstack sudo[98698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:26 devstack sudo[98698]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4e8e101c-b211-480f-8feb-b43e7b79a202 tempest-GroupSnapshotsTest-1060963943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5" returned: 0 in 0.494s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4e8e101c-b211-480f-8feb-b43e7b79a202 tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5.b6857b3e-645d-49ee-ae01-9a9d2e98b5a3 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:26 devstack sudo[98703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5.b6857b3e-645d-49ee-ae01-9a9d2e98b5a3 Aug 11 04:40:26 devstack sudo[98703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:27 devstack sudo[98703]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4e8e101c-b211-480f-8feb-b43e7b79a202 tempest-GroupSnapshotsTest-1060963943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5.b6857b3e-645d-49ee-ae01-9a9d2e98b5a3" returned: 0 in 0.400s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4e8e101c-b211-480f-8feb-b43e7b79a202 tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5.b6857b3e-645d-49ee-ae01-9a9d2e98b5a3 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:27 devstack sudo[98709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5.b6857b3e-645d-49ee-ae01-9a9d2e98b5a3 Aug 11 04:40:27 devstack sudo[98709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:27 devstack sudo[98709]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4e8e101c-b211-480f-8feb-b43e7b79a202 tempest-GroupSnapshotsTest-1060963943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5.b6857b3e-645d-49ee-ae01-9a9d2e98b5a3" returned: 0 in 0.270s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:27 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4e8e101c-b211-480f-8feb-b43e7b79a202 tempest-GroupSnapshotsTest-1060963943 None] Lock "cinder-quobyte-b6857b3e-645d-49ee-ae01-9a9d2e98b5a3" released by "_delete_snapshot" :: held 1.812s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:40:27 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4e8e101c-b211-480f-8feb-b43e7b79a202 tempest-GroupSnapshotsTest-1060963943 None] Lock "cinder-quobyte-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5" released by "delete_snapshot" :: held 1.849s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:40:27 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=123,cinder:UPDATE=130,cinder:INSERT=32,cinder:DELETE=10 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:40:27 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:UPDATE=140,cinder:SELECT=129,cinder:INSERT=30,cinder:DELETE=2 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:40:27 devstack cinder-volume[94472]: WARNING cinder.quota [None req-4e8e101c-b211-480f-8feb-b43e7b79a202 tempest-GroupSnapshotsTest-1060963943 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-839529177 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-839529177, it is now deprecated. Please use the default quota class for default quota. Aug 11 04:40:27 devstack cinder-volume[94472]: WARNING cinder.quota [None req-4e8e101c-b211-480f-8feb-b43e7b79a202 tempest-GroupSnapshotsTest-1060963943 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-839529177 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-839529177, it is now deprecated. Please use the default quota class for default quota. Aug 11 04:40:27 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-4e8e101c-b211-480f-8feb-b43e7b79a202 tempest-GroupSnapshotsTest-1060963943 None] Created reservations ['f266cff8-55cc-4119-84b8-6da331c4e090', '154ba919-c5ea-4e55-9633-df06a68eec21', '410449c1-c7b4-40dd-9d95-5e44499c84ce', '6e1b0337-dd63-4d30-a6f8-2ecfe86d6b2f'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:40:27 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-4e8e101c-b211-480f-8feb-b43e7b79a202 tempest-GroupSnapshotsTest-1060963943 None] group_snapshot 60e249e8-3e0c-425e-a551-88faf0d1004b: deleted successfully Aug 11 04:40:28 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-826cddf6-9b0d-4b6e-8c18-16e9173a5372 tempest-GroupSnapshotsTest-1060963943 None] Acquiring lock "cinder-quobyte-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:40:28 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-826cddf6-9b0d-4b6e-8c18-16e9173a5372 tempest-GroupSnapshotsTest-1060963943 None] Lock "cinder-quobyte-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5" acquired by "delete_volume" :: waited 0.017s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:40:28 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[e194117f-a9e9-4dc5-8158-21d4ebedec77]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:40:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-826cddf6-9b0d-4b6e-8c18-16e9173a5372 tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:28 devstack sudo[98712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5 Aug 11 04:40:28 devstack sudo[98712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:28 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-b1b1f926-264e-4627-a6b4-36eb16e1798b tempest-GroupSnapshotsV319Test-102447502 None] Group tempest-GroupSnapshotsV319Test-Group-1870366376: creating Aug 11 04:40:28 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-b1b1f926-264e-4627-a6b4-36eb16e1798b tempest-GroupSnapshotsV319Test-102447502 None] Group tempest-GroupSnapshotsV319Test-Group-1870366376: created successfully Aug 11 04:40:28 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-b1b1f926-264e-4627-a6b4-36eb16e1798b tempest-GroupSnapshotsV319Test-102447502 None] Create group completed successfully. Aug 11 04:40:28 devstack sudo[98712]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-826cddf6-9b0d-4b6e-8c18-16e9173a5372 tempest-GroupSnapshotsTest-1060963943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5" returned: 0 in 0.387s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-826cddf6-9b0d-4b6e-8c18-16e9173a5372 tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:28 devstack sudo[98718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5 Aug 11 04:40:28 devstack sudo[98718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:29 devstack sudo[98718]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-826cddf6-9b0d-4b6e-8c18-16e9173a5372 tempest-GroupSnapshotsTest-1060963943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5" returned: 0 in 0.239s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:29 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-826cddf6-9b0d-4b6e-8c18-16e9173a5372 tempest-GroupSnapshotsTest-1060963943 None] Lock "cinder-quobyte-5bf5dbd1-ed38-4b09-9e50-080ae31c66c5" released by "delete_volume" :: held 0.701s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:40:29 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-826cddf6-9b0d-4b6e-8c18-16e9173a5372 tempest-GroupSnapshotsTest-1060963943 None] Created reservations ['1750dbd2-cbf6-4e1b-acc4-5ea56f97454f'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:40:29 devstack cinder-volume[94472]: WARNING cinder.quota [None req-826cddf6-9b0d-4b6e-8c18-16e9173a5372 tempest-GroupSnapshotsTest-1060963943 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-839529177 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-839529177, it is now deprecated. Please use the default quota class for default quota. Aug 11 04:40:29 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-826cddf6-9b0d-4b6e-8c18-16e9173a5372 tempest-GroupSnapshotsTest-1060963943 None] Created reservations ['5e3dde58-2815-445e-92d8-fdd984a2cfe2', '2b5b13be-d583-4a07-a741-d74a50716883', '20a12297-cb9d-48bf-8d1c-9ebb4b42ed14', 'c21dd45c-5106-41ae-a075-31545affe20d'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:40:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-826cddf6-9b0d-4b6e-8c18-16e9173a5372 tempest-GroupSnapshotsTest-1060963943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:40:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-826cddf6-9b0d-4b6e-8c18-16e9173a5372 tempest-GroupSnapshotsTest-1060963943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:40:29 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-826cddf6-9b0d-4b6e-8c18-16e9173a5372 tempest-GroupSnapshotsTest-1060963943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:40:29 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-826cddf6-9b0d-4b6e-8c18-16e9173a5372 tempest-GroupSnapshotsTest-1060963943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:40:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-826cddf6-9b0d-4b6e-8c18-16e9173a5372 tempest-GroupSnapshotsTest-1060963943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:40:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-826cddf6-9b0d-4b6e-8c18-16e9173a5372 tempest-GroupSnapshotsTest-1060963943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:29 devstack sudo[98723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:40:29 devstack sudo[98723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:29 devstack sudo[98723]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-826cddf6-9b0d-4b6e-8c18-16e9173a5372 tempest-GroupSnapshotsTest-1060963943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.301s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:29 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-826cddf6-9b0d-4b6e-8c18-16e9173a5372 tempest-GroupSnapshotsTest-1060963943 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:40:29 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-826cddf6-9b0d-4b6e-8c18-16e9173a5372 tempest-GroupSnapshotsTest-1060963943 None] Delete group completed successfully. Aug 11 04:40:30 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-092b443d-90e7-4f72-a817-b2143a7752b9 tempest-AttachVolumeNegativeTest-2108237366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:40:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-092b443d-90e7-4f72-a817-b2143a7752b9 tempest-AttachVolumeNegativeTest-2108237366 None] Flow 'volume_create_manager' (30f7ef5b-64c0-4b55-899f-9bae01fb8e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:40:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-092b443d-90e7-4f72-a817-b2143a7752b9 tempest-AttachVolumeNegativeTest-2108237366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (219a39d6-7c5b-4d9b-b740-6f4e557a6432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:40:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-092b443d-90e7-4f72-a817-b2143a7752b9 tempest-AttachVolumeNegativeTest-2108237366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (219a39d6-7c5b-4d9b-b740-6f4e557a6432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-821619774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fdca1b9-116f-4bbd-a91a-5f6585815449,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a131d77a71664b3a89d1c522ada17ddd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:40:30Z,use_quota=True,user_id='91e0e000756a4389bb2bb1b08d8fa2e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:40:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-092b443d-90e7-4f72-a817-b2143a7752b9 tempest-AttachVolumeNegativeTest-2108237366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f42a0f8-bcd7-42fb-9617-a72015e391e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:40:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-092b443d-90e7-4f72-a817-b2143a7752b9 tempest-AttachVolumeNegativeTest-2108237366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f42a0f8-bcd7-42fb-9617-a72015e391e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:40:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-092b443d-90e7-4f72-a817-b2143a7752b9 tempest-AttachVolumeNegativeTest-2108237366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec2564c1-c97b-4fdd-8298-cae31c4726a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:40:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-092b443d-90e7-4f72-a817-b2143a7752b9 tempest-AttachVolumeNegativeTest-2108237366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec2564c1-c97b-4fdd-8298-cae31c4726a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fdca1b9-116f-4bbd-a91a-5f6585815449', 'volume_name': 'volume-8fdca1b9-116f-4bbd-a91a-5f6585815449', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:40:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-092b443d-90e7-4f72-a817-b2143a7752b9 tempest-AttachVolumeNegativeTest-2108237366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (016aec92-8bc5-46d1-8e9e-f103231f9561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:40:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-092b443d-90e7-4f72-a817-b2143a7752b9 tempest-AttachVolumeNegativeTest-2108237366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (016aec92-8bc5-46d1-8e9e-f103231f9561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:40:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-092b443d-90e7-4f72-a817-b2143a7752b9 tempest-AttachVolumeNegativeTest-2108237366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21f45287-9f72-41f7-bb9b-53a69193853f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:40:30 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-092b443d-90e7-4f72-a817-b2143a7752b9 tempest-AttachVolumeNegativeTest-2108237366 None] Volume 8fdca1b9-116f-4bbd-a91a-5f6585815449: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fdca1b9-116f-4bbd-a91a-5f6585815449', 'volume_size': 1} Aug 11 04:40:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-092b443d-90e7-4f72-a817-b2143a7752b9 tempest-AttachVolumeNegativeTest-2108237366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:40:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-092b443d-90e7-4f72-a817-b2143a7752b9 tempest-AttachVolumeNegativeTest-2108237366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:40:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-092b443d-90e7-4f72-a817-b2143a7752b9 tempest-AttachVolumeNegativeTest-2108237366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-821619774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fdca1b9-116f-4bbd-a91a-5f6585815449,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a131d77a71664b3a89d1c522ada17ddd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:40:30Z,use_quota=True,user_id='91e0e000756a4389bb2bb1b08d8fa2e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:40:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-092b443d-90e7-4f72-a817-b2143a7752b9 tempest-AttachVolumeNegativeTest-2108237366 None] Creating volume 8fdca1b9-116f-4bbd-a91a-5f6585815449 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:40:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-092b443d-90e7-4f72-a817-b2143a7752b9 tempest-AttachVolumeNegativeTest-2108237366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:40:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-092b443d-90e7-4f72-a817-b2143a7752b9 tempest-AttachVolumeNegativeTest-2108237366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:40:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-092b443d-90e7-4f72-a817-b2143a7752b9 tempest-AttachVolumeNegativeTest-2108237366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:40:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-092b443d-90e7-4f72-a817-b2143a7752b9 tempest-AttachVolumeNegativeTest-2108237366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:40:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-092b443d-90e7-4f72-a817-b2143a7752b9 tempest-AttachVolumeNegativeTest-2108237366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:40:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-092b443d-90e7-4f72-a817-b2143a7752b9 tempest-AttachVolumeNegativeTest-2108237366 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:40:30 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-092b443d-90e7-4f72-a817-b2143a7752b9 tempest-AttachVolumeNegativeTest-2108237366 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:40:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-092b443d-90e7-4f72-a817-b2143a7752b9 tempest-AttachVolumeNegativeTest-2108237366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8fdca1b9-116f-4bbd-a91a-5f6585815449 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:30 devstack sudo[98726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8fdca1b9-116f-4bbd-a91a-5f6585815449 1073741824 Aug 11 04:40:30 devstack sudo[98726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:30 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9b7c374-09ae-485c-9fda-44c532af1d8d tempest-GroupSnapshotsV319Test-102447502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:40:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b9b7c374-09ae-485c-9fda-44c532af1d8d tempest-GroupSnapshotsV319Test-102447502 None] Flow 'volume_create_manager' (61579269-69df-4089-aa28-e1cf3b2fc72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:40:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b9b7c374-09ae-485c-9fda-44c532af1d8d tempest-GroupSnapshotsV319Test-102447502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (470b880b-2cf4-4247-afa2-52b73fd330c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:40:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b9b7c374-09ae-485c-9fda-44c532af1d8d tempest-GroupSnapshotsV319Test-102447502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (470b880b-2cf4-4247-afa2-52b73fd330c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-286032540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2121fcad-2760-4727-bc3b-034b0fb9220f,host='devstack@QuobyteHD#QuobyteHD',id=5599954e-30d0-4394-8ec4-7ef2e4393365,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff6ed090de8b4674b5c7223f819e01e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:40:31Z,use_quota=True,user_id='90347dfe9b5a4cd29c3349606b95af20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6456f215-7e1d-435d-8750-a825e030cbc5),volume_type_id=6456f215-7e1d-435d-8750-a825e030cbc5)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:40:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b9b7c374-09ae-485c-9fda-44c532af1d8d tempest-GroupSnapshotsV319Test-102447502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1560d5a-de1c-438f-8d64-52d7556135e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:40:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b9b7c374-09ae-485c-9fda-44c532af1d8d tempest-GroupSnapshotsV319Test-102447502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1560d5a-de1c-438f-8d64-52d7556135e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:40:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b9b7c374-09ae-485c-9fda-44c532af1d8d tempest-GroupSnapshotsV319Test-102447502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68b275c1-e4a1-454d-9f45-a311d74a3ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:40:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b9b7c374-09ae-485c-9fda-44c532af1d8d tempest-GroupSnapshotsV319Test-102447502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68b275c1-e4a1-454d-9f45-a311d74a3ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5599954e-30d0-4394-8ec4-7ef2e4393365', 'volume_name': 'volume-5599954e-30d0-4394-8ec4-7ef2e4393365', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:40:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b9b7c374-09ae-485c-9fda-44c532af1d8d tempest-GroupSnapshotsV319Test-102447502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f08f1bf6-c62f-4e00-bfce-66f146b4eca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:40:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b9b7c374-09ae-485c-9fda-44c532af1d8d tempest-GroupSnapshotsV319Test-102447502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f08f1bf6-c62f-4e00-bfce-66f146b4eca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:40:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b9b7c374-09ae-485c-9fda-44c532af1d8d tempest-GroupSnapshotsV319Test-102447502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d73bfea-549d-461f-be1a-bd9a4507d4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:40:30 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-b9b7c374-09ae-485c-9fda-44c532af1d8d tempest-GroupSnapshotsV319Test-102447502 None] Volume 5599954e-30d0-4394-8ec4-7ef2e4393365: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5599954e-30d0-4394-8ec4-7ef2e4393365', 'volume_size': 1} Aug 11 04:40:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b9b7c374-09ae-485c-9fda-44c532af1d8d tempest-GroupSnapshotsV319Test-102447502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:40:30 devstack sudo[98726]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-092b443d-90e7-4f72-a817-b2143a7752b9 tempest-AttachVolumeNegativeTest-2108237366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8fdca1b9-116f-4bbd-a91a-5f6585815449 1073741824" returned: 0 in 0.645s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-092b443d-90e7-4f72-a817-b2143a7752b9 tempest-AttachVolumeNegativeTest-2108237366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8fdca1b9-116f-4bbd-a91a-5f6585815449 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:31 devstack sudo[98735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8fdca1b9-116f-4bbd-a91a-5f6585815449 Aug 11 04:40:31 devstack sudo[98735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:31 devstack sudo[98735]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-092b443d-90e7-4f72-a817-b2143a7752b9 tempest-AttachVolumeNegativeTest-2108237366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8fdca1b9-116f-4bbd-a91a-5f6585815449" returned: 0 in 0.284s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:31 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-092b443d-90e7-4f72-a817-b2143a7752b9 tempest-AttachVolumeNegativeTest-2108237366 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:40:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-092b443d-90e7-4f72-a817-b2143a7752b9 tempest-AttachVolumeNegativeTest-2108237366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:40:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b9b7c374-09ae-485c-9fda-44c532af1d8d tempest-GroupSnapshotsV319Test-102447502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.519s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:40:31 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b9b7c374-09ae-485c-9fda-44c532af1d8d tempest-GroupSnapshotsV319Test-102447502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2121fcad-2760-4727-bc3b-034b0fb9220f,created_at=2026-08-11T02:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-286032540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2121fcad-2760-4727-bc3b-034b0fb9220f,host='devstack@QuobyteHD#QuobyteHD',id=5599954e-30d0-4394-8ec4-7ef2e4393365,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff6ed090de8b4674b5c7223f819e01e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:40:31Z,use_quota=True,user_id='90347dfe9b5a4cd29c3349606b95af20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6456f215-7e1d-435d-8750-a825e030cbc5),volume_type_id=6456f215-7e1d-435d-8750-a825e030cbc5)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:40:31 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-b9b7c374-09ae-485c-9fda-44c532af1d8d tempest-GroupSnapshotsV319Test-102447502 None] Creating volume 5599954e-30d0-4394-8ec4-7ef2e4393365 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:40:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b9b7c374-09ae-485c-9fda-44c532af1d8d tempest-GroupSnapshotsV319Test-102447502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:40:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b9b7c374-09ae-485c-9fda-44c532af1d8d tempest-GroupSnapshotsV319Test-102447502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:40:31 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b9b7c374-09ae-485c-9fda-44c532af1d8d tempest-GroupSnapshotsV319Test-102447502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:40:31 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b9b7c374-09ae-485c-9fda-44c532af1d8d tempest-GroupSnapshotsV319Test-102447502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:40:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b9b7c374-09ae-485c-9fda-44c532af1d8d tempest-GroupSnapshotsV319Test-102447502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:40:31 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b9b7c374-09ae-485c-9fda-44c532af1d8d tempest-GroupSnapshotsV319Test-102447502 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:40:31 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-b9b7c374-09ae-485c-9fda-44c532af1d8d tempest-GroupSnapshotsV319Test-102447502 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:40:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b9b7c374-09ae-485c-9fda-44c532af1d8d tempest-GroupSnapshotsV319Test-102447502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5599954e-30d0-4394-8ec4-7ef2e4393365 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-092b443d-90e7-4f72-a817-b2143a7752b9 tempest-AttachVolumeNegativeTest-2108237366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21f45287-9f72-41f7-bb9b-53a69193853f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fdca1b9-116f-4bbd-a91a-5f6585815449', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:40:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-092b443d-90e7-4f72-a817-b2143a7752b9 tempest-AttachVolumeNegativeTest-2108237366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12e8373b-b6f0-4755-8be3-10cbab02e786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:40:31 devstack sudo[98738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5599954e-30d0-4394-8ec4-7ef2e4393365 1073741824 Aug 11 04:40:31 devstack sudo[98738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:31 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-092b443d-90e7-4f72-a817-b2143a7752b9 tempest-AttachVolumeNegativeTest-2108237366 None] Volume volume-8fdca1b9-116f-4bbd-a91a-5f6585815449 (8fdca1b9-116f-4bbd-a91a-5f6585815449): created successfully Aug 11 04:40:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-092b443d-90e7-4f72-a817-b2143a7752b9 tempest-AttachVolumeNegativeTest-2108237366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12e8373b-b6f0-4755-8be3-10cbab02e786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:40:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-092b443d-90e7-4f72-a817-b2143a7752b9 tempest-AttachVolumeNegativeTest-2108237366 None] Flow 'volume_create_manager' (30f7ef5b-64c0-4b55-899f-9bae01fb8e94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:40:31 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-092b443d-90e7-4f72-a817-b2143a7752b9 tempest-AttachVolumeNegativeTest-2108237366 None] Created volume successfully. Aug 11 04:40:31 devstack sudo[98738]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b9b7c374-09ae-485c-9fda-44c532af1d8d tempest-GroupSnapshotsV319Test-102447502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5599954e-30d0-4394-8ec4-7ef2e4393365 1073741824" returned: 0 in 0.620s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b9b7c374-09ae-485c-9fda-44c532af1d8d tempest-GroupSnapshotsV319Test-102447502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5599954e-30d0-4394-8ec4-7ef2e4393365 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:32 devstack sudo[98744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5599954e-30d0-4394-8ec4-7ef2e4393365 Aug 11 04:40:32 devstack sudo[98744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:32 devstack sudo[98744]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b9b7c374-09ae-485c-9fda-44c532af1d8d tempest-GroupSnapshotsV319Test-102447502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5599954e-30d0-4394-8ec4-7ef2e4393365" returned: 0 in 0.313s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b9b7c374-09ae-485c-9fda-44c532af1d8d tempest-GroupSnapshotsV319Test-102447502 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:40:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b9b7c374-09ae-485c-9fda-44c532af1d8d tempest-GroupSnapshotsV319Test-102447502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:40:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b9b7c374-09ae-485c-9fda-44c532af1d8d tempest-GroupSnapshotsV319Test-102447502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d73bfea-549d-461f-be1a-bd9a4507d4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5599954e-30d0-4394-8ec4-7ef2e4393365', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:40:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b9b7c374-09ae-485c-9fda-44c532af1d8d tempest-GroupSnapshotsV319Test-102447502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dc57cbd-2626-460a-9fa2-beed1faeeb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:40:32 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-b9b7c374-09ae-485c-9fda-44c532af1d8d tempest-GroupSnapshotsV319Test-102447502 None] Volume volume-5599954e-30d0-4394-8ec4-7ef2e4393365 (5599954e-30d0-4394-8ec4-7ef2e4393365): created successfully Aug 11 04:40:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b9b7c374-09ae-485c-9fda-44c532af1d8d tempest-GroupSnapshotsV319Test-102447502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dc57cbd-2626-460a-9fa2-beed1faeeb5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:40:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b9b7c374-09ae-485c-9fda-44c532af1d8d tempest-GroupSnapshotsV319Test-102447502 None] Flow 'volume_create_manager' (61579269-69df-4089-aa28-e1cf3b2fc72e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:40:32 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-b9b7c374-09ae-485c-9fda-44c532af1d8d tempest-GroupSnapshotsV319Test-102447502 None] Created volume successfully. Aug 11 04:40:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-eb0446ec-126f-4287-87f7-326dd363e5f1 req-cf15b4fb-a22a-4351-935c-3ba9e49e1a0f tempest-AttachVolumeNegativeTest-2108237366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:40:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-eb0446ec-126f-4287-87f7-326dd363e5f1 req-cf15b4fb-a22a-4351-935c-3ba9e49e1a0f tempest-AttachVolumeNegativeTest-2108237366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:40:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-eb0446ec-126f-4287-87f7-326dd363e5f1 req-cf15b4fb-a22a-4351-935c-3ba9e49e1a0f tempest-AttachVolumeNegativeTest-2108237366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:40:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-eb0446ec-126f-4287-87f7-326dd363e5f1 req-cf15b4fb-a22a-4351-935c-3ba9e49e1a0f tempest-AttachVolumeNegativeTest-2108237366 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd', 'name': 'volume-8fdca1b9-116f-4bbd-a91a-5f6585815449', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4bd433cf-549d-4d93-a550-dc5d47ee1615', 'enforce_multipath': True} {{(pid=94472) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 11 04:40:33 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-eb0446ec-126f-4287-87f7-326dd363e5f1 req-cf15b4fb-a22a-4351-935c-3ba9e49e1a0f tempest-AttachVolumeNegativeTest-2108237366 None] attachment_update completed successfully. Aug 11 04:40:33 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-19d25290-e859-4955-ae5d-2f329ac3a7d9 tempest-GroupSnapshotsV319Test-102447502 None] GroupSnapshot 33e846c5-cbcc-4ec9-8cba-74ff7621bbca: creating. Aug 11 04:40:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-19d25290-e859-4955-ae5d-2f329ac3a7d9 tempest-GroupSnapshotsV319Test-102447502 None] Group snapshot 33e846c5-cbcc-4ec9-8cba-74ff7621bbca: creating. {{(pid=94472) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 11 04:40:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-19d25290-e859-4955-ae5d-2f329ac3a7d9 tempest-GroupSnapshotsV319Test-102447502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:40:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-19d25290-e859-4955-ae5d-2f329ac3a7d9 tempest-GroupSnapshotsV319Test-102447502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:40:33 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-19d25290-e859-4955-ae5d-2f329ac3a7d9 tempest-GroupSnapshotsV319Test-102447502 None] Creating offline snapshot d11f732b-aad8-4247-bae7-cf55844b08b8 of volume 5599954e-30d0-4394-8ec4-7ef2e4393365 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 04:40:33 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c709d4a-3c26-4834-a226-d178f63d6e85]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:40:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-19d25290-e859-4955-ae5d-2f329ac3a7d9 tempest-GroupSnapshotsV319Test-102447502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5599954e-30d0-4394-8ec4-7ef2e4393365 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:33 devstack sudo[98789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5599954e-30d0-4394-8ec4-7ef2e4393365 Aug 11 04:40:33 devstack sudo[98789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:34 devstack sudo[98789]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-19d25290-e859-4955-ae5d-2f329ac3a7d9 tempest-GroupSnapshotsV319Test-102447502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5599954e-30d0-4394-8ec4-7ef2e4393365" returned: 0 in 0.544s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-19d25290-e859-4955-ae5d-2f329ac3a7d9 tempest-GroupSnapshotsV319Test-102447502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5599954e-30d0-4394-8ec4-7ef2e4393365,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5599954e-30d0-4394-8ec4-7ef2e4393365.d11f732b-aad8-4247-bae7-cf55844b08b8 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:34 devstack sudo[99153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5599954e-30d0-4394-8ec4-7ef2e4393365,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5599954e-30d0-4394-8ec4-7ef2e4393365.d11f732b-aad8-4247-bae7-cf55844b08b8 1G Aug 11 04:40:34 devstack sudo[99153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:34 devstack sudo[99153]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-19d25290-e859-4955-ae5d-2f329ac3a7d9 tempest-GroupSnapshotsV319Test-102447502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5599954e-30d0-4394-8ec4-7ef2e4393365,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5599954e-30d0-4394-8ec4-7ef2e4393365.d11f732b-aad8-4247-bae7-cf55844b08b8 1G" returned: 0 in 0.595s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-19d25290-e859-4955-ae5d-2f329ac3a7d9 tempest-GroupSnapshotsV319Test-102447502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5599954e-30d0-4394-8ec4-7ef2e4393365 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5599954e-30d0-4394-8ec4-7ef2e4393365.d11f732b-aad8-4247-bae7-cf55844b08b8 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:34 devstack sudo[99160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5599954e-30d0-4394-8ec4-7ef2e4393365 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5599954e-30d0-4394-8ec4-7ef2e4393365.d11f732b-aad8-4247-bae7-cf55844b08b8 Aug 11 04:40:34 devstack sudo[99160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:35 devstack sudo[99160]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-19d25290-e859-4955-ae5d-2f329ac3a7d9 tempest-GroupSnapshotsV319Test-102447502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5599954e-30d0-4394-8ec4-7ef2e4393365 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5599954e-30d0-4394-8ec4-7ef2e4393365.d11f732b-aad8-4247-bae7-cf55844b08b8" returned: 0 in 0.321s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:35 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-19d25290-e859-4955-ae5d-2f329ac3a7d9 tempest-GroupSnapshotsV319Test-102447502 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5599954e-30d0-4394-8ec4-7ef2e4393365.d11f732b-aad8-4247-bae7-cf55844b08b8 is being set with open permissions: ugo+rw: NotImplementedError Aug 11 04:40:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-19d25290-e859-4955-ae5d-2f329ac3a7d9 tempest-GroupSnapshotsV319Test-102447502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5599954e-30d0-4394-8ec4-7ef2e4393365.d11f732b-aad8-4247-bae7-cf55844b08b8 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:35 devstack sudo[99165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5599954e-30d0-4394-8ec4-7ef2e4393365.d11f732b-aad8-4247-bae7-cf55844b08b8 Aug 11 04:40:35 devstack sudo[99165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:35 devstack sudo[99165]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-19d25290-e859-4955-ae5d-2f329ac3a7d9 tempest-GroupSnapshotsV319Test-102447502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5599954e-30d0-4394-8ec4-7ef2e4393365.d11f732b-aad8-4247-bae7-cf55844b08b8" returned: 0 in 0.267s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-19d25290-e859-4955-ae5d-2f329ac3a7d9 tempest-GroupSnapshotsV319Test-102447502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5599954e-30d0-4394-8ec4-7ef2e4393365.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:35 devstack sudo[99168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5599954e-30d0-4394-8ec4-7ef2e4393365.info Aug 11 04:40:35 devstack sudo[99168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:35 devstack sudo[99168]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-19d25290-e859-4955-ae5d-2f329ac3a7d9 tempest-GroupSnapshotsV319Test-102447502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5599954e-30d0-4394-8ec4-7ef2e4393365.info" returned: 0 in 0.457s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:35 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-19d25290-e859-4955-ae5d-2f329ac3a7d9 tempest-GroupSnapshotsV319Test-102447502 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5599954e-30d0-4394-8ec4-7ef2e4393365.info is being set with open permissions: ugo+rw: NotImplementedError Aug 11 04:40:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-19d25290-e859-4955-ae5d-2f329ac3a7d9 tempest-GroupSnapshotsV319Test-102447502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5599954e-30d0-4394-8ec4-7ef2e4393365.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:35 devstack sudo[99172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5599954e-30d0-4394-8ec4-7ef2e4393365.info Aug 11 04:40:35 devstack sudo[99172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:36 devstack sudo[99172]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-19d25290-e859-4955-ae5d-2f329ac3a7d9 tempest-GroupSnapshotsV319Test-102447502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5599954e-30d0-4394-8ec4-7ef2e4393365.info" returned: 0 in 0.306s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-19d25290-e859-4955-ae5d-2f329ac3a7d9 tempest-GroupSnapshotsV319Test-102447502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.597s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:40:36 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-19d25290-e859-4955-ae5d-2f329ac3a7d9 tempest-GroupSnapshotsV319Test-102447502 None] group_snapshot 33e846c5-cbcc-4ec9-8cba-74ff7621bbca: created successfully Aug 11 04:40:36 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-2b4eb2ed-edf4-4fca-bb98-c45c432d1e66 tempest-GroupsTest-125468306 None] Group tempest-Group1-2128214730: creating Aug 11 04:40:36 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-445c1046-b6d4-4f4b-94ea-302703a3ca2d req-91ff28b9-d7f5-45cf-883c-2a5fd47455d8 tempest-AttachVolumeNegativeTest-2108237366 None] Terminate volume connection completed successfully. Aug 11 04:40:36 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-445c1046-b6d4-4f4b-94ea-302703a3ca2d req-91ff28b9-d7f5-45cf-883c-2a5fd47455d8 tempest-AttachVolumeNegativeTest-2108237366 None] Deleting attachment 4bd433cf-549d-4d93-a550-dc5d47ee1615. {{(pid=94472) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 11 04:40:36 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-2b4eb2ed-edf4-4fca-bb98-c45c432d1e66 tempest-GroupsTest-125468306 None] Group tempest-Group1-2128214730: created successfully Aug 11 04:40:36 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-2b4eb2ed-edf4-4fca-bb98-c45c432d1e66 tempest-GroupsTest-125468306 None] Create group completed successfully. Aug 11 04:40:37 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-dfb8b9eb-8167-4e33-be4a-fe7f00653e74 tempest-GroupSnapshotsV319Test-102447502 None] group_snapshot 33e846c5-cbcc-4ec9-8cba-74ff7621bbca: deleting Aug 11 04:40:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-dfb8b9eb-8167-4e33-be4a-fe7f00653e74 tempest-GroupSnapshotsV319Test-102447502 None] group_snapshot 33e846c5-cbcc-4ec9-8cba-74ff7621bbca: deleting {{(pid=94472) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 11 04:40:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-dfb8b9eb-8167-4e33-be4a-fe7f00653e74 tempest-GroupSnapshotsV319Test-102447502 None] Acquiring lock "cinder-quobyte-5599954e-30d0-4394-8ec4-7ef2e4393365" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:40:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-dfb8b9eb-8167-4e33-be4a-fe7f00653e74 tempest-GroupSnapshotsV319Test-102447502 None] Lock "cinder-quobyte-5599954e-30d0-4394-8ec4-7ef2e4393365" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:40:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-dfb8b9eb-8167-4e33-be4a-fe7f00653e74 tempest-GroupSnapshotsV319Test-102447502 None] Acquiring lock "cinder-quobyte-d11f732b-aad8-4247-bae7-cf55844b08b8" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:40:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-dfb8b9eb-8167-4e33-be4a-fe7f00653e74 tempest-GroupSnapshotsV319Test-102447502 None] Lock "cinder-quobyte-d11f732b-aad8-4247-bae7-cf55844b08b8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:40:37 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-dfb8b9eb-8167-4e33-be4a-fe7f00653e74 tempest-GroupSnapshotsV319Test-102447502 None] Deleting offline snapshot d11f732b-aad8-4247-bae7-cf55844b08b8 of volume 5599954e-30d0-4394-8ec4-7ef2e4393365 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 04:40:37 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-dfb8b9eb-8167-4e33-be4a-fe7f00653e74 tempest-GroupSnapshotsV319Test-102447502 None] snapshot_file for this snap is: volume-5599954e-30d0-4394-8ec4-7ef2e4393365.d11f732b-aad8-4247-bae7-cf55844b08b8 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 04:40:37 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce2ff4d-0fb2-4414-b5fc-1eebc059e1b7]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:40:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-dfb8b9eb-8167-4e33-be4a-fe7f00653e74 tempest-GroupSnapshotsV319Test-102447502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5599954e-30d0-4394-8ec4-7ef2e4393365.d11f732b-aad8-4247-bae7-cf55844b08b8 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:37 devstack sudo[99209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5599954e-30d0-4394-8ec4-7ef2e4393365.d11f732b-aad8-4247-bae7-cf55844b08b8 Aug 11 04:40:37 devstack sudo[99209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:37 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-9e6b6b55-7236-4a19-beee-50494e049f70 tempest-GroupsTest-125468306 None] Group tempest-Group2-2037028560: creating Aug 11 04:40:37 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-9e6b6b55-7236-4a19-beee-50494e049f70 tempest-GroupsTest-125468306 None] Group tempest-Group2-2037028560: created successfully Aug 11 04:40:37 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-9e6b6b55-7236-4a19-beee-50494e049f70 tempest-GroupsTest-125468306 None] Create group completed successfully. Aug 11 04:40:38 devstack sudo[99209]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-dfb8b9eb-8167-4e33-be4a-fe7f00653e74 tempest-GroupSnapshotsV319Test-102447502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5599954e-30d0-4394-8ec4-7ef2e4393365.d11f732b-aad8-4247-bae7-cf55844b08b8" returned: 0 in 0.666s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:38 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-dfb8b9eb-8167-4e33-be4a-fe7f00653e74 tempest-GroupSnapshotsV319Test-102447502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5599954e-30d0-4394-8ec4-7ef2e4393365(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:40:38 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a376bc8-032a-4d8d-a0b9-143492833fca]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:40:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-dfb8b9eb-8167-4e33-be4a-fe7f00653e74 tempest-GroupSnapshotsV319Test-102447502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5599954e-30d0-4394-8ec4-7ef2e4393365 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:38 devstack sudo[99234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5599954e-30d0-4394-8ec4-7ef2e4393365 Aug 11 04:40:38 devstack sudo[99234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:38 devstack sudo[99234]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-dfb8b9eb-8167-4e33-be4a-fe7f00653e74 tempest-GroupSnapshotsV319Test-102447502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5599954e-30d0-4394-8ec4-7ef2e4393365" returned: 0 in 0.432s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-dfb8b9eb-8167-4e33-be4a-fe7f00653e74 tempest-GroupSnapshotsV319Test-102447502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5599954e-30d0-4394-8ec4-7ef2e4393365.d11f732b-aad8-4247-bae7-cf55844b08b8 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:38 devstack sudo[99241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5599954e-30d0-4394-8ec4-7ef2e4393365.d11f732b-aad8-4247-bae7-cf55844b08b8 Aug 11 04:40:38 devstack sudo[99241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:39 devstack sudo[99241]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-dfb8b9eb-8167-4e33-be4a-fe7f00653e74 tempest-GroupSnapshotsV319Test-102447502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5599954e-30d0-4394-8ec4-7ef2e4393365.d11f732b-aad8-4247-bae7-cf55844b08b8" returned: 0 in 0.512s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-dfb8b9eb-8167-4e33-be4a-fe7f00653e74 tempest-GroupSnapshotsV319Test-102447502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5599954e-30d0-4394-8ec4-7ef2e4393365.d11f732b-aad8-4247-bae7-cf55844b08b8 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:39 devstack sudo[99247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5599954e-30d0-4394-8ec4-7ef2e4393365.d11f732b-aad8-4247-bae7-cf55844b08b8 Aug 11 04:40:39 devstack sudo[99247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:39 devstack sudo[99247]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-dfb8b9eb-8167-4e33-be4a-fe7f00653e74 tempest-GroupSnapshotsV319Test-102447502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5599954e-30d0-4394-8ec4-7ef2e4393365.d11f732b-aad8-4247-bae7-cf55844b08b8" returned: 0 in 0.548s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-dfb8b9eb-8167-4e33-be4a-fe7f00653e74 tempest-GroupSnapshotsV319Test-102447502 None] Lock "cinder-quobyte-d11f732b-aad8-4247-bae7-cf55844b08b8" released by "_delete_snapshot" :: held 2.336s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:40:39 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1f6c978-6267-41c6-b2a2-c15e64a1b09e tempest-GroupsTest-125468306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:40:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d1f6c978-6267-41c6-b2a2-c15e64a1b09e tempest-GroupsTest-125468306 None] Flow 'volume_create_manager' (dc207cbe-7caa-4055-888b-be6619f172e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:40:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d1f6c978-6267-41c6-b2a2-c15e64a1b09e tempest-GroupsTest-125468306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d27e47ef-fbe8-4906-af8a-226128d29efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:40:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-dfb8b9eb-8167-4e33-be4a-fe7f00653e74 tempest-GroupSnapshotsV319Test-102447502 None] Lock "cinder-quobyte-5599954e-30d0-4394-8ec4-7ef2e4393365" released by "delete_snapshot" :: held 2.418s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:40:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d1f6c978-6267-41c6-b2a2-c15e64a1b09e tempest-GroupsTest-125468306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d27e47ef-fbe8-4906-af8a-226128d29efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1033383559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2f70463b-458c-419a-b985-fce9d6d13a7b,host='devstack@QuobyteHD#QuobyteHD',id=fb20a464-c875-418d-87e6-c436d951445b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c392e77d35e14e4aba23dfd68c692a3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:40:40Z,use_quota=True,user_id='14bb5bbe7f0847f8b7c609d29c01d8cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54557ffb-2b7e-4d1b-8b20-5bde559c05df),volume_type_id=54557ffb-2b7e-4d1b-8b20-5bde559c05df)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:40:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d1f6c978-6267-41c6-b2a2-c15e64a1b09e tempest-GroupsTest-125468306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aa1578b-6767-4742-8183-48e89a6d788a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:40:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d1f6c978-6267-41c6-b2a2-c15e64a1b09e tempest-GroupsTest-125468306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aa1578b-6767-4742-8183-48e89a6d788a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:40:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d1f6c978-6267-41c6-b2a2-c15e64a1b09e tempest-GroupsTest-125468306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0af22980-228b-41ad-95c5-af1550d96de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:40:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d1f6c978-6267-41c6-b2a2-c15e64a1b09e tempest-GroupsTest-125468306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0af22980-228b-41ad-95c5-af1550d96de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb20a464-c875-418d-87e6-c436d951445b', 'volume_name': 'volume-fb20a464-c875-418d-87e6-c436d951445b', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:40:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d1f6c978-6267-41c6-b2a2-c15e64a1b09e tempest-GroupsTest-125468306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ec3ec8f-a996-4c8e-a6ff-d52f2da4d3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:40:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d1f6c978-6267-41c6-b2a2-c15e64a1b09e tempest-GroupsTest-125468306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ec3ec8f-a996-4c8e-a6ff-d52f2da4d3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:40:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d1f6c978-6267-41c6-b2a2-c15e64a1b09e tempest-GroupsTest-125468306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cbd556e-feab-4a3e-8db5-ec703b427982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:40:39 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-d1f6c978-6267-41c6-b2a2-c15e64a1b09e tempest-GroupsTest-125468306 None] Volume fb20a464-c875-418d-87e6-c436d951445b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb20a464-c875-418d-87e6-c436d951445b', 'volume_size': 1} Aug 11 04:40:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d1f6c978-6267-41c6-b2a2-c15e64a1b09e tempest-GroupsTest-125468306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:40:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d1f6c978-6267-41c6-b2a2-c15e64a1b09e tempest-GroupsTest-125468306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:40:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d1f6c978-6267-41c6-b2a2-c15e64a1b09e tempest-GroupsTest-125468306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2f70463b-458c-419a-b985-fce9d6d13a7b,created_at=2026-08-11T02:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1033383559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2f70463b-458c-419a-b985-fce9d6d13a7b,host='devstack@QuobyteHD#QuobyteHD',id=fb20a464-c875-418d-87e6-c436d951445b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c392e77d35e14e4aba23dfd68c692a3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:40:40Z,use_quota=True,user_id='14bb5bbe7f0847f8b7c609d29c01d8cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54557ffb-2b7e-4d1b-8b20-5bde559c05df),volume_type_id=54557ffb-2b7e-4d1b-8b20-5bde559c05df)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:40:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-d1f6c978-6267-41c6-b2a2-c15e64a1b09e tempest-GroupsTest-125468306 None] Creating volume fb20a464-c875-418d-87e6-c436d951445b {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:40:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d1f6c978-6267-41c6-b2a2-c15e64a1b09e tempest-GroupsTest-125468306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:40:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d1f6c978-6267-41c6-b2a2-c15e64a1b09e tempest-GroupsTest-125468306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:40:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d1f6c978-6267-41c6-b2a2-c15e64a1b09e tempest-GroupsTest-125468306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:40:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d1f6c978-6267-41c6-b2a2-c15e64a1b09e tempest-GroupsTest-125468306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:40:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d1f6c978-6267-41c6-b2a2-c15e64a1b09e tempest-GroupsTest-125468306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:40:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d1f6c978-6267-41c6-b2a2-c15e64a1b09e tempest-GroupsTest-125468306 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:40:39 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-d1f6c978-6267-41c6-b2a2-c15e64a1b09e tempest-GroupsTest-125468306 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:40:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d1f6c978-6267-41c6-b2a2-c15e64a1b09e tempest-GroupsTest-125468306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-fb20a464-c875-418d-87e6-c436d951445b 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:39 devstack sudo[99253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-fb20a464-c875-418d-87e6-c436d951445b 1073741824 Aug 11 04:40:39 devstack sudo[99253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:39 devstack cinder-volume[94472]: WARNING cinder.quota [None req-dfb8b9eb-8167-4e33-be4a-fe7f00653e74 tempest-GroupSnapshotsV319Test-102447502 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-551711354 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-551711354, it is now deprecated. Please use the default quota class for default quota. Aug 11 04:40:39 devstack cinder-volume[94472]: WARNING cinder.quota [None req-dfb8b9eb-8167-4e33-be4a-fe7f00653e74 tempest-GroupSnapshotsV319Test-102447502 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-551711354 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-551711354, it is now deprecated. Please use the default quota class for default quota. Aug 11 04:40:39 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-dfb8b9eb-8167-4e33-be4a-fe7f00653e74 tempest-GroupSnapshotsV319Test-102447502 None] Created reservations ['aca08945-b966-48ff-9ad5-19dac3fc5a8d', '033df1ea-e493-4f10-bade-cdc56da6c490', 'cbd514dc-30d0-41f4-b7f3-aa0aa782ccfc', 'fa448b28-40a8-418b-a8a3-84812ea4ca94'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:40:40 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-dfb8b9eb-8167-4e33-be4a-fe7f00653e74 tempest-GroupSnapshotsV319Test-102447502 None] group_snapshot 33e846c5-cbcc-4ec9-8cba-74ff7621bbca: deleted successfully Aug 11 04:40:40 devstack sudo[99253]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d1f6c978-6267-41c6-b2a2-c15e64a1b09e tempest-GroupsTest-125468306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-fb20a464-c875-418d-87e6-c436d951445b 1073741824" returned: 0 in 0.533s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d1f6c978-6267-41c6-b2a2-c15e64a1b09e tempest-GroupsTest-125468306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-fb20a464-c875-418d-87e6-c436d951445b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:40 devstack sudo[99260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-fb20a464-c875-418d-87e6-c436d951445b Aug 11 04:40:40 devstack sudo[99260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:40 devstack sudo[99260]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d1f6c978-6267-41c6-b2a2-c15e64a1b09e tempest-GroupsTest-125468306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-fb20a464-c875-418d-87e6-c436d951445b" returned: 0 in 0.241s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:40 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d1f6c978-6267-41c6-b2a2-c15e64a1b09e tempest-GroupsTest-125468306 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:40:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d1f6c978-6267-41c6-b2a2-c15e64a1b09e tempest-GroupsTest-125468306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:40:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d1f6c978-6267-41c6-b2a2-c15e64a1b09e tempest-GroupsTest-125468306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cbd556e-feab-4a3e-8db5-ec703b427982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb20a464-c875-418d-87e6-c436d951445b', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:40:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d1f6c978-6267-41c6-b2a2-c15e64a1b09e tempest-GroupsTest-125468306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04abff60-f870-49fe-844e-23a2d8b04232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:40:40 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-d1f6c978-6267-41c6-b2a2-c15e64a1b09e tempest-GroupsTest-125468306 None] Volume volume-fb20a464-c875-418d-87e6-c436d951445b (fb20a464-c875-418d-87e6-c436d951445b): created successfully Aug 11 04:40:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d1f6c978-6267-41c6-b2a2-c15e64a1b09e tempest-GroupsTest-125468306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04abff60-f870-49fe-844e-23a2d8b04232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:40:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d1f6c978-6267-41c6-b2a2-c15e64a1b09e tempest-GroupsTest-125468306 None] Flow 'volume_create_manager' (dc207cbe-7caa-4055-888b-be6619f172e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:40:40 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-d1f6c978-6267-41c6-b2a2-c15e64a1b09e tempest-GroupsTest-125468306 None] Created volume successfully. Aug 11 04:40:41 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-78357a1e-a347-4b54-9df7-e9c864fe79e6 tempest-GroupSnapshotsV319Test-102447502 None] Acquiring lock "cinder-quobyte-5599954e-30d0-4394-8ec4-7ef2e4393365" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:40:41 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-78357a1e-a347-4b54-9df7-e9c864fe79e6 tempest-GroupSnapshotsV319Test-102447502 None] Lock "cinder-quobyte-5599954e-30d0-4394-8ec4-7ef2e4393365" acquired by "delete_volume" :: waited 0.035s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:40:41 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d781c7-0cbc-4471-9a22-58f791710d0b]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:40:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-78357a1e-a347-4b54-9df7-e9c864fe79e6 tempest-GroupSnapshotsV319Test-102447502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5599954e-30d0-4394-8ec4-7ef2e4393365 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:41 devstack sudo[99263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5599954e-30d0-4394-8ec4-7ef2e4393365 Aug 11 04:40:41 devstack sudo[99263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:41 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-eaa11303-3e16-4dab-9199-d848a2acfd98 tempest-GroupsTest-125468306 None] Acquiring lock "cinder-quobyte-fb20a464-c875-418d-87e6-c436d951445b" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:40:41 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-eaa11303-3e16-4dab-9199-d848a2acfd98 tempest-GroupsTest-125468306 None] Lock "cinder-quobyte-fb20a464-c875-418d-87e6-c436d951445b" acquired by "delete_volume" :: waited 0.026s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:40:41 devstack sudo[99263]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-78357a1e-a347-4b54-9df7-e9c864fe79e6 tempest-GroupSnapshotsV319Test-102447502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5599954e-30d0-4394-8ec4-7ef2e4393365" returned: 0 in 0.500s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-78357a1e-a347-4b54-9df7-e9c864fe79e6 tempest-GroupSnapshotsV319Test-102447502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5599954e-30d0-4394-8ec4-7ef2e4393365 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:41 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[9843b6cd-286b-4ec8-b0d2-9151508c05cc]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:40:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-eaa11303-3e16-4dab-9199-d848a2acfd98 tempest-GroupsTest-125468306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-fb20a464-c875-418d-87e6-c436d951445b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:41 devstack sudo[99268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5599954e-30d0-4394-8ec4-7ef2e4393365 Aug 11 04:40:41 devstack sudo[99268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:42 devstack sudo[99269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-fb20a464-c875-418d-87e6-c436d951445b Aug 11 04:40:42 devstack sudo[99269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:42 devstack sudo[99268]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-78357a1e-a347-4b54-9df7-e9c864fe79e6 tempest-GroupSnapshotsV319Test-102447502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5599954e-30d0-4394-8ec4-7ef2e4393365" returned: 0 in 0.364s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:42 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-78357a1e-a347-4b54-9df7-e9c864fe79e6 tempest-GroupSnapshotsV319Test-102447502 None] Lock "cinder-quobyte-5599954e-30d0-4394-8ec4-7ef2e4393365" released by "delete_volume" :: held 0.954s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:40:42 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-78357a1e-a347-4b54-9df7-e9c864fe79e6 tempest-GroupSnapshotsV319Test-102447502 None] Created reservations ['fae097f3-46c8-476d-bacb-ed6d4d3d1fd0'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:40:42 devstack cinder-volume[94472]: WARNING cinder.quota [None req-78357a1e-a347-4b54-9df7-e9c864fe79e6 tempest-GroupSnapshotsV319Test-102447502 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-551711354 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-551711354, it is now deprecated. Please use the default quota class for default quota. Aug 11 04:40:42 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-78357a1e-a347-4b54-9df7-e9c864fe79e6 tempest-GroupSnapshotsV319Test-102447502 None] Created reservations ['bf3a0fe8-f267-426c-a8c1-df404aeb04e0', 'c7fc6659-6018-40e0-890f-f6c809e8c8b4', '66bbfef7-e847-4a48-9b75-7d27b084d3b1', '9ef00fa8-4b63-4867-b380-64277315e473'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:40:42 devstack sudo[99269]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-eaa11303-3e16-4dab-9199-d848a2acfd98 tempest-GroupsTest-125468306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-fb20a464-c875-418d-87e6-c436d951445b" returned: 0 in 0.611s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-eaa11303-3e16-4dab-9199-d848a2acfd98 tempest-GroupsTest-125468306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-fb20a464-c875-418d-87e6-c436d951445b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:42 devstack sudo[99278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-fb20a464-c875-418d-87e6-c436d951445b Aug 11 04:40:42 devstack sudo[99278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-78357a1e-a347-4b54-9df7-e9c864fe79e6 tempest-GroupSnapshotsV319Test-102447502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:40:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-78357a1e-a347-4b54-9df7-e9c864fe79e6 tempest-GroupSnapshotsV319Test-102447502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:40:42 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-78357a1e-a347-4b54-9df7-e9c864fe79e6 tempest-GroupSnapshotsV319Test-102447502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:40:42 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-78357a1e-a347-4b54-9df7-e9c864fe79e6 tempest-GroupSnapshotsV319Test-102447502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:40:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-78357a1e-a347-4b54-9df7-e9c864fe79e6 tempest-GroupSnapshotsV319Test-102447502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:40:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-78357a1e-a347-4b54-9df7-e9c864fe79e6 tempest-GroupSnapshotsV319Test-102447502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:42 devstack sudo[99281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:40:42 devstack sudo[99281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:42 devstack sudo[99278]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-eaa11303-3e16-4dab-9199-d848a2acfd98 tempest-GroupsTest-125468306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-fb20a464-c875-418d-87e6-c436d951445b" returned: 0 in 0.346s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:42 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-eaa11303-3e16-4dab-9199-d848a2acfd98 tempest-GroupsTest-125468306 None] Lock "cinder-quobyte-fb20a464-c875-418d-87e6-c436d951445b" released by "delete_volume" :: held 1.030s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:40:42 devstack sudo[99281]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-78357a1e-a347-4b54-9df7-e9c864fe79e6 tempest-GroupSnapshotsV319Test-102447502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.310s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:42 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-78357a1e-a347-4b54-9df7-e9c864fe79e6 tempest-GroupSnapshotsV319Test-102447502 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:40:42 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-78357a1e-a347-4b54-9df7-e9c864fe79e6 tempest-GroupSnapshotsV319Test-102447502 None] Delete group completed successfully. Aug 11 04:40:42 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-eaa11303-3e16-4dab-9199-d848a2acfd98 tempest-GroupsTest-125468306 None] Created reservations ['5e9d54b3-8535-404a-bdb8-d641bba1a871'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:40:42 devstack cinder-volume[94472]: WARNING cinder.quota [None req-eaa11303-3e16-4dab-9199-d848a2acfd98 tempest-GroupsTest-125468306 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1901289843 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1901289843, it is now deprecated. Please use the default quota class for default quota. Aug 11 04:40:42 devstack cinder-volume[94472]: WARNING cinder.quota [None req-eaa11303-3e16-4dab-9199-d848a2acfd98 tempest-GroupsTest-125468306 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1901289843 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1901289843, it is now deprecated. Please use the default quota class for default quota. Aug 11 04:40:43 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-eaa11303-3e16-4dab-9199-d848a2acfd98 tempest-GroupsTest-125468306 None] Created reservations ['20aaa714-6608-43a0-b0d2-b5ea500cd915', 'f53f1992-d19e-4a7c-b693-8d35015aaafb', '62e5faa0-4cda-4884-9d11-6b8828d26235', '34b7f5b3-158a-41b8-8087-677915ca615e'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:40:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-eaa11303-3e16-4dab-9199-d848a2acfd98 tempest-GroupsTest-125468306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:40:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-eaa11303-3e16-4dab-9199-d848a2acfd98 tempest-GroupsTest-125468306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:40:43 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-eaa11303-3e16-4dab-9199-d848a2acfd98 tempest-GroupsTest-125468306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:40:43 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-eaa11303-3e16-4dab-9199-d848a2acfd98 tempest-GroupsTest-125468306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:40:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-eaa11303-3e16-4dab-9199-d848a2acfd98 tempest-GroupsTest-125468306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:40:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-eaa11303-3e16-4dab-9199-d848a2acfd98 tempest-GroupsTest-125468306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:43 devstack sudo[99285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:40:43 devstack sudo[99285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:43 devstack sudo[99285]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-eaa11303-3e16-4dab-9199-d848a2acfd98 tempest-GroupsTest-125468306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.277s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:43 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-eaa11303-3e16-4dab-9199-d848a2acfd98 tempest-GroupsTest-125468306 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:40:43 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-eaa11303-3e16-4dab-9199-d848a2acfd98 tempest-GroupsTest-125468306 None] Delete group completed successfully. Aug 11 04:40:44 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-b2f25705-8cc6-4908-bedd-09c5ac433a91 tempest-GroupsTest-125468306 None] Created reservations ['e07b07c9-6870-4ffb-9b42-4b3ee2339c83'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:40:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b2f25705-8cc6-4908-bedd-09c5ac433a91 tempest-GroupsTest-125468306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:40:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b2f25705-8cc6-4908-bedd-09c5ac433a91 tempest-GroupsTest-125468306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:40:44 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b2f25705-8cc6-4908-bedd-09c5ac433a91 tempest-GroupsTest-125468306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:40:44 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b2f25705-8cc6-4908-bedd-09c5ac433a91 tempest-GroupsTest-125468306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:40:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b2f25705-8cc6-4908-bedd-09c5ac433a91 tempest-GroupsTest-125468306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:40:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b2f25705-8cc6-4908-bedd-09c5ac433a91 tempest-GroupsTest-125468306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:44 devstack sudo[99288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:40:44 devstack sudo[99288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:44 devstack sudo[99288]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b2f25705-8cc6-4908-bedd-09c5ac433a91 tempest-GroupsTest-125468306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.392s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:44 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-b2f25705-8cc6-4908-bedd-09c5ac433a91 tempest-GroupsTest-125468306 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:40:44 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-b2f25705-8cc6-4908-bedd-09c5ac433a91 tempest-GroupsTest-125468306 None] Delete group completed successfully. Aug 11 04:40:46 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-0ea147bd-ac61-4ca8-b252-e2bbfdd068fd tempest-GroupsTest-125468306 None] Group tempest-GroupsTest-Group-719889803: creating Aug 11 04:40:46 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-0ea147bd-ac61-4ca8-b252-e2bbfdd068fd tempest-GroupsTest-125468306 None] Group tempest-GroupsTest-Group-719889803: created successfully Aug 11 04:40:46 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-0ea147bd-ac61-4ca8-b252-e2bbfdd068fd tempest-GroupsTest-125468306 None] Create group completed successfully. Aug 11 04:40:48 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e2564cc-4efa-4f23-939b-d68c4dc3028d tempest-GroupsTest-125468306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:40:48 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2e2564cc-4efa-4f23-939b-d68c4dc3028d tempest-GroupsTest-125468306 None] Flow 'volume_create_manager' (d62d200e-f9d8-44d6-a9ed-0298a70ba40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:40:48 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2e2564cc-4efa-4f23-939b-d68c4dc3028d tempest-GroupsTest-125468306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b496f7b-2ef5-4592-ad7e-1dd988b1fce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:40:48 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2e2564cc-4efa-4f23-939b-d68c4dc3028d tempest-GroupsTest-125468306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b496f7b-2ef5-4592-ad7e-1dd988b1fce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:40:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-170389563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5c2ade0b-3e59-4439-b53b-1bea484189f6,host='devstack@QuobyteHD#QuobyteHD',id=f17edf4d-43b9-44c1-af8c-405399cbd3b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c392e77d35e14e4aba23dfd68c692a3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:40:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:40:48Z,use_quota=True,user_id='14bb5bbe7f0847f8b7c609d29c01d8cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd940183-7570-4f14-af3f-4d5b63868ded),volume_type_id=dd940183-7570-4f14-af3f-4d5b63868ded)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:40:48 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2e2564cc-4efa-4f23-939b-d68c4dc3028d tempest-GroupsTest-125468306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85128e48-cd5d-427c-a4eb-149dff59fd1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:40:48 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2e2564cc-4efa-4f23-939b-d68c4dc3028d tempest-GroupsTest-125468306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85128e48-cd5d-427c-a4eb-149dff59fd1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:40:48 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2e2564cc-4efa-4f23-939b-d68c4dc3028d tempest-GroupsTest-125468306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5812dcf1-736e-4682-a439-f7ed4f537847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:40:48 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2e2564cc-4efa-4f23-939b-d68c4dc3028d tempest-GroupsTest-125468306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5812dcf1-736e-4682-a439-f7ed4f537847) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f17edf4d-43b9-44c1-af8c-405399cbd3b5', 'volume_name': 'volume-f17edf4d-43b9-44c1-af8c-405399cbd3b5', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:40:48 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2e2564cc-4efa-4f23-939b-d68c4dc3028d tempest-GroupsTest-125468306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e1aa6db-05ae-4959-8821-86617cc9b3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:40:48 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2e2564cc-4efa-4f23-939b-d68c4dc3028d tempest-GroupsTest-125468306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e1aa6db-05ae-4959-8821-86617cc9b3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:40:48 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2e2564cc-4efa-4f23-939b-d68c4dc3028d tempest-GroupsTest-125468306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92b430ad-fb6c-4670-bf7f-486fe7c53d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:40:48 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-2e2564cc-4efa-4f23-939b-d68c4dc3028d tempest-GroupsTest-125468306 None] Volume f17edf4d-43b9-44c1-af8c-405399cbd3b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f17edf4d-43b9-44c1-af8c-405399cbd3b5', 'volume_size': 1} Aug 11 04:40:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2e2564cc-4efa-4f23-939b-d68c4dc3028d tempest-GroupsTest-125468306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:40:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2e2564cc-4efa-4f23-939b-d68c4dc3028d tempest-GroupsTest-125468306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:40:48 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2e2564cc-4efa-4f23-939b-d68c4dc3028d tempest-GroupsTest-125468306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5c2ade0b-3e59-4439-b53b-1bea484189f6,created_at=2026-08-11T02:40:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-170389563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5c2ade0b-3e59-4439-b53b-1bea484189f6,host='devstack@QuobyteHD#QuobyteHD',id=f17edf4d-43b9-44c1-af8c-405399cbd3b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c392e77d35e14e4aba23dfd68c692a3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:40:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:40:48Z,use_quota=True,user_id='14bb5bbe7f0847f8b7c609d29c01d8cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd940183-7570-4f14-af3f-4d5b63868ded),volume_type_id=dd940183-7570-4f14-af3f-4d5b63868ded)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:40:48 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-2e2564cc-4efa-4f23-939b-d68c4dc3028d tempest-GroupsTest-125468306 None] Creating volume f17edf4d-43b9-44c1-af8c-405399cbd3b5 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:40:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2e2564cc-4efa-4f23-939b-d68c4dc3028d tempest-GroupsTest-125468306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:40:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2e2564cc-4efa-4f23-939b-d68c4dc3028d tempest-GroupsTest-125468306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:40:48 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2e2564cc-4efa-4f23-939b-d68c4dc3028d tempest-GroupsTest-125468306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:40:48 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2e2564cc-4efa-4f23-939b-d68c4dc3028d tempest-GroupsTest-125468306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:40:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2e2564cc-4efa-4f23-939b-d68c4dc3028d tempest-GroupsTest-125468306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:40:48 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2e2564cc-4efa-4f23-939b-d68c4dc3028d tempest-GroupsTest-125468306 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:40:48 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-2e2564cc-4efa-4f23-939b-d68c4dc3028d tempest-GroupsTest-125468306 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:40:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2e2564cc-4efa-4f23-939b-d68c4dc3028d tempest-GroupsTest-125468306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f17edf4d-43b9-44c1-af8c-405399cbd3b5 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:48 devstack sudo[99299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f17edf4d-43b9-44c1-af8c-405399cbd3b5 1073741824 Aug 11 04:40:48 devstack sudo[99299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:48 devstack sudo[99299]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2e2564cc-4efa-4f23-939b-d68c4dc3028d tempest-GroupsTest-125468306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f17edf4d-43b9-44c1-af8c-405399cbd3b5 1073741824" returned: 0 in 0.702s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2e2564cc-4efa-4f23-939b-d68c4dc3028d tempest-GroupsTest-125468306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f17edf4d-43b9-44c1-af8c-405399cbd3b5 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:48 devstack sudo[99305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f17edf4d-43b9-44c1-af8c-405399cbd3b5 Aug 11 04:40:48 devstack sudo[99305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:49 devstack sudo[99305]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2e2564cc-4efa-4f23-939b-d68c4dc3028d tempest-GroupsTest-125468306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f17edf4d-43b9-44c1-af8c-405399cbd3b5" returned: 0 in 0.339s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:49 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2e2564cc-4efa-4f23-939b-d68c4dc3028d tempest-GroupsTest-125468306 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:40:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2e2564cc-4efa-4f23-939b-d68c4dc3028d tempest-GroupsTest-125468306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:40:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2e2564cc-4efa-4f23-939b-d68c4dc3028d tempest-GroupsTest-125468306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92b430ad-fb6c-4670-bf7f-486fe7c53d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f17edf4d-43b9-44c1-af8c-405399cbd3b5', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:40:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2e2564cc-4efa-4f23-939b-d68c4dc3028d tempest-GroupsTest-125468306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23936a7b-cd9d-44bf-9b3b-053a0beebd06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:40:49 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-2e2564cc-4efa-4f23-939b-d68c4dc3028d tempest-GroupsTest-125468306 None] Volume volume-f17edf4d-43b9-44c1-af8c-405399cbd3b5 (f17edf4d-43b9-44c1-af8c-405399cbd3b5): created successfully Aug 11 04:40:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2e2564cc-4efa-4f23-939b-d68c4dc3028d tempest-GroupsTest-125468306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23936a7b-cd9d-44bf-9b3b-053a0beebd06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:40:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2e2564cc-4efa-4f23-939b-d68c4dc3028d tempest-GroupsTest-125468306 None] Flow 'volume_create_manager' (d62d200e-f9d8-44d6-a9ed-0298a70ba40b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:40:49 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-2e2564cc-4efa-4f23-939b-d68c4dc3028d tempest-GroupsTest-125468306 None] Created volume successfully. Aug 11 04:40:51 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c59d6ad-0690-466f-bafc-7ae1c16db8bd tempest-GroupsTest-125468306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:40:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9c59d6ad-0690-466f-bafc-7ae1c16db8bd tempest-GroupsTest-125468306 None] Flow 'volume_create_manager' (95c97b6e-5540-4baf-a5f4-9ed71f66a338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:40:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9c59d6ad-0690-466f-bafc-7ae1c16db8bd tempest-GroupsTest-125468306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99ab4353-b973-4993-be1d-384f97ead405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:40:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9c59d6ad-0690-466f-bafc-7ae1c16db8bd tempest-GroupsTest-125468306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99ab4353-b973-4993-be1d-384f97ead405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2050266723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5c2ade0b-3e59-4439-b53b-1bea484189f6,host='devstack@QuobyteHD#QuobyteHD',id=e015738b-ed33-43da-babc-3fc0b1da4c6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c392e77d35e14e4aba23dfd68c692a3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:40:51Z,use_quota=True,user_id='14bb5bbe7f0847f8b7c609d29c01d8cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd940183-7570-4f14-af3f-4d5b63868ded),volume_type_id=dd940183-7570-4f14-af3f-4d5b63868ded)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:40:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9c59d6ad-0690-466f-bafc-7ae1c16db8bd tempest-GroupsTest-125468306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ebfd46b-79d4-4cb5-bc2d-cc974a140466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:40:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9c59d6ad-0690-466f-bafc-7ae1c16db8bd tempest-GroupsTest-125468306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ebfd46b-79d4-4cb5-bc2d-cc974a140466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:40:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9c59d6ad-0690-466f-bafc-7ae1c16db8bd tempest-GroupsTest-125468306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0927f86-72e6-4669-a3aa-c2eea5aa9f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:40:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9c59d6ad-0690-466f-bafc-7ae1c16db8bd tempest-GroupsTest-125468306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0927f86-72e6-4669-a3aa-c2eea5aa9f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e015738b-ed33-43da-babc-3fc0b1da4c6e', 'volume_name': 'volume-e015738b-ed33-43da-babc-3fc0b1da4c6e', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:40:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9c59d6ad-0690-466f-bafc-7ae1c16db8bd tempest-GroupsTest-125468306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6965c80-413e-48c0-86b8-ab69336f9608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:40:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9c59d6ad-0690-466f-bafc-7ae1c16db8bd tempest-GroupsTest-125468306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6965c80-413e-48c0-86b8-ab69336f9608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:40:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9c59d6ad-0690-466f-bafc-7ae1c16db8bd tempest-GroupsTest-125468306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d016f2e3-30ea-4061-be56-8b929354e0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:40:51 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-9c59d6ad-0690-466f-bafc-7ae1c16db8bd tempest-GroupsTest-125468306 None] Volume e015738b-ed33-43da-babc-3fc0b1da4c6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e015738b-ed33-43da-babc-3fc0b1da4c6e', 'volume_size': 1} Aug 11 04:40:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9c59d6ad-0690-466f-bafc-7ae1c16db8bd tempest-GroupsTest-125468306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:40:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9c59d6ad-0690-466f-bafc-7ae1c16db8bd tempest-GroupsTest-125468306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:40:51 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9c59d6ad-0690-466f-bafc-7ae1c16db8bd tempest-GroupsTest-125468306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5c2ade0b-3e59-4439-b53b-1bea484189f6,created_at=2026-08-11T02:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2050266723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5c2ade0b-3e59-4439-b53b-1bea484189f6,host='devstack@QuobyteHD#QuobyteHD',id=e015738b-ed33-43da-babc-3fc0b1da4c6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c392e77d35e14e4aba23dfd68c692a3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:40:51Z,use_quota=True,user_id='14bb5bbe7f0847f8b7c609d29c01d8cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd940183-7570-4f14-af3f-4d5b63868ded),volume_type_id=dd940183-7570-4f14-af3f-4d5b63868ded)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:40:51 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-9c59d6ad-0690-466f-bafc-7ae1c16db8bd tempest-GroupsTest-125468306 None] Creating volume e015738b-ed33-43da-babc-3fc0b1da4c6e {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:40:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9c59d6ad-0690-466f-bafc-7ae1c16db8bd tempest-GroupsTest-125468306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:40:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9c59d6ad-0690-466f-bafc-7ae1c16db8bd tempest-GroupsTest-125468306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:40:51 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9c59d6ad-0690-466f-bafc-7ae1c16db8bd tempest-GroupsTest-125468306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:40:51 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9c59d6ad-0690-466f-bafc-7ae1c16db8bd tempest-GroupsTest-125468306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:40:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9c59d6ad-0690-466f-bafc-7ae1c16db8bd tempest-GroupsTest-125468306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:40:51 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9c59d6ad-0690-466f-bafc-7ae1c16db8bd tempest-GroupsTest-125468306 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:40:51 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-9c59d6ad-0690-466f-bafc-7ae1c16db8bd tempest-GroupsTest-125468306 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:40:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9c59d6ad-0690-466f-bafc-7ae1c16db8bd tempest-GroupsTest-125468306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e015738b-ed33-43da-babc-3fc0b1da4c6e 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:51 devstack sudo[99326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e015738b-ed33-43da-babc-3fc0b1da4c6e 1073741824 Aug 11 04:40:51 devstack sudo[99326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:52 devstack sudo[99326]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9c59d6ad-0690-466f-bafc-7ae1c16db8bd tempest-GroupsTest-125468306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e015738b-ed33-43da-babc-3fc0b1da4c6e 1073741824" returned: 0 in 0.658s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9c59d6ad-0690-466f-bafc-7ae1c16db8bd tempest-GroupsTest-125468306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e015738b-ed33-43da-babc-3fc0b1da4c6e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:52 devstack sudo[99334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e015738b-ed33-43da-babc-3fc0b1da4c6e Aug 11 04:40:52 devstack sudo[99334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:52 devstack sudo[99334]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9c59d6ad-0690-466f-bafc-7ae1c16db8bd tempest-GroupsTest-125468306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e015738b-ed33-43da-babc-3fc0b1da4c6e" returned: 0 in 0.280s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9c59d6ad-0690-466f-bafc-7ae1c16db8bd tempest-GroupsTest-125468306 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:40:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9c59d6ad-0690-466f-bafc-7ae1c16db8bd tempest-GroupsTest-125468306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:40:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9c59d6ad-0690-466f-bafc-7ae1c16db8bd tempest-GroupsTest-125468306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d016f2e3-30ea-4061-be56-8b929354e0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e015738b-ed33-43da-babc-3fc0b1da4c6e', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:40:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9c59d6ad-0690-466f-bafc-7ae1c16db8bd tempest-GroupsTest-125468306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bef18b0-2e4c-44a7-8dc6-6c1a79c2d946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:40:52 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-9c59d6ad-0690-466f-bafc-7ae1c16db8bd tempest-GroupsTest-125468306 None] Volume volume-e015738b-ed33-43da-babc-3fc0b1da4c6e (e015738b-ed33-43da-babc-3fc0b1da4c6e): created successfully Aug 11 04:40:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9c59d6ad-0690-466f-bafc-7ae1c16db8bd tempest-GroupsTest-125468306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bef18b0-2e4c-44a7-8dc6-6c1a79c2d946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:40:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9c59d6ad-0690-466f-bafc-7ae1c16db8bd tempest-GroupsTest-125468306 None] Flow 'volume_create_manager' (95c97b6e-5540-4baf-a5f4-9ed71f66a338) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:40:52 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-9c59d6ad-0690-466f-bafc-7ae1c16db8bd tempest-GroupsTest-125468306 None] Created volume successfully. Aug 11 04:40:52 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-72263483-cd42-42f9-8006-1607ea809e46 tempest-GroupsTest-125468306 None] Update group completed successfully. Aug 11 04:40:54 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-11daf348-cc6f-4c10-b9fd-2e31e724cfa0 tempest-GroupsTest-125468306 None] Update group completed successfully. Aug 11 04:40:56 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-49a7f504-370a-48c7-9ec6-7e5c3162c5a7 tempest-GroupsTest-125468306 None] Acquiring lock "cinder-quobyte-e015738b-ed33-43da-babc-3fc0b1da4c6e" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:40:56 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-49a7f504-370a-48c7-9ec6-7e5c3162c5a7 tempest-GroupsTest-125468306 None] Lock "cinder-quobyte-e015738b-ed33-43da-babc-3fc0b1da4c6e" acquired by "delete_volume" :: waited 0.025s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:40:56 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf7973e-efa7-4212-bcbf-91297b6f8c19]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:40:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-49a7f504-370a-48c7-9ec6-7e5c3162c5a7 tempest-GroupsTest-125468306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e015738b-ed33-43da-babc-3fc0b1da4c6e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:56 devstack sudo[99420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e015738b-ed33-43da-babc-3fc0b1da4c6e Aug 11 04:40:56 devstack sudo[99420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:57 devstack sudo[99420]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-49a7f504-370a-48c7-9ec6-7e5c3162c5a7 tempest-GroupsTest-125468306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e015738b-ed33-43da-babc-3fc0b1da4c6e" returned: 0 in 0.546s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-49a7f504-370a-48c7-9ec6-7e5c3162c5a7 tempest-GroupsTest-125468306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e015738b-ed33-43da-babc-3fc0b1da4c6e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:57 devstack sudo[99425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e015738b-ed33-43da-babc-3fc0b1da4c6e Aug 11 04:40:57 devstack sudo[99425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:57 devstack sudo[99425]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-49a7f504-370a-48c7-9ec6-7e5c3162c5a7 tempest-GroupsTest-125468306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e015738b-ed33-43da-babc-3fc0b1da4c6e" returned: 0 in 0.577s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:57 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-49a7f504-370a-48c7-9ec6-7e5c3162c5a7 tempest-GroupsTest-125468306 None] Lock "cinder-quobyte-e015738b-ed33-43da-babc-3fc0b1da4c6e" released by "delete_volume" :: held 1.210s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:40:57 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-49a7f504-370a-48c7-9ec6-7e5c3162c5a7 tempest-GroupsTest-125468306 None] Acquiring lock "cinder-quobyte-f17edf4d-43b9-44c1-af8c-405399cbd3b5" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:40:57 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-49a7f504-370a-48c7-9ec6-7e5c3162c5a7 tempest-GroupsTest-125468306 None] Lock "cinder-quobyte-f17edf4d-43b9-44c1-af8c-405399cbd3b5" acquired by "delete_volume" :: waited 0.039s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:40:57 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36c42ed-4c2c-4046-bf0a-396dfb9e1925]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:40:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-49a7f504-370a-48c7-9ec6-7e5c3162c5a7 tempest-GroupsTest-125468306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f17edf4d-43b9-44c1-af8c-405399cbd3b5 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:58 devstack sudo[99431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f17edf4d-43b9-44c1-af8c-405399cbd3b5 Aug 11 04:40:58 devstack sudo[99431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:58 devstack sudo[99431]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-49a7f504-370a-48c7-9ec6-7e5c3162c5a7 tempest-GroupsTest-125468306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f17edf4d-43b9-44c1-af8c-405399cbd3b5" returned: 0 in 0.515s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-49a7f504-370a-48c7-9ec6-7e5c3162c5a7 tempest-GroupsTest-125468306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f17edf4d-43b9-44c1-af8c-405399cbd3b5 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:58 devstack sudo[99436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f17edf4d-43b9-44c1-af8c-405399cbd3b5 Aug 11 04:40:58 devstack sudo[99436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:58 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 04:40:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:40:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:40:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:40:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:40:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:40:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:58 devstack sudo[99438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:40:58 devstack sudo[99438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:58 devstack sudo[99436]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-49a7f504-370a-48c7-9ec6-7e5c3162c5a7 tempest-GroupsTest-125468306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f17edf4d-43b9-44c1-af8c-405399cbd3b5" returned: 0 in 0.321s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:58 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-49a7f504-370a-48c7-9ec6-7e5c3162c5a7 tempest-GroupsTest-125468306 None] Lock "cinder-quobyte-f17edf4d-43b9-44c1-af8c-405399cbd3b5" released by "delete_volume" :: held 0.914s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:40:58 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-49a7f504-370a-48c7-9ec6-7e5c3162c5a7 tempest-GroupsTest-125468306 None] Created reservations ['2845826a-f55d-4b83-bd32-ac88398c39e6'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:40:58 devstack cinder-volume[94472]: WARNING cinder.quota [None req-49a7f504-370a-48c7-9ec6-7e5c3162c5a7 tempest-GroupsTest-125468306 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-761784166 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-761784166, it is now deprecated. Please use the default quota class for default quota. Aug 11 04:40:58 devstack cinder-volume[94472]: WARNING cinder.quota [None req-49a7f504-370a-48c7-9ec6-7e5c3162c5a7 tempest-GroupsTest-125468306 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-761784166 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-761784166, it is now deprecated. Please use the default quota class for default quota. Aug 11 04:40:58 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-49a7f504-370a-48c7-9ec6-7e5c3162c5a7 tempest-GroupsTest-125468306 None] Created reservations ['39cebfa3-d57b-48ca-8003-a35ecdc02070', 'ec0ff188-c930-4151-b483-a2b155f0312e', '1c71d6ee-6bb6-48dc-98fc-df15e83eaea0', '8c98fe5e-22eb-4fc2-8c83-ec4e0fce4c58'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:40:59 devstack sudo[99438]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:59 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-49a7f504-370a-48c7-9ec6-7e5c3162c5a7 tempest-GroupsTest-125468306 None] Created reservations ['6c301af4-5f33-4324-9315-63ee3e07ff57', 'a2d62fc5-891d-43fc-9dbd-af54d33ad1fb', '1425050d-4601-49c4-8439-5e14869510f5', '2e14926c-880c-40ad-b4c0-5ad61b89eae2'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:40:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.732s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:59 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:40:59 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running periodic task VolumeManager._thread_info {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 04:40:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] thread count: 8 {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 11 04:40:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] thread info: [<_MainThread(MainThread, started 133315846115456)>, , , , , , , ] {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 11 04:40:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-49a7f504-370a-48c7-9ec6-7e5c3162c5a7 tempest-GroupsTest-125468306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:40:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-49a7f504-370a-48c7-9ec6-7e5c3162c5a7 tempest-GroupsTest-125468306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:40:59 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-49a7f504-370a-48c7-9ec6-7e5c3162c5a7 tempest-GroupsTest-125468306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:40:59 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-49a7f504-370a-48c7-9ec6-7e5c3162c5a7 tempest-GroupsTest-125468306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:40:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-49a7f504-370a-48c7-9ec6-7e5c3162c5a7 tempest-GroupsTest-125468306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:40:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-49a7f504-370a-48c7-9ec6-7e5c3162c5a7 tempest-GroupsTest-125468306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:40:59 devstack sudo[99442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:40:59 devstack sudo[99442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:40:59 devstack sudo[99442]: pam_unix(sudo:session): session closed for user root Aug 11 04:40:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-49a7f504-370a-48c7-9ec6-7e5c3162c5a7 tempest-GroupsTest-125468306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.467s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:40:59 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-49a7f504-370a-48c7-9ec6-7e5c3162c5a7 tempest-GroupsTest-125468306 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:40:59 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-49a7f504-370a-48c7-9ec6-7e5c3162c5a7 tempest-GroupsTest-125468306 None] Delete group completed successfully. Aug 11 04:41:00 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-4b431e43-3b91-4905-a704-4e525c52e251 tempest-GroupsV314Test-1489721617 None] Group tempest-GroupsV314Test-Group-1917947449: creating Aug 11 04:41:00 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-4b431e43-3b91-4905-a704-4e525c52e251 tempest-GroupsV314Test-1489721617 None] Group tempest-GroupsV314Test-Group-1917947449: created successfully Aug 11 04:41:00 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-4b431e43-3b91-4905-a704-4e525c52e251 tempest-GroupsV314Test-1489721617 None] Create group completed successfully. Aug 11 04:41:02 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed8ea46b-fa30-49ce-aa4b-9e9f40e290af tempest-GroupsV314Test-1489721617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:41:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ed8ea46b-fa30-49ce-aa4b-9e9f40e290af tempest-GroupsV314Test-1489721617 None] Flow 'volume_create_manager' (e21b89db-5c9a-4a3d-9f63-2cc489820dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:41:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ed8ea46b-fa30-49ce-aa4b-9e9f40e290af tempest-GroupsV314Test-1489721617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70850494-f8b9-4d99-9c6b-2f1fea7d010b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:41:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ed8ea46b-fa30-49ce-aa4b-9e9f40e290af tempest-GroupsV314Test-1489721617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70850494-f8b9-4d99-9c6b-2f1fea7d010b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:41:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-306240141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d710154a-15e4-4d5f-ab84-655042327c54,host='devstack@QuobyteHD#QuobyteHD',id=f9eeb458-893f-40ff-98af-81eaaac6880f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90042e3e9874c1186aa93f2d95d7315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:41:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:41:03Z,use_quota=True,user_id='2ae4776139c341569afb39727169f46c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a360b3-02a5-47a7-80b5-421e1246f547),volume_type_id=b1a360b3-02a5-47a7-80b5-421e1246f547)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:41:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ed8ea46b-fa30-49ce-aa4b-9e9f40e290af tempest-GroupsV314Test-1489721617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46d01b49-4a52-4e99-9529-d0b46e7a9c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:41:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ed8ea46b-fa30-49ce-aa4b-9e9f40e290af tempest-GroupsV314Test-1489721617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46d01b49-4a52-4e99-9529-d0b46e7a9c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:41:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ed8ea46b-fa30-49ce-aa4b-9e9f40e290af tempest-GroupsV314Test-1489721617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aad83fc9-cc14-4e67-8d3f-6594872cab61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:41:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ed8ea46b-fa30-49ce-aa4b-9e9f40e290af tempest-GroupsV314Test-1489721617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aad83fc9-cc14-4e67-8d3f-6594872cab61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9eeb458-893f-40ff-98af-81eaaac6880f', 'volume_name': 'volume-f9eeb458-893f-40ff-98af-81eaaac6880f', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:41:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ed8ea46b-fa30-49ce-aa4b-9e9f40e290af tempest-GroupsV314Test-1489721617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b40efb67-ce3e-447c-a1ca-64c08dcc8fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:41:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ed8ea46b-fa30-49ce-aa4b-9e9f40e290af tempest-GroupsV314Test-1489721617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b40efb67-ce3e-447c-a1ca-64c08dcc8fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:41:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ed8ea46b-fa30-49ce-aa4b-9e9f40e290af tempest-GroupsV314Test-1489721617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0964abdc-8b33-4afd-8df1-f55e229e9769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:41:02 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-ed8ea46b-fa30-49ce-aa4b-9e9f40e290af tempest-GroupsV314Test-1489721617 None] Volume f9eeb458-893f-40ff-98af-81eaaac6880f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9eeb458-893f-40ff-98af-81eaaac6880f', 'volume_size': 1} Aug 11 04:41:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ed8ea46b-fa30-49ce-aa4b-9e9f40e290af tempest-GroupsV314Test-1489721617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:41:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ed8ea46b-fa30-49ce-aa4b-9e9f40e290af tempest-GroupsV314Test-1489721617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:41:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ed8ea46b-fa30-49ce-aa4b-9e9f40e290af tempest-GroupsV314Test-1489721617 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d710154a-15e4-4d5f-ab84-655042327c54,created_at=2026-08-11T02:41:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-306240141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d710154a-15e4-4d5f-ab84-655042327c54,host='devstack@QuobyteHD#QuobyteHD',id=f9eeb458-893f-40ff-98af-81eaaac6880f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90042e3e9874c1186aa93f2d95d7315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:41:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:41:03Z,use_quota=True,user_id='2ae4776139c341569afb39727169f46c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a360b3-02a5-47a7-80b5-421e1246f547),volume_type_id=b1a360b3-02a5-47a7-80b5-421e1246f547)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:41:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-ed8ea46b-fa30-49ce-aa4b-9e9f40e290af tempest-GroupsV314Test-1489721617 None] Creating volume f9eeb458-893f-40ff-98af-81eaaac6880f {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:41:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ed8ea46b-fa30-49ce-aa4b-9e9f40e290af tempest-GroupsV314Test-1489721617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:41:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ed8ea46b-fa30-49ce-aa4b-9e9f40e290af tempest-GroupsV314Test-1489721617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:41:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ed8ea46b-fa30-49ce-aa4b-9e9f40e290af tempest-GroupsV314Test-1489721617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:41:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ed8ea46b-fa30-49ce-aa4b-9e9f40e290af tempest-GroupsV314Test-1489721617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:41:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ed8ea46b-fa30-49ce-aa4b-9e9f40e290af tempest-GroupsV314Test-1489721617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:41:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ed8ea46b-fa30-49ce-aa4b-9e9f40e290af tempest-GroupsV314Test-1489721617 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:41:02 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-ed8ea46b-fa30-49ce-aa4b-9e9f40e290af tempest-GroupsV314Test-1489721617 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:41:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ed8ea46b-fa30-49ce-aa4b-9e9f40e290af tempest-GroupsV314Test-1489721617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:03 devstack sudo[99458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f 1073741824 Aug 11 04:41:03 devstack sudo[99458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:03 devstack sudo[99458]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ed8ea46b-fa30-49ce-aa4b-9e9f40e290af tempest-GroupsV314Test-1489721617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f 1073741824" returned: 0 in 0.746s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ed8ea46b-fa30-49ce-aa4b-9e9f40e290af tempest-GroupsV314Test-1489721617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:03 devstack sudo[99475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f Aug 11 04:41:03 devstack sudo[99475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:04 devstack sudo[99475]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ed8ea46b-fa30-49ce-aa4b-9e9f40e290af tempest-GroupsV314Test-1489721617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f" returned: 0 in 0.594s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:04 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ed8ea46b-fa30-49ce-aa4b-9e9f40e290af tempest-GroupsV314Test-1489721617 None] <== create_volume: return (1448ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:41:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ed8ea46b-fa30-49ce-aa4b-9e9f40e290af tempest-GroupsV314Test-1489721617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.453s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:41:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ed8ea46b-fa30-49ce-aa4b-9e9f40e290af tempest-GroupsV314Test-1489721617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0964abdc-8b33-4afd-8df1-f55e229e9769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9eeb458-893f-40ff-98af-81eaaac6880f', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:41:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ed8ea46b-fa30-49ce-aa4b-9e9f40e290af tempest-GroupsV314Test-1489721617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16b3b16a-91af-49cd-a377-374f0cd71568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:41:04 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-ed8ea46b-fa30-49ce-aa4b-9e9f40e290af tempest-GroupsV314Test-1489721617 None] Volume volume-f9eeb458-893f-40ff-98af-81eaaac6880f (f9eeb458-893f-40ff-98af-81eaaac6880f): created successfully Aug 11 04:41:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ed8ea46b-fa30-49ce-aa4b-9e9f40e290af tempest-GroupsV314Test-1489721617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16b3b16a-91af-49cd-a377-374f0cd71568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:41:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ed8ea46b-fa30-49ce-aa4b-9e9f40e290af tempest-GroupsV314Test-1489721617 None] Flow 'volume_create_manager' (e21b89db-5c9a-4a3d-9f63-2cc489820dd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:41:04 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-ed8ea46b-fa30-49ce-aa4b-9e9f40e290af tempest-GroupsV314Test-1489721617 None] Created volume successfully. Aug 11 04:41:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:41:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:41:07 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] Cloning volume f9eeb458-893f-40ff-98af-81eaaac6880f to volume 0805feb8-e380-4210-88bf-924faf9a8c01 Aug 11 04:41:07 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] Creating offline snapshot 56ce6289-617e-4fc6-8398-db2406edbae1 of volume f9eeb458-893f-40ff-98af-81eaaac6880f {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 04:41:07 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[e335c7cc-419c-469a-8644-74358401b746]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:41:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:07 devstack sudo[99526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f Aug 11 04:41:07 devstack sudo[99526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:08 devstack sudo[99526]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f" returned: 0 in 1.037s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f.56ce6289-617e-4fc6-8398-db2406edbae1 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:08 devstack sudo[99594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f.56ce6289-617e-4fc6-8398-db2406edbae1 1G Aug 11 04:41:08 devstack sudo[99594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:09 devstack sudo[99594]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f.56ce6289-617e-4fc6-8398-db2406edbae1 1G" returned: 0 in 0.701s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9eeb458-893f-40ff-98af-81eaaac6880f -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f.56ce6289-617e-4fc6-8398-db2406edbae1 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:09 devstack sudo[99618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9eeb458-893f-40ff-98af-81eaaac6880f -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f.56ce6289-617e-4fc6-8398-db2406edbae1 Aug 11 04:41:09 devstack sudo[99618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:09 devstack sudo[99618]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9eeb458-893f-40ff-98af-81eaaac6880f -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f.56ce6289-617e-4fc6-8398-db2406edbae1" returned: 0 in 0.503s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:09 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f.56ce6289-617e-4fc6-8398-db2406edbae1 is being set with open permissions: ugo+rw: NotImplementedError Aug 11 04:41:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f.56ce6289-617e-4fc6-8398-db2406edbae1 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:09 devstack sudo[99625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f.56ce6289-617e-4fc6-8398-db2406edbae1 Aug 11 04:41:09 devstack sudo[99625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:09 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-ae213f0e-d457-4035-8ef4-bc8f27da0da2 tempest-GroupsV320Test-2021639226 None] Group tempest-GroupsV320Test-Group-1739079276: creating Aug 11 04:41:09 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-ae213f0e-d457-4035-8ef4-bc8f27da0da2 tempest-GroupsV320Test-2021639226 None] Group tempest-GroupsV320Test-Group-1739079276: created successfully Aug 11 04:41:09 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-ae213f0e-d457-4035-8ef4-bc8f27da0da2 tempest-GroupsV320Test-2021639226 None] Create group completed successfully. Aug 11 04:41:09 devstack sudo[99625]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f.56ce6289-617e-4fc6-8398-db2406edbae1" returned: 0 in 0.366s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:10 devstack sudo[99652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f.info Aug 11 04:41:10 devstack sudo[99652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:10 devstack sudo[99652]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f.info" returned: 0 in 0.372s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:10 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f.info is being set with open permissions: ugo+rw: NotImplementedError Aug 11 04:41:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:10 devstack sudo[99655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f.info Aug 11 04:41:10 devstack sudo[99655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:10 devstack sudo[99655]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f.info" returned: 0 in 0.270s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] Acquiring lock "cinder-quobyte-0805feb8-e380-4210-88bf-924faf9a8c01" by "_copy_volume_from_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:41:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] Lock "cinder-quobyte-0805feb8-e380-4210-88bf-924faf9a8c01" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:41:10 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] snapshot: 56ce6289-617e-4fc6-8398-db2406edbae1, volume: 0805feb8-e380-4210-88bf-924faf9a8c01, {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 11 04:41:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:41:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:41:10 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:41:10 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:41:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:41:10 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[351b4689-529d-4735-a5ab-f10efdb473fb]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:41:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f.56ce6289-617e-4fc6-8398-db2406edbae1 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:10 devstack sudo[99659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f.56ce6289-617e-4fc6-8398-db2406edbae1 Aug 11 04:41:10 devstack sudo[99659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:11 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-d0c33fe7-2276-48b2-8f2e-b4f6f5667fef tempest-GroupsV320Test-2021639226 None] Created reservations ['bc051b77-3a9e-4026-9b8f-1571a70a51b5'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:41:11 devstack sudo[99659]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f.56ce6289-617e-4fc6-8398-db2406edbae1" returned: 0 in 0.470s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9eeb458-893f-40ff-98af-81eaaac6880f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:41:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d0c33fe7-2276-48b2-8f2e-b4f6f5667fef tempest-GroupsV320Test-2021639226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:41:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d0c33fe7-2276-48b2-8f2e-b4f6f5667fef tempest-GroupsV320Test-2021639226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:41:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d0c33fe7-2276-48b2-8f2e-b4f6f5667fef tempest-GroupsV320Test-2021639226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:41:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d0c33fe7-2276-48b2-8f2e-b4f6f5667fef tempest-GroupsV320Test-2021639226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:41:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d0c33fe7-2276-48b2-8f2e-b4f6f5667fef tempest-GroupsV320Test-2021639226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:41:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d0c33fe7-2276-48b2-8f2e-b4f6f5667fef tempest-GroupsV320Test-2021639226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:11 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ad535a-ce39-46e0-b87c-98d137f175c2]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:41:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:11 devstack sudo[99665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:41:11 devstack sudo[99665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:11 devstack sudo[99666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f Aug 11 04:41:11 devstack sudo[99666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:11 devstack sudo[99665]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d0c33fe7-2276-48b2-8f2e-b4f6f5667fef tempest-GroupsV320Test-2021639226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.365s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:11 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-d0c33fe7-2276-48b2-8f2e-b4f6f5667fef tempest-GroupsV320Test-2021639226 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:41:11 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-d0c33fe7-2276-48b2-8f2e-b4f6f5667fef tempest-GroupsV320Test-2021639226 None] Delete group completed successfully. Aug 11 04:41:11 devstack sudo[99666]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f" returned: 0 in 0.487s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] will copy from snapshot at /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 11 04:41:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] Creating direct copy from snapshot {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 11 04:41:11 devstack cinder-volume[94472]: DEBUG cinder.utils [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] Path /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-0805feb8-e380-4210-88bf-924faf9a8c01 not found in is_blk_device check {{(pid=94472) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 11 04:41:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-0805feb8-e380-4210-88bf-924faf9a8c01 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:11 devstack sudo[99673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-0805feb8-e380-4210-88bf-924faf9a8c01 Aug 11 04:41:11 devstack sudo[99673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:19 devstack sudo[99673]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-0805feb8-e380-4210-88bf-924faf9a8c01" returned: 0 in 7.566s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:19 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] Image conversion details: src /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f, size 1024.00 MB, duration 7.57 sec, destination /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-0805feb8-e380-4210-88bf-924faf9a8c01 {{(pid=94472) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 11 04:41:19 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] Converted 1024.00 MB image at 135.31 MB/s Aug 11 04:41:19 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-0805feb8-e380-4210-88bf-924faf9a8c01 is being set with open permissions: ugo+rw: NotImplementedError Aug 11 04:41:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-0805feb8-e380-4210-88bf-924faf9a8c01 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:19 devstack sudo[99691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-0805feb8-e380-4210-88bf-924faf9a8c01 Aug 11 04:41:19 devstack sudo[99691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:19 devstack sudo[99691]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-0805feb8-e380-4210-88bf-924faf9a8c01" returned: 0 in 0.362s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] Lock "cinder-quobyte-0805feb8-e380-4210-88bf-924faf9a8c01" released by "_copy_volume_from_snapshot" :: held 8.999s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:41:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] Acquiring lock "cinder-quobyte-56ce6289-617e-4fc6-8398-db2406edbae1" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:41:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] Lock "cinder-quobyte-56ce6289-617e-4fc6-8398-db2406edbae1" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:41:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] Deleting offline snapshot 56ce6289-617e-4fc6-8398-db2406edbae1 of volume f9eeb458-893f-40ff-98af-81eaaac6880f {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 04:41:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] snapshot_file for this snap is: volume-f9eeb458-893f-40ff-98af-81eaaac6880f.56ce6289-617e-4fc6-8398-db2406edbae1 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 04:41:19 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2fd4dfc-8618-4bc7-b13b-117794a382d3]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:41:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f.56ce6289-617e-4fc6-8398-db2406edbae1 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:19 devstack sudo[99694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f.56ce6289-617e-4fc6-8398-db2406edbae1 Aug 11 04:41:19 devstack sudo[99694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:20 devstack sudo[99694]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f.56ce6289-617e-4fc6-8398-db2406edbae1" returned: 0 in 0.436s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9eeb458-893f-40ff-98af-81eaaac6880f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:41:20 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7a3bba-bb84-435e-b4e8-e2b0ed7c7aca]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:41:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:20 devstack sudo[99699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f Aug 11 04:41:20 devstack sudo[99699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:20 devstack sudo[99699]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f" returned: 0 in 0.596s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f.56ce6289-617e-4fc6-8398-db2406edbae1 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:20 devstack sudo[99704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f.56ce6289-617e-4fc6-8398-db2406edbae1 Aug 11 04:41:20 devstack sudo[99704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:21 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=108,cinder:INSERT=19,cinder:UPDATE=99,cinder:DELETE=2 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:41:21 devstack sudo[99704]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f.56ce6289-617e-4fc6-8398-db2406edbae1" returned: 0 in 0.503s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f.56ce6289-617e-4fc6-8398-db2406edbae1 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:21 devstack sudo[99712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f.56ce6289-617e-4fc6-8398-db2406edbae1 Aug 11 04:41:21 devstack sudo[99712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:21 devstack sudo[99712]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f.56ce6289-617e-4fc6-8398-db2406edbae1" returned: 0 in 0.417s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] Lock "cinder-quobyte-56ce6289-617e-4fc6-8398-db2406edbae1" released by "_delete_snapshot" :: held 2.092s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:41:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.723s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:41:21 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc1db0f4-9b46-48db-9740-3f3051b1086d tempest-AttachVolumeNegativeTest-2108237366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:41:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-dc1db0f4-9b46-48db-9740-3f3051b1086d tempest-AttachVolumeNegativeTest-2108237366 None] Flow 'volume_create_manager' (1b8a1ce1-ec92-4f49-b282-9eebba82ac48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:41:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-dc1db0f4-9b46-48db-9740-3f3051b1086d tempest-AttachVolumeNegativeTest-2108237366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (629036b5-1b3f-4f68-b9dd-25c14d45e2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:41:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-dc1db0f4-9b46-48db-9740-3f3051b1086d tempest-AttachVolumeNegativeTest-2108237366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (629036b5-1b3f-4f68-b9dd-25c14d45e2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1669282269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e56542a-b095-4684-a05f-07b4eb05aba0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a131d77a71664b3a89d1c522ada17ddd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:41:22Z,use_quota=True,user_id='91e0e000756a4389bb2bb1b08d8fa2e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:41:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-dc1db0f4-9b46-48db-9740-3f3051b1086d tempest-AttachVolumeNegativeTest-2108237366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e15438be-9d94-460f-9d74-006047696631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:41:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-dc1db0f4-9b46-48db-9740-3f3051b1086d tempest-AttachVolumeNegativeTest-2108237366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e15438be-9d94-460f-9d74-006047696631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:41:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-dc1db0f4-9b46-48db-9740-3f3051b1086d tempest-AttachVolumeNegativeTest-2108237366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (453e0ba0-bfa1-4757-973c-0518544749df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:41:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-dc1db0f4-9b46-48db-9740-3f3051b1086d tempest-AttachVolumeNegativeTest-2108237366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (453e0ba0-bfa1-4757-973c-0518544749df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e56542a-b095-4684-a05f-07b4eb05aba0', 'volume_name': 'volume-2e56542a-b095-4684-a05f-07b4eb05aba0', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:41:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-dc1db0f4-9b46-48db-9740-3f3051b1086d tempest-AttachVolumeNegativeTest-2108237366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03f0df42-730d-4d96-b67b-1e6d364c0d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:41:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-dc1db0f4-9b46-48db-9740-3f3051b1086d tempest-AttachVolumeNegativeTest-2108237366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03f0df42-730d-4d96-b67b-1e6d364c0d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:41:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-dc1db0f4-9b46-48db-9740-3f3051b1086d tempest-AttachVolumeNegativeTest-2108237366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aa972e8-6ff0-4075-840b-a2c443d2f65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:41:22 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-dc1db0f4-9b46-48db-9740-3f3051b1086d tempest-AttachVolumeNegativeTest-2108237366 None] Volume 2e56542a-b095-4684-a05f-07b4eb05aba0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e56542a-b095-4684-a05f-07b4eb05aba0', 'volume_size': 1} Aug 11 04:41:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-dc1db0f4-9b46-48db-9740-3f3051b1086d tempest-AttachVolumeNegativeTest-2108237366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:41:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-dc1db0f4-9b46-48db-9740-3f3051b1086d tempest-AttachVolumeNegativeTest-2108237366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:41:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-dc1db0f4-9b46-48db-9740-3f3051b1086d tempest-AttachVolumeNegativeTest-2108237366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1669282269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e56542a-b095-4684-a05f-07b4eb05aba0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a131d77a71664b3a89d1c522ada17ddd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:41:22Z,use_quota=True,user_id='91e0e000756a4389bb2bb1b08d8fa2e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:41:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-dc1db0f4-9b46-48db-9740-3f3051b1086d tempest-AttachVolumeNegativeTest-2108237366 None] Creating volume 2e56542a-b095-4684-a05f-07b4eb05aba0 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:41:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-dc1db0f4-9b46-48db-9740-3f3051b1086d tempest-AttachVolumeNegativeTest-2108237366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:41:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-dc1db0f4-9b46-48db-9740-3f3051b1086d tempest-AttachVolumeNegativeTest-2108237366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:41:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-dc1db0f4-9b46-48db-9740-3f3051b1086d tempest-AttachVolumeNegativeTest-2108237366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:41:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-dc1db0f4-9b46-48db-9740-3f3051b1086d tempest-AttachVolumeNegativeTest-2108237366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:41:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-dc1db0f4-9b46-48db-9740-3f3051b1086d tempest-AttachVolumeNegativeTest-2108237366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:41:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-dc1db0f4-9b46-48db-9740-3f3051b1086d tempest-AttachVolumeNegativeTest-2108237366 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:41:22 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-dc1db0f4-9b46-48db-9740-3f3051b1086d tempest-AttachVolumeNegativeTest-2108237366 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:41:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-dc1db0f4-9b46-48db-9740-3f3051b1086d tempest-AttachVolumeNegativeTest-2108237366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e56542a-b095-4684-a05f-07b4eb05aba0 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:22 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-491479a8-233f-4541-8b5d-5e7e0fd6c0d5 tempest-GroupsV314Test-1489721617 None] Create group from source-group-d710154a-15e4-4d5f-ab84-655042327c54 completed successfully. Aug 11 04:41:22 devstack sudo[99717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e56542a-b095-4684-a05f-07b4eb05aba0 1073741824 Aug 11 04:41:22 devstack sudo[99717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:22 devstack sudo[99717]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-dc1db0f4-9b46-48db-9740-3f3051b1086d tempest-AttachVolumeNegativeTest-2108237366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e56542a-b095-4684-a05f-07b4eb05aba0 1073741824" returned: 0 in 0.534s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-dc1db0f4-9b46-48db-9740-3f3051b1086d tempest-AttachVolumeNegativeTest-2108237366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e56542a-b095-4684-a05f-07b4eb05aba0 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:22 devstack sudo[99745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e56542a-b095-4684-a05f-07b4eb05aba0 Aug 11 04:41:22 devstack sudo[99745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:22 devstack sudo[99745]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-dc1db0f4-9b46-48db-9740-3f3051b1086d tempest-AttachVolumeNegativeTest-2108237366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e56542a-b095-4684-a05f-07b4eb05aba0" returned: 0 in 0.285s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-dc1db0f4-9b46-48db-9740-3f3051b1086d tempest-AttachVolumeNegativeTest-2108237366 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:41:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-dc1db0f4-9b46-48db-9740-3f3051b1086d tempest-AttachVolumeNegativeTest-2108237366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:41:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-dc1db0f4-9b46-48db-9740-3f3051b1086d tempest-AttachVolumeNegativeTest-2108237366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aa972e8-6ff0-4075-840b-a2c443d2f65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e56542a-b095-4684-a05f-07b4eb05aba0', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:41:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-dc1db0f4-9b46-48db-9740-3f3051b1086d tempest-AttachVolumeNegativeTest-2108237366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a275121b-781a-42a4-b70f-b88c0ea161e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:41:22 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-dc1db0f4-9b46-48db-9740-3f3051b1086d tempest-AttachVolumeNegativeTest-2108237366 None] Volume volume-2e56542a-b095-4684-a05f-07b4eb05aba0 (2e56542a-b095-4684-a05f-07b4eb05aba0): created successfully Aug 11 04:41:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-dc1db0f4-9b46-48db-9740-3f3051b1086d tempest-AttachVolumeNegativeTest-2108237366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a275121b-781a-42a4-b70f-b88c0ea161e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:41:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-dc1db0f4-9b46-48db-9740-3f3051b1086d tempest-AttachVolumeNegativeTest-2108237366 None] Flow 'volume_create_manager' (1b8a1ce1-ec92-4f49-b282-9eebba82ac48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:41:23 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-dc1db0f4-9b46-48db-9740-3f3051b1086d tempest-AttachVolumeNegativeTest-2108237366 None] Created volume successfully. Aug 11 04:41:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-952491bc-6a93-4a01-9baa-a5b9253f73fb tempest-GroupsV314Test-1489721617 None] Acquiring lock "cinder-quobyte-0805feb8-e380-4210-88bf-924faf9a8c01" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:41:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-952491bc-6a93-4a01-9baa-a5b9253f73fb tempest-GroupsV314Test-1489721617 None] Lock "cinder-quobyte-0805feb8-e380-4210-88bf-924faf9a8c01" acquired by "delete_volume" :: waited 0.018s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:41:23 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5653b2-7f2b-489c-8040-f4749831253d]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:41:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-952491bc-6a93-4a01-9baa-a5b9253f73fb tempest-GroupsV314Test-1489721617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-0805feb8-e380-4210-88bf-924faf9a8c01 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:23 devstack sudo[99748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-0805feb8-e380-4210-88bf-924faf9a8c01 Aug 11 04:41:23 devstack sudo[99748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:23 devstack sudo[99748]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-952491bc-6a93-4a01-9baa-a5b9253f73fb tempest-GroupsV314Test-1489721617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-0805feb8-e380-4210-88bf-924faf9a8c01" returned: 0 in 0.413s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-952491bc-6a93-4a01-9baa-a5b9253f73fb tempest-GroupsV314Test-1489721617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-0805feb8-e380-4210-88bf-924faf9a8c01 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:23 devstack sudo[99759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-0805feb8-e380-4210-88bf-924faf9a8c01 Aug 11 04:41:23 devstack sudo[99759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:23 devstack sudo[99759]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-952491bc-6a93-4a01-9baa-a5b9253f73fb tempest-GroupsV314Test-1489721617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-0805feb8-e380-4210-88bf-924faf9a8c01" returned: 0 in 0.255s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-952491bc-6a93-4a01-9baa-a5b9253f73fb tempest-GroupsV314Test-1489721617 None] Lock "cinder-quobyte-0805feb8-e380-4210-88bf-924faf9a8c01" released by "delete_volume" :: held 0.715s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:41:23 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-952491bc-6a93-4a01-9baa-a5b9253f73fb tempest-GroupsV314Test-1489721617 None] Created reservations ['8c84bf50-4bc7-4800-9964-5ddaf6168e3a'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:41:24 devstack cinder-volume[94472]: WARNING cinder.quota [None req-952491bc-6a93-4a01-9baa-a5b9253f73fb tempest-GroupsV314Test-1489721617 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-185250195 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-185250195, it is now deprecated. Please use the default quota class for default quota. Aug 11 04:41:24 devstack cinder-volume[94472]: WARNING cinder.quota [None req-952491bc-6a93-4a01-9baa-a5b9253f73fb tempest-GroupsV314Test-1489721617 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-185250195 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-185250195, it is now deprecated. Please use the default quota class for default quota. Aug 11 04:41:24 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-952491bc-6a93-4a01-9baa-a5b9253f73fb tempest-GroupsV314Test-1489721617 None] Created reservations ['80a6e865-05d9-4ada-82c1-f756c6f7e390', '7e8c07f4-7b9d-4ca1-a5aa-cb480c523222', 'f63dfce3-6b4a-4834-a316-3faa874a3574', '980a0fe4-997f-4e85-b6f2-bde13c4ca261'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:41:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-952491bc-6a93-4a01-9baa-a5b9253f73fb tempest-GroupsV314Test-1489721617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:41:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-952491bc-6a93-4a01-9baa-a5b9253f73fb tempest-GroupsV314Test-1489721617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:41:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-952491bc-6a93-4a01-9baa-a5b9253f73fb tempest-GroupsV314Test-1489721617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:41:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-952491bc-6a93-4a01-9baa-a5b9253f73fb tempest-GroupsV314Test-1489721617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:41:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-952491bc-6a93-4a01-9baa-a5b9253f73fb tempest-GroupsV314Test-1489721617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:41:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-952491bc-6a93-4a01-9baa-a5b9253f73fb tempest-GroupsV314Test-1489721617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:24 devstack sudo[99764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:41:24 devstack sudo[99764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:24 devstack sudo[99764]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-952491bc-6a93-4a01-9baa-a5b9253f73fb tempest-GroupsV314Test-1489721617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.252s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:24 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-952491bc-6a93-4a01-9baa-a5b9253f73fb tempest-GroupsV314Test-1489721617 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:41:24 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-952491bc-6a93-4a01-9baa-a5b9253f73fb tempest-GroupsV314Test-1489721617 None] Delete group completed successfully. Aug 11 04:41:24 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-3272c663-5d78-45a6-8cd8-ab97de2d83f1 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:41:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3272c663-5d78-45a6-8cd8-ab97de2d83f1 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Flow 'volume_create_manager' (5513c119-4440-4b7f-bdcb-db50e7b8f8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:41:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3272c663-5d78-45a6-8cd8-ab97de2d83f1 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8accfb12-2c4b-4b69-a256-652c05bdf7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:41:24 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-28012725-65da-42a6-ab8a-4ab97ebbecda tempest-GroupsV314Test-1489721617 None] Acquiring lock "cinder-quobyte-f9eeb458-893f-40ff-98af-81eaaac6880f" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:41:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3272c663-5d78-45a6-8cd8-ab97de2d83f1 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8accfb12-2c4b-4b69-a256-652c05bdf7e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-468069848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aba43251-5328-4d8b-8e41-c0cf3b691051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9cfbb8cffe940238d890c4c2a3bb0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:41:25Z,use_quota=True,user_id='befbba83b67f4a759ccef88549c50371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:41:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3272c663-5d78-45a6-8cd8-ab97de2d83f1 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f9a9ccc-faa1-4397-8e0d-4169bc11c863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:41:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3272c663-5d78-45a6-8cd8-ab97de2d83f1 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f9a9ccc-faa1-4397-8e0d-4169bc11c863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:41:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3272c663-5d78-45a6-8cd8-ab97de2d83f1 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (367ea9ce-26e5-45a4-bec8-dd9d521b993e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:41:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3272c663-5d78-45a6-8cd8-ab97de2d83f1 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (367ea9ce-26e5-45a4-bec8-dd9d521b993e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aba43251-5328-4d8b-8e41-c0cf3b691051', 'volume_name': 'volume-aba43251-5328-4d8b-8e41-c0cf3b691051', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:41:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3272c663-5d78-45a6-8cd8-ab97de2d83f1 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f223df69-7324-42e3-bf87-b814cc1f15a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:41:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3272c663-5d78-45a6-8cd8-ab97de2d83f1 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f223df69-7324-42e3-bf87-b814cc1f15a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:41:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3272c663-5d78-45a6-8cd8-ab97de2d83f1 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6027a604-1c52-4f6c-9f92-df5158571c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:41:24 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-3272c663-5d78-45a6-8cd8-ab97de2d83f1 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Volume aba43251-5328-4d8b-8e41-c0cf3b691051: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aba43251-5328-4d8b-8e41-c0cf3b691051', 'volume_size': 1} Aug 11 04:41:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3272c663-5d78-45a6-8cd8-ab97de2d83f1 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:41:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3272c663-5d78-45a6-8cd8-ab97de2d83f1 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:41:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3272c663-5d78-45a6-8cd8-ab97de2d83f1 tempest-VolumeQuotasAdminTestJSON-1296187800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-468069848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aba43251-5328-4d8b-8e41-c0cf3b691051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9cfbb8cffe940238d890c4c2a3bb0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:41:25Z,use_quota=True,user_id='befbba83b67f4a759ccef88549c50371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:41:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-3272c663-5d78-45a6-8cd8-ab97de2d83f1 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Creating volume aba43251-5328-4d8b-8e41-c0cf3b691051 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:41:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3272c663-5d78-45a6-8cd8-ab97de2d83f1 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:41:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3272c663-5d78-45a6-8cd8-ab97de2d83f1 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:41:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3272c663-5d78-45a6-8cd8-ab97de2d83f1 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:41:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3272c663-5d78-45a6-8cd8-ab97de2d83f1 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:41:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3272c663-5d78-45a6-8cd8-ab97de2d83f1 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:41:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3272c663-5d78-45a6-8cd8-ab97de2d83f1 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:41:24 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-3272c663-5d78-45a6-8cd8-ab97de2d83f1 tempest-VolumeQuotasAdminTestJSON-1296187800 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:41:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3272c663-5d78-45a6-8cd8-ab97de2d83f1 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-aba43251-5328-4d8b-8e41-c0cf3b691051 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:24 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-28012725-65da-42a6-ab8a-4ab97ebbecda tempest-GroupsV314Test-1489721617 None] Lock "cinder-quobyte-f9eeb458-893f-40ff-98af-81eaaac6880f" acquired by "delete_volume" :: waited 0.085s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:41:24 devstack sudo[99778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-aba43251-5328-4d8b-8e41-c0cf3b691051 1073741824 Aug 11 04:41:24 devstack sudo[99778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:25 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b3a010-535c-49c6-9296-ee02b123cdfd]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:41:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-28012725-65da-42a6-ab8a-4ab97ebbecda tempest-GroupsV314Test-1489721617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-f5e7f639-9b72-4da1-a449-0198034a3bec req-4c2d94e8-020a-408f-af3d-34ffcffc4157 tempest-AttachVolumeNegativeTest-2108237366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:41:25 devstack sudo[99780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f Aug 11 04:41:25 devstack sudo[99780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:25 devstack sudo[99778]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3272c663-5d78-45a6-8cd8-ab97de2d83f1 tempest-VolumeQuotasAdminTestJSON-1296187800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-aba43251-5328-4d8b-8e41-c0cf3b691051 1073741824" returned: 0 in 0.452s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:25 devstack sudo[99780]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-28012725-65da-42a6-ab8a-4ab97ebbecda tempest-GroupsV314Test-1489721617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f" returned: 0 in 0.397s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-28012725-65da-42a6-ab8a-4ab97ebbecda tempest-GroupsV314Test-1489721617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3272c663-5d78-45a6-8cd8-ab97de2d83f1 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-aba43251-5328-4d8b-8e41-c0cf3b691051 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:25 devstack sudo[99789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f Aug 11 04:41:25 devstack sudo[99789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:25 devstack sudo[99791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-aba43251-5328-4d8b-8e41-c0cf3b691051 Aug 11 04:41:25 devstack sudo[99791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:25 devstack sudo[99789]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-28012725-65da-42a6-ab8a-4ab97ebbecda tempest-GroupsV314Test-1489721617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f9eeb458-893f-40ff-98af-81eaaac6880f" returned: 0 in 0.247s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-28012725-65da-42a6-ab8a-4ab97ebbecda tempest-GroupsV314Test-1489721617 None] Lock "cinder-quobyte-f9eeb458-893f-40ff-98af-81eaaac6880f" released by "delete_volume" :: held 0.722s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:41:25 devstack sudo[99791]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3272c663-5d78-45a6-8cd8-ab97de2d83f1 tempest-VolumeQuotasAdminTestJSON-1296187800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-aba43251-5328-4d8b-8e41-c0cf3b691051" returned: 0 in 0.257s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:25 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3272c663-5d78-45a6-8cd8-ab97de2d83f1 tempest-VolumeQuotasAdminTestJSON-1296187800 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:41:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3272c663-5d78-45a6-8cd8-ab97de2d83f1 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:41:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-f5e7f639-9b72-4da1-a449-0198034a3bec req-4c2d94e8-020a-408f-af3d-34ffcffc4157 tempest-AttachVolumeNegativeTest-2108237366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.672s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:41:25 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3272c663-5d78-45a6-8cd8-ab97de2d83f1 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6027a604-1c52-4f6c-9f92-df5158571c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aba43251-5328-4d8b-8e41-c0cf3b691051', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:41:25 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3272c663-5d78-45a6-8cd8-ab97de2d83f1 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b65ae67-e577-4751-8944-7781aac1c460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:41:25 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-3272c663-5d78-45a6-8cd8-ab97de2d83f1 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Volume volume-aba43251-5328-4d8b-8e41-c0cf3b691051 (aba43251-5328-4d8b-8e41-c0cf3b691051): created successfully Aug 11 04:41:25 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3272c663-5d78-45a6-8cd8-ab97de2d83f1 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b65ae67-e577-4751-8944-7781aac1c460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:41:25 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3272c663-5d78-45a6-8cd8-ab97de2d83f1 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Flow 'volume_create_manager' (5513c119-4440-4b7f-bdcb-db50e7b8f8ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:41:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-f5e7f639-9b72-4da1-a449-0198034a3bec req-4c2d94e8-020a-408f-af3d-34ffcffc4157 tempest-AttachVolumeNegativeTest-2108237366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.109s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:41:25 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-3272c663-5d78-45a6-8cd8-ab97de2d83f1 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Created volume successfully. Aug 11 04:41:25 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-f5e7f639-9b72-4da1-a449-0198034a3bec req-4c2d94e8-020a-408f-af3d-34ffcffc4157 tempest-AttachVolumeNegativeTest-2108237366 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd', 'name': 'volume-2e56542a-b095-4684-a05f-07b4eb05aba0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '131f1667-1ad3-4837-958a-b25d770e864e', 'enforce_multipath': True} {{(pid=94472) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 11 04:41:25 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-28012725-65da-42a6-ab8a-4ab97ebbecda tempest-GroupsV314Test-1489721617 None] Created reservations ['7c4881a4-57d8-40fa-ab35-79ab03ad305e'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:41:25 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-28012725-65da-42a6-ab8a-4ab97ebbecda tempest-GroupsV314Test-1489721617 None] Created reservations ['cf008231-5d0a-4462-93ed-c05b9c8cf7a5', '90219059-2c48-476b-b03c-377fb86de2c2', '4c30216e-3470-4141-b928-da38d4fbbdec', '856d6d04-c357-49f2-983d-e0866100a879'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:41:25 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-f5e7f639-9b72-4da1-a449-0198034a3bec req-4c2d94e8-020a-408f-af3d-34ffcffc4157 tempest-AttachVolumeNegativeTest-2108237366 None] attachment_update completed successfully. Aug 11 04:41:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-28012725-65da-42a6-ab8a-4ab97ebbecda tempest-GroupsV314Test-1489721617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:41:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-28012725-65da-42a6-ab8a-4ab97ebbecda tempest-GroupsV314Test-1489721617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:41:26 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-28012725-65da-42a6-ab8a-4ab97ebbecda tempest-GroupsV314Test-1489721617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:41:26 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-28012725-65da-42a6-ab8a-4ab97ebbecda tempest-GroupsV314Test-1489721617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:41:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-28012725-65da-42a6-ab8a-4ab97ebbecda tempest-GroupsV314Test-1489721617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:41:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-28012725-65da-42a6-ab8a-4ab97ebbecda tempest-GroupsV314Test-1489721617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:26 devstack sudo[99797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:41:26 devstack sudo[99797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:26 devstack sudo[99797]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-28012725-65da-42a6-ab8a-4ab97ebbecda tempest-GroupsV314Test-1489721617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.283s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:26 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-28012725-65da-42a6-ab8a-4ab97ebbecda tempest-GroupsV314Test-1489721617 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:41:26 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-28012725-65da-42a6-ab8a-4ab97ebbecda tempest-GroupsV314Test-1489721617 None] Delete group completed successfully. Aug 11 04:41:27 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8a6abe3a-4b92-4409-852a-bd2419358b31 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Acquiring lock "cinder-aba43251-5328-4d8b-8e41-c0cf3b691051-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:41:27 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8a6abe3a-4b92-4409-852a-bd2419358b31 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Lock "cinder-aba43251-5328-4d8b-8e41-c0cf3b691051-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:41:27 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8a6abe3a-4b92-4409-852a-bd2419358b31 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Acquiring lock "cinder-quobyte-aba43251-5328-4d8b-8e41-c0cf3b691051" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:41:27 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8a6abe3a-4b92-4409-852a-bd2419358b31 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Lock "cinder-quobyte-aba43251-5328-4d8b-8e41-c0cf3b691051" acquired by "delete_volume" :: waited 0.014s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:41:27 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c45e82e-b908-490a-9b51-c056a18d1589]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:41:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8a6abe3a-4b92-4409-852a-bd2419358b31 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-aba43251-5328-4d8b-8e41-c0cf3b691051 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:27 devstack sudo[100184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-aba43251-5328-4d8b-8e41-c0cf3b691051 Aug 11 04:41:27 devstack sudo[100184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:27 devstack sudo[100184]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8a6abe3a-4b92-4409-852a-bd2419358b31 tempest-VolumeQuotasAdminTestJSON-1296187800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-aba43251-5328-4d8b-8e41-c0cf3b691051" returned: 0 in 0.382s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8a6abe3a-4b92-4409-852a-bd2419358b31 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-aba43251-5328-4d8b-8e41-c0cf3b691051 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:27 devstack sudo[100190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-aba43251-5328-4d8b-8e41-c0cf3b691051 Aug 11 04:41:27 devstack sudo[100190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:27 devstack sudo[100190]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8a6abe3a-4b92-4409-852a-bd2419358b31 tempest-VolumeQuotasAdminTestJSON-1296187800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-aba43251-5328-4d8b-8e41-c0cf3b691051" returned: 0 in 0.255s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:27 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8a6abe3a-4b92-4409-852a-bd2419358b31 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Lock "cinder-quobyte-aba43251-5328-4d8b-8e41-c0cf3b691051" released by "delete_volume" :: held 0.684s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:41:27 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=130,cinder:INSERT=32,cinder:UPDATE=129,cinder:DELETE=6 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:41:27 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-8a6abe3a-4b92-4409-852a-bd2419358b31 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Created reservations ['6e968526-faa4-48a0-8def-6b7fa74bee1f', '00286e87-516a-47c5-b7b1-f38b1db61939', '448ad29f-e785-499a-b9e6-d23bee8603aa', '68f769b5-aadb-4c36-8acc-cb900c6b539f'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:41:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8a6abe3a-4b92-4409-852a-bd2419358b31 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:41:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8a6abe3a-4b92-4409-852a-bd2419358b31 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:41:28 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-8a6abe3a-4b92-4409-852a-bd2419358b31 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:41:28 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-8a6abe3a-4b92-4409-852a-bd2419358b31 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:41:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8a6abe3a-4b92-4409-852a-bd2419358b31 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:41:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8a6abe3a-4b92-4409-852a-bd2419358b31 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:28 devstack sudo[100193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:41:28 devstack sudo[100193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:28 devstack sudo[100193]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8a6abe3a-4b92-4409-852a-bd2419358b31 tempest-VolumeQuotasAdminTestJSON-1296187800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.328s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:28 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-8a6abe3a-4b92-4409-852a-bd2419358b31 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:41:28 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-8a6abe3a-4b92-4409-852a-bd2419358b31 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Deleted volume successfully. Aug 11 04:41:28 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8a6abe3a-4b92-4409-852a-bd2419358b31 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Lock "cinder-aba43251-5328-4d8b-8e41-c0cf3b691051-delete_volume" released by "delete_volume" :: held 1.367s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:41:28 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-384473a0-2964-4488-bacb-c14a565472d6 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:41:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-384473a0-2964-4488-bacb-c14a565472d6 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Flow 'volume_create_manager' (f4719cc9-e8df-4300-a978-f097642da302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:41:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-384473a0-2964-4488-bacb-c14a565472d6 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9a4ec93-a0aa-441e-aaef-3d1cddc03180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:41:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-384473a0-2964-4488-bacb-c14a565472d6 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9a4ec93-a0aa-441e-aaef-3d1cddc03180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1481922170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb08b011-ace3-4f19-93aa-33953be25550,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9cfbb8cffe940238d890c4c2a3bb0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:41:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:41:29Z,use_quota=True,user_id='befbba83b67f4a759ccef88549c50371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:41:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-384473a0-2964-4488-bacb-c14a565472d6 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38a2971e-e7eb-4edf-a690-dd3245c3ea3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:41:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-384473a0-2964-4488-bacb-c14a565472d6 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38a2971e-e7eb-4edf-a690-dd3245c3ea3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:41:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-384473a0-2964-4488-bacb-c14a565472d6 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce7c1edf-c286-4fdf-946c-28428cd2e2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:41:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-384473a0-2964-4488-bacb-c14a565472d6 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce7c1edf-c286-4fdf-946c-28428cd2e2a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb08b011-ace3-4f19-93aa-33953be25550', 'volume_name': 'volume-cb08b011-ace3-4f19-93aa-33953be25550', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:41:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-384473a0-2964-4488-bacb-c14a565472d6 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e6ccfa8-8e91-4271-afad-6a7978685ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:41:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-384473a0-2964-4488-bacb-c14a565472d6 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e6ccfa8-8e91-4271-afad-6a7978685ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:41:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-384473a0-2964-4488-bacb-c14a565472d6 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12b17be3-6c48-487f-8bb0-3f82080b1885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:41:29 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-384473a0-2964-4488-bacb-c14a565472d6 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Volume cb08b011-ace3-4f19-93aa-33953be25550: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb08b011-ace3-4f19-93aa-33953be25550', 'volume_size': 1} Aug 11 04:41:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-384473a0-2964-4488-bacb-c14a565472d6 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:41:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-384473a0-2964-4488-bacb-c14a565472d6 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:41:29 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-384473a0-2964-4488-bacb-c14a565472d6 tempest-VolumeQuotasAdminTestJSON-1296187800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1481922170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb08b011-ace3-4f19-93aa-33953be25550,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9cfbb8cffe940238d890c4c2a3bb0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:41:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:41:29Z,use_quota=True,user_id='befbba83b67f4a759ccef88549c50371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:41:29 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-384473a0-2964-4488-bacb-c14a565472d6 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Creating volume cb08b011-ace3-4f19-93aa-33953be25550 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:41:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-384473a0-2964-4488-bacb-c14a565472d6 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:41:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-384473a0-2964-4488-bacb-c14a565472d6 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:41:29 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-384473a0-2964-4488-bacb-c14a565472d6 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:41:29 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-384473a0-2964-4488-bacb-c14a565472d6 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:41:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-384473a0-2964-4488-bacb-c14a565472d6 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:41:29 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-384473a0-2964-4488-bacb-c14a565472d6 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:41:29 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-384473a0-2964-4488-bacb-c14a565472d6 tempest-VolumeQuotasAdminTestJSON-1296187800 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:41:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-384473a0-2964-4488-bacb-c14a565472d6 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cb08b011-ace3-4f19-93aa-33953be25550 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:29 devstack sudo[100197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cb08b011-ace3-4f19-93aa-33953be25550 1073741824 Aug 11 04:41:29 devstack sudo[100197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:29 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-2c9f30fe-c823-47e4-a211-8ec5cfa7a054 req-eb37b491-cefd-4c6d-92f9-054c7952c640 tempest-AttachVolumeNegativeTest-2108237366 None] Terminate volume connection completed successfully. Aug 11 04:41:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-2c9f30fe-c823-47e4-a211-8ec5cfa7a054 req-eb37b491-cefd-4c6d-92f9-054c7952c640 tempest-AttachVolumeNegativeTest-2108237366 None] Deleting attachment 131f1667-1ad3-4837-958a-b25d770e864e. {{(pid=94472) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 11 04:41:29 devstack sudo[100197]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-384473a0-2964-4488-bacb-c14a565472d6 tempest-VolumeQuotasAdminTestJSON-1296187800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cb08b011-ace3-4f19-93aa-33953be25550 1073741824" returned: 0 in 0.674s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-384473a0-2964-4488-bacb-c14a565472d6 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cb08b011-ace3-4f19-93aa-33953be25550 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:29 devstack sudo[100233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cb08b011-ace3-4f19-93aa-33953be25550 Aug 11 04:41:29 devstack sudo[100233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:30 devstack sudo[100233]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-384473a0-2964-4488-bacb-c14a565472d6 tempest-VolumeQuotasAdminTestJSON-1296187800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cb08b011-ace3-4f19-93aa-33953be25550" returned: 0 in 0.330s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-384473a0-2964-4488-bacb-c14a565472d6 tempest-VolumeQuotasAdminTestJSON-1296187800 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:41:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-384473a0-2964-4488-bacb-c14a565472d6 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:41:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-384473a0-2964-4488-bacb-c14a565472d6 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12b17be3-6c48-487f-8bb0-3f82080b1885) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb08b011-ace3-4f19-93aa-33953be25550', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:41:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-384473a0-2964-4488-bacb-c14a565472d6 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18089572-478c-47d2-b1ca-0361e51f870d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:41:30 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-384473a0-2964-4488-bacb-c14a565472d6 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Volume volume-cb08b011-ace3-4f19-93aa-33953be25550 (cb08b011-ace3-4f19-93aa-33953be25550): created successfully Aug 11 04:41:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-384473a0-2964-4488-bacb-c14a565472d6 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18089572-478c-47d2-b1ca-0361e51f870d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:41:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-384473a0-2964-4488-bacb-c14a565472d6 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Flow 'volume_create_manager' (f4719cc9-e8df-4300-a978-f097642da302) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:41:30 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-384473a0-2964-4488-bacb-c14a565472d6 tempest-VolumeQuotasAdminTestJSON-1296187800 None] Created volume successfully. Aug 11 04:41:32 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-a4685dca-6c97-486f-98c1-417e65757540 tempest-VolumeQuotasAdminTestJSON-1066746077 None] Transfer volume completed successfully. Aug 11 04:41:32 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9e3700bd-bfb3-4026-891a-ceaf6d6eaf30 tempest-VolumeQuotasAdminTestJSON-122254602 None] Acquiring lock "cinder-cb08b011-ace3-4f19-93aa-33953be25550-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:41:32 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9e3700bd-bfb3-4026-891a-ceaf6d6eaf30 tempest-VolumeQuotasAdminTestJSON-122254602 None] Lock "cinder-cb08b011-ace3-4f19-93aa-33953be25550-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:41:32 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b0fdcad-3c9f-443a-9754-21d8d8b48789 tempest-SnapshotsActionsTest-2089057445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:41:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1b0fdcad-3c9f-443a-9754-21d8d8b48789 tempest-SnapshotsActionsTest-2089057445 None] Flow 'volume_create_manager' (6b2074f5-8bd5-4c16-bfdf-3d9235d63a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:41:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1b0fdcad-3c9f-443a-9754-21d8d8b48789 tempest-SnapshotsActionsTest-2089057445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77a5f8c8-690c-4ac2-8555-cc21462f1c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:41:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1b0fdcad-3c9f-443a-9754-21d8d8b48789 tempest-SnapshotsActionsTest-2089057445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77a5f8c8-690c-4ac2-8555-cc21462f1c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:41:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1730258760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b359c8b6-61e9-44af-a5a4-4ff6da4d6783,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5545b14a3c6e473aad095a6ed269c920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:41:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:41:33Z,use_quota=True,user_id='693e220ae5d2469485d547df2d7d1a01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:41:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1b0fdcad-3c9f-443a-9754-21d8d8b48789 tempest-SnapshotsActionsTest-2089057445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a546c9d4-944c-4adc-9a72-c47aed7c1faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:41:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1b0fdcad-3c9f-443a-9754-21d8d8b48789 tempest-SnapshotsActionsTest-2089057445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a546c9d4-944c-4adc-9a72-c47aed7c1faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:41:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1b0fdcad-3c9f-443a-9754-21d8d8b48789 tempest-SnapshotsActionsTest-2089057445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a9a718d-ef16-4fed-a8cb-733e647953da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:41:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1b0fdcad-3c9f-443a-9754-21d8d8b48789 tempest-SnapshotsActionsTest-2089057445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a9a718d-ef16-4fed-a8cb-733e647953da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b359c8b6-61e9-44af-a5a4-4ff6da4d6783', 'volume_name': 'volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:41:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1b0fdcad-3c9f-443a-9754-21d8d8b48789 tempest-SnapshotsActionsTest-2089057445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (762aba18-d8ed-4f11-a904-177fbff6a3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:41:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1b0fdcad-3c9f-443a-9754-21d8d8b48789 tempest-SnapshotsActionsTest-2089057445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (762aba18-d8ed-4f11-a904-177fbff6a3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:41:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1b0fdcad-3c9f-443a-9754-21d8d8b48789 tempest-SnapshotsActionsTest-2089057445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (203a8a0c-b69a-4114-b008-fe91001d8aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:41:32 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-1b0fdcad-3c9f-443a-9754-21d8d8b48789 tempest-SnapshotsActionsTest-2089057445 None] Volume b359c8b6-61e9-44af-a5a4-4ff6da4d6783: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783', 'volume_size': 1} Aug 11 04:41:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1b0fdcad-3c9f-443a-9754-21d8d8b48789 tempest-SnapshotsActionsTest-2089057445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:41:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1b0fdcad-3c9f-443a-9754-21d8d8b48789 tempest-SnapshotsActionsTest-2089057445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:41:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1b0fdcad-3c9f-443a-9754-21d8d8b48789 tempest-SnapshotsActionsTest-2089057445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:41:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1730258760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b359c8b6-61e9-44af-a5a4-4ff6da4d6783,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5545b14a3c6e473aad095a6ed269c920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:41:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:41:33Z,use_quota=True,user_id='693e220ae5d2469485d547df2d7d1a01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:41:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-1b0fdcad-3c9f-443a-9754-21d8d8b48789 tempest-SnapshotsActionsTest-2089057445 None] Creating volume b359c8b6-61e9-44af-a5a4-4ff6da4d6783 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:41:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1b0fdcad-3c9f-443a-9754-21d8d8b48789 tempest-SnapshotsActionsTest-2089057445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:41:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1b0fdcad-3c9f-443a-9754-21d8d8b48789 tempest-SnapshotsActionsTest-2089057445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:41:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1b0fdcad-3c9f-443a-9754-21d8d8b48789 tempest-SnapshotsActionsTest-2089057445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:41:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1b0fdcad-3c9f-443a-9754-21d8d8b48789 tempest-SnapshotsActionsTest-2089057445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:41:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1b0fdcad-3c9f-443a-9754-21d8d8b48789 tempest-SnapshotsActionsTest-2089057445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:41:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1b0fdcad-3c9f-443a-9754-21d8d8b48789 tempest-SnapshotsActionsTest-2089057445 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:41:32 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-1b0fdcad-3c9f-443a-9754-21d8d8b48789 tempest-SnapshotsActionsTest-2089057445 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:41:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1b0fdcad-3c9f-443a-9754-21d8d8b48789 tempest-SnapshotsActionsTest-2089057445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:32 devstack sudo[100266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783 1073741824 Aug 11 04:41:32 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9e3700bd-bfb3-4026-891a-ceaf6d6eaf30 tempest-VolumeQuotasAdminTestJSON-122254602 None] Acquiring lock "cinder-quobyte-cb08b011-ace3-4f19-93aa-33953be25550" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:41:32 devstack sudo[100266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:32 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9e3700bd-bfb3-4026-891a-ceaf6d6eaf30 tempest-VolumeQuotasAdminTestJSON-122254602 None] Lock "cinder-quobyte-cb08b011-ace3-4f19-93aa-33953be25550" acquired by "delete_volume" :: waited 0.028s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:41:32 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec03bcb-cfe0-44e9-bb6d-13412aee8cf0]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:41:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9e3700bd-bfb3-4026-891a-ceaf6d6eaf30 tempest-VolumeQuotasAdminTestJSON-122254602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cb08b011-ace3-4f19-93aa-33953be25550 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:33 devstack sudo[100268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cb08b011-ace3-4f19-93aa-33953be25550 Aug 11 04:41:33 devstack sudo[100268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:33 devstack sudo[100268]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9e3700bd-bfb3-4026-891a-ceaf6d6eaf30 tempest-VolumeQuotasAdminTestJSON-122254602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cb08b011-ace3-4f19-93aa-33953be25550" returned: 0 in 0.428s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9e3700bd-bfb3-4026-891a-ceaf6d6eaf30 tempest-VolumeQuotasAdminTestJSON-122254602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cb08b011-ace3-4f19-93aa-33953be25550 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:33 devstack sudo[100266]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1b0fdcad-3c9f-443a-9754-21d8d8b48789 tempest-SnapshotsActionsTest-2089057445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783 1073741824" returned: 0 in 0.540s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:33 devstack sudo[100280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cb08b011-ace3-4f19-93aa-33953be25550 Aug 11 04:41:33 devstack sudo[100280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1b0fdcad-3c9f-443a-9754-21d8d8b48789 tempest-SnapshotsActionsTest-2089057445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:33 devstack sudo[100282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783 Aug 11 04:41:33 devstack sudo[100282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:33 devstack sudo[100280]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9e3700bd-bfb3-4026-891a-ceaf6d6eaf30 tempest-VolumeQuotasAdminTestJSON-122254602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cb08b011-ace3-4f19-93aa-33953be25550" returned: 0 in 0.263s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9e3700bd-bfb3-4026-891a-ceaf6d6eaf30 tempest-VolumeQuotasAdminTestJSON-122254602 None] Lock "cinder-quobyte-cb08b011-ace3-4f19-93aa-33953be25550" released by "delete_volume" :: held 0.761s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:41:33 devstack sudo[100282]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1b0fdcad-3c9f-443a-9754-21d8d8b48789 tempest-SnapshotsActionsTest-2089057445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783" returned: 0 in 0.274s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:33 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1b0fdcad-3c9f-443a-9754-21d8d8b48789 tempest-SnapshotsActionsTest-2089057445 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:41:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1b0fdcad-3c9f-443a-9754-21d8d8b48789 tempest-SnapshotsActionsTest-2089057445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:41:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1b0fdcad-3c9f-443a-9754-21d8d8b48789 tempest-SnapshotsActionsTest-2089057445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (203a8a0c-b69a-4114-b008-fe91001d8aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:41:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1b0fdcad-3c9f-443a-9754-21d8d8b48789 tempest-SnapshotsActionsTest-2089057445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (243dc4b5-bf02-4d03-a960-a5a001af847b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:41:33 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-9e3700bd-bfb3-4026-891a-ceaf6d6eaf30 tempest-VolumeQuotasAdminTestJSON-122254602 None] Created reservations ['76646c4a-3fc5-4ea3-b320-076e729cd3f3', 'd3d964bf-2691-4709-8d52-5e09305053f4', '2918f602-51d4-431b-8fe5-b11185ca73b4', 'f47f3bd8-ba4f-4f73-a199-e3eb688231b7'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:41:33 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-1b0fdcad-3c9f-443a-9754-21d8d8b48789 tempest-SnapshotsActionsTest-2089057445 None] Volume volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783 (b359c8b6-61e9-44af-a5a4-4ff6da4d6783): created successfully Aug 11 04:41:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1b0fdcad-3c9f-443a-9754-21d8d8b48789 tempest-SnapshotsActionsTest-2089057445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (243dc4b5-bf02-4d03-a960-a5a001af847b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:41:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1b0fdcad-3c9f-443a-9754-21d8d8b48789 tempest-SnapshotsActionsTest-2089057445 None] Flow 'volume_create_manager' (6b2074f5-8bd5-4c16-bfdf-3d9235d63a20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:41:33 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-1b0fdcad-3c9f-443a-9754-21d8d8b48789 tempest-SnapshotsActionsTest-2089057445 None] Created volume successfully. Aug 11 04:41:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9e3700bd-bfb3-4026-891a-ceaf6d6eaf30 tempest-VolumeQuotasAdminTestJSON-122254602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:41:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9e3700bd-bfb3-4026-891a-ceaf6d6eaf30 tempest-VolumeQuotasAdminTestJSON-122254602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:41:33 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9e3700bd-bfb3-4026-891a-ceaf6d6eaf30 tempest-VolumeQuotasAdminTestJSON-122254602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:41:33 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9e3700bd-bfb3-4026-891a-ceaf6d6eaf30 tempest-VolumeQuotasAdminTestJSON-122254602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:41:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9e3700bd-bfb3-4026-891a-ceaf6d6eaf30 tempest-VolumeQuotasAdminTestJSON-122254602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:41:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9e3700bd-bfb3-4026-891a-ceaf6d6eaf30 tempest-VolumeQuotasAdminTestJSON-122254602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:33 devstack sudo[100286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:41:33 devstack sudo[100286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:34 devstack sudo[100286]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9e3700bd-bfb3-4026-891a-ceaf6d6eaf30 tempest-VolumeQuotasAdminTestJSON-122254602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.316s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:34 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-9e3700bd-bfb3-4026-891a-ceaf6d6eaf30 tempest-VolumeQuotasAdminTestJSON-122254602 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:41:34 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-9e3700bd-bfb3-4026-891a-ceaf6d6eaf30 tempest-VolumeQuotasAdminTestJSON-122254602 None] Deleted volume successfully. Aug 11 04:41:34 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9e3700bd-bfb3-4026-891a-ceaf6d6eaf30 tempest-VolumeQuotasAdminTestJSON-122254602 None] Lock "cinder-cb08b011-ace3-4f19-93aa-33953be25550-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:41:34 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c8d23c1-3085-4a7d-a815-86faf87e4f36 tempest-ServerActionsTestOtherA-1583977559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:41:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8c8d23c1-3085-4a7d-a815-86faf87e4f36 tempest-ServerActionsTestOtherA-1583977559 None] Flow 'volume_create_manager' (75b503b3-3962-4824-b75d-0923478cf5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:41:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8c8d23c1-3085-4a7d-a815-86faf87e4f36 tempest-ServerActionsTestOtherA-1583977559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec3753ca-67aa-4542-bb26-6228f4c898db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:41:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8c8d23c1-3085-4a7d-a815-86faf87e4f36 tempest-ServerActionsTestOtherA-1583977559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec3753ca-67aa-4542-bb26-6228f4c898db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:41:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-201462283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=499eda1c-589a-4063-9f23-453e0c821c80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55dd6075a81141dcab2ad4ffbcd544ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:41:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:41:34Z,use_quota=True,user_id='418876d7fa8c46edb8fd9fac7b14ce95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:41:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8c8d23c1-3085-4a7d-a815-86faf87e4f36 tempest-ServerActionsTestOtherA-1583977559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56fe1ce0-eb62-4883-a87e-dc6339ea7c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:41:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8c8d23c1-3085-4a7d-a815-86faf87e4f36 tempest-ServerActionsTestOtherA-1583977559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56fe1ce0-eb62-4883-a87e-dc6339ea7c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:41:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8c8d23c1-3085-4a7d-a815-86faf87e4f36 tempest-ServerActionsTestOtherA-1583977559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d1469b6-c8a8-4b29-9056-77fe5be5cd52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:41:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8c8d23c1-3085-4a7d-a815-86faf87e4f36 tempest-ServerActionsTestOtherA-1583977559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d1469b6-c8a8-4b29-9056-77fe5be5cd52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '499eda1c-589a-4063-9f23-453e0c821c80', 'volume_name': 'volume-499eda1c-589a-4063-9f23-453e0c821c80', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:41:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8c8d23c1-3085-4a7d-a815-86faf87e4f36 tempest-ServerActionsTestOtherA-1583977559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40c06168-161e-4e02-86ef-48ee61e68132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:41:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8c8d23c1-3085-4a7d-a815-86faf87e4f36 tempest-ServerActionsTestOtherA-1583977559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40c06168-161e-4e02-86ef-48ee61e68132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:41:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8c8d23c1-3085-4a7d-a815-86faf87e4f36 tempest-ServerActionsTestOtherA-1583977559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a43717b-8b0f-434d-8200-4d907e2ac0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:41:34 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-8c8d23c1-3085-4a7d-a815-86faf87e4f36 tempest-ServerActionsTestOtherA-1583977559 None] Volume 499eda1c-589a-4063-9f23-453e0c821c80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-499eda1c-589a-4063-9f23-453e0c821c80', 'volume_size': 1} Aug 11 04:41:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8c8d23c1-3085-4a7d-a815-86faf87e4f36 tempest-ServerActionsTestOtherA-1583977559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:41:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8c8d23c1-3085-4a7d-a815-86faf87e4f36 tempest-ServerActionsTestOtherA-1583977559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:41:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-8c8d23c1-3085-4a7d-a815-86faf87e4f36 tempest-ServerActionsTestOtherA-1583977559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:41:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-201462283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=499eda1c-589a-4063-9f23-453e0c821c80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55dd6075a81141dcab2ad4ffbcd544ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:41:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:41:34Z,use_quota=True,user_id='418876d7fa8c46edb8fd9fac7b14ce95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:41:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-8c8d23c1-3085-4a7d-a815-86faf87e4f36 tempest-ServerActionsTestOtherA-1583977559 None] Creating volume 499eda1c-589a-4063-9f23-453e0c821c80 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:41:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8c8d23c1-3085-4a7d-a815-86faf87e4f36 tempest-ServerActionsTestOtherA-1583977559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:41:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8c8d23c1-3085-4a7d-a815-86faf87e4f36 tempest-ServerActionsTestOtherA-1583977559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:41:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-8c8d23c1-3085-4a7d-a815-86faf87e4f36 tempest-ServerActionsTestOtherA-1583977559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:41:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-8c8d23c1-3085-4a7d-a815-86faf87e4f36 tempest-ServerActionsTestOtherA-1583977559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:41:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8c8d23c1-3085-4a7d-a815-86faf87e4f36 tempest-ServerActionsTestOtherA-1583977559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:41:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-8c8d23c1-3085-4a7d-a815-86faf87e4f36 tempest-ServerActionsTestOtherA-1583977559 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:41:34 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-8c8d23c1-3085-4a7d-a815-86faf87e4f36 tempest-ServerActionsTestOtherA-1583977559 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:41:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8c8d23c1-3085-4a7d-a815-86faf87e4f36 tempest-ServerActionsTestOtherA-1583977559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-499eda1c-589a-4063-9f23-453e0c821c80 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:34 devstack sudo[100289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-499eda1c-589a-4063-9f23-453e0c821c80 1073741824 Aug 11 04:41:34 devstack sudo[100289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-15b3757c-a0f2-4479-8a35-3c1022340b30 tempest-SnapshotsActionsTest-2089057445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:41:35 devstack sudo[100289]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8c8d23c1-3085-4a7d-a815-86faf87e4f36 tempest-ServerActionsTestOtherA-1583977559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-499eda1c-589a-4063-9f23-453e0c821c80 1073741824" returned: 0 in 0.695s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8c8d23c1-3085-4a7d-a815-86faf87e4f36 tempest-ServerActionsTestOtherA-1583977559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-499eda1c-589a-4063-9f23-453e0c821c80 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:35 devstack sudo[100296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-499eda1c-589a-4063-9f23-453e0c821c80 Aug 11 04:41:35 devstack sudo[100296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:35 devstack sudo[100296]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:35 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4672c42c-f442-4d1e-9290-745336ef1734 tempest-AttachVolumeNegativeTest-2108237366 None] Acquiring lock "cinder-2e56542a-b095-4684-a05f-07b4eb05aba0-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:41:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8c8d23c1-3085-4a7d-a815-86faf87e4f36 tempest-ServerActionsTestOtherA-1583977559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-499eda1c-589a-4063-9f23-453e0c821c80" returned: 0 in 0.342s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:35 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-8c8d23c1-3085-4a7d-a815-86faf87e4f36 tempest-ServerActionsTestOtherA-1583977559 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:41:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8c8d23c1-3085-4a7d-a815-86faf87e4f36 tempest-ServerActionsTestOtherA-1583977559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:41:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-15b3757c-a0f2-4479-8a35-3c1022340b30 tempest-SnapshotsActionsTest-2089057445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.451s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:41:35 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4672c42c-f442-4d1e-9290-745336ef1734 tempest-AttachVolumeNegativeTest-2108237366 None] Lock "cinder-2e56542a-b095-4684-a05f-07b4eb05aba0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:41:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8c8d23c1-3085-4a7d-a815-86faf87e4f36 tempest-ServerActionsTestOtherA-1583977559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a43717b-8b0f-434d-8200-4d907e2ac0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-499eda1c-589a-4063-9f23-453e0c821c80', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:41:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8c8d23c1-3085-4a7d-a815-86faf87e4f36 tempest-ServerActionsTestOtherA-1583977559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad7c74ce-a40a-40ce-a0fd-82fac074a25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:41:35 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-15b3757c-a0f2-4479-8a35-3c1022340b30 tempest-SnapshotsActionsTest-2089057445 None] Creating offline snapshot 80fe623f-7dce-40fb-999e-3a5a6a74ee8b of volume b359c8b6-61e9-44af-a5a4-4ff6da4d6783 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 04:41:35 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-8c8d23c1-3085-4a7d-a815-86faf87e4f36 tempest-ServerActionsTestOtherA-1583977559 None] Volume volume-499eda1c-589a-4063-9f23-453e0c821c80 (499eda1c-589a-4063-9f23-453e0c821c80): created successfully Aug 11 04:41:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8c8d23c1-3085-4a7d-a815-86faf87e4f36 tempest-ServerActionsTestOtherA-1583977559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad7c74ce-a40a-40ce-a0fd-82fac074a25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:41:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8c8d23c1-3085-4a7d-a815-86faf87e4f36 tempest-ServerActionsTestOtherA-1583977559 None] Flow 'volume_create_manager' (75b503b3-3962-4824-b75d-0923478cf5ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:41:35 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[da04f1c3-177e-4079-8253-95ff2e59a023]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:41:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-15b3757c-a0f2-4479-8a35-3c1022340b30 tempest-SnapshotsActionsTest-2089057445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:35 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-8c8d23c1-3085-4a7d-a815-86faf87e4f36 tempest-ServerActionsTestOtherA-1583977559 None] Created volume successfully. Aug 11 04:41:35 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4672c42c-f442-4d1e-9290-745336ef1734 tempest-AttachVolumeNegativeTest-2108237366 None] Acquiring lock "cinder-quobyte-2e56542a-b095-4684-a05f-07b4eb05aba0" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:41:35 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4672c42c-f442-4d1e-9290-745336ef1734 tempest-AttachVolumeNegativeTest-2108237366 None] Lock "cinder-quobyte-2e56542a-b095-4684-a05f-07b4eb05aba0" acquired by "delete_volume" :: waited 0.024s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:41:35 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c943ba-33ef-4773-b704-0ede8d55b1b3]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:41:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4672c42c-f442-4d1e-9290-745336ef1734 tempest-AttachVolumeNegativeTest-2108237366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e56542a-b095-4684-a05f-07b4eb05aba0 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:35 devstack sudo[100299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783 Aug 11 04:41:35 devstack sudo[100299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:35 devstack sudo[100300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e56542a-b095-4684-a05f-07b4eb05aba0 Aug 11 04:41:35 devstack sudo[100300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:36 devstack sudo[100299]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-15b3757c-a0f2-4479-8a35-3c1022340b30 tempest-SnapshotsActionsTest-2089057445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783" returned: 0 in 0.496s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-15b3757c-a0f2-4479-8a35-3c1022340b30 tempest-SnapshotsActionsTest-2089057445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:36 devstack sudo[100308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b 1G Aug 11 04:41:36 devstack sudo[100308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:36 devstack sudo[100300]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4672c42c-f442-4d1e-9290-745336ef1734 tempest-AttachVolumeNegativeTest-2108237366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e56542a-b095-4684-a05f-07b4eb05aba0" returned: 0 in 0.458s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4672c42c-f442-4d1e-9290-745336ef1734 tempest-AttachVolumeNegativeTest-2108237366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e56542a-b095-4684-a05f-07b4eb05aba0 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:36 devstack sudo[100312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e56542a-b095-4684-a05f-07b4eb05aba0 Aug 11 04:41:36 devstack sudo[100312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:36 devstack sudo[100312]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4672c42c-f442-4d1e-9290-745336ef1734 tempest-AttachVolumeNegativeTest-2108237366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e56542a-b095-4684-a05f-07b4eb05aba0" returned: 0 in 0.283s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:36 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4672c42c-f442-4d1e-9290-745336ef1734 tempest-AttachVolumeNegativeTest-2108237366 None] Lock "cinder-quobyte-2e56542a-b095-4684-a05f-07b4eb05aba0" released by "delete_volume" :: held 0.791s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:41:36 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-4672c42c-f442-4d1e-9290-745336ef1734 tempest-AttachVolumeNegativeTest-2108237366 None] Created reservations ['b4f0b964-5d56-4478-bdc7-71e5a5752254', '18b2309c-c323-47bc-b0d4-696ea43deda5', '363ee875-f409-44dd-9068-6e0a76411358', '8cbb78de-8a8f-444c-b9a7-6f9983e6ce85'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:41:36 devstack sudo[100308]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-15b3757c-a0f2-4479-8a35-3c1022340b30 tempest-SnapshotsActionsTest-2089057445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b 1G" returned: 0 in 0.514s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-15b3757c-a0f2-4479-8a35-3c1022340b30 tempest-SnapshotsActionsTest-2089057445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:36 devstack sudo[100319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b Aug 11 04:41:36 devstack sudo[100319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4672c42c-f442-4d1e-9290-745336ef1734 tempest-AttachVolumeNegativeTest-2108237366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:41:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4672c42c-f442-4d1e-9290-745336ef1734 tempest-AttachVolumeNegativeTest-2108237366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:41:36 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4672c42c-f442-4d1e-9290-745336ef1734 tempest-AttachVolumeNegativeTest-2108237366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:41:36 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4672c42c-f442-4d1e-9290-745336ef1734 tempest-AttachVolumeNegativeTest-2108237366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:41:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4672c42c-f442-4d1e-9290-745336ef1734 tempest-AttachVolumeNegativeTest-2108237366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:41:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4672c42c-f442-4d1e-9290-745336ef1734 tempest-AttachVolumeNegativeTest-2108237366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:36 devstack sudo[100321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:41:36 devstack sudo[100321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-82b5dd5d-7e04-4eec-b808-45970fa95e9f tempest-AttachVolumeNegativeTest-2108237366 None] Acquiring lock "cinder-8fdca1b9-116f-4bbd-a91a-5f6585815449-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:41:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-82b5dd5d-7e04-4eec-b808-45970fa95e9f tempest-AttachVolumeNegativeTest-2108237366 None] Lock "cinder-8fdca1b9-116f-4bbd-a91a-5f6585815449-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:41:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-82b5dd5d-7e04-4eec-b808-45970fa95e9f tempest-AttachVolumeNegativeTest-2108237366 None] Acquiring lock "cinder-quobyte-8fdca1b9-116f-4bbd-a91a-5f6585815449" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:41:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-82b5dd5d-7e04-4eec-b808-45970fa95e9f tempest-AttachVolumeNegativeTest-2108237366 None] Lock "cinder-quobyte-8fdca1b9-116f-4bbd-a91a-5f6585815449" acquired by "delete_volume" :: waited 0.025s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:41:37 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[5438e401-d5f8-4229-bf35-b8b9fe608fc3]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:41:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-82b5dd5d-7e04-4eec-b808-45970fa95e9f tempest-AttachVolumeNegativeTest-2108237366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8fdca1b9-116f-4bbd-a91a-5f6585815449 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:37 devstack sudo[100319]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-15b3757c-a0f2-4479-8a35-3c1022340b30 tempest-SnapshotsActionsTest-2089057445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b" returned: 0 in 0.532s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:37 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-15b3757c-a0f2-4479-8a35-3c1022340b30 tempest-SnapshotsActionsTest-2089057445 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b is being set with open permissions: ugo+rw Aug 11 04:41:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-15b3757c-a0f2-4479-8a35-3c1022340b30 tempest-SnapshotsActionsTest-2089057445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:37 devstack sudo[100321]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4672c42c-f442-4d1e-9290-745336ef1734 tempest-AttachVolumeNegativeTest-2108237366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.487s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:37 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-4672c42c-f442-4d1e-9290-745336ef1734 tempest-AttachVolumeNegativeTest-2108237366 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:41:37 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-4672c42c-f442-4d1e-9290-745336ef1734 tempest-AttachVolumeNegativeTest-2108237366 None] Deleted volume successfully. Aug 11 04:41:37 devstack sudo[100328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b Aug 11 04:41:37 devstack sudo[100328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4672c42c-f442-4d1e-9290-745336ef1734 tempest-AttachVolumeNegativeTest-2108237366 None] Lock "cinder-2e56542a-b095-4684-a05f-07b4eb05aba0-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:41:37 devstack sudo[100327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8fdca1b9-116f-4bbd-a91a-5f6585815449 Aug 11 04:41:37 devstack sudo[100327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:37 devstack sudo[100328]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-15b3757c-a0f2-4479-8a35-3c1022340b30 tempest-SnapshotsActionsTest-2089057445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b" returned: 0 in 0.368s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-15b3757c-a0f2-4479-8a35-3c1022340b30 tempest-SnapshotsActionsTest-2089057445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:37 devstack sudo[100335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.info Aug 11 04:41:37 devstack sudo[100335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:37 devstack sudo[100327]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-82b5dd5d-7e04-4eec-b808-45970fa95e9f tempest-AttachVolumeNegativeTest-2108237366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8fdca1b9-116f-4bbd-a91a-5f6585815449" returned: 0 in 0.518s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-82b5dd5d-7e04-4eec-b808-45970fa95e9f tempest-AttachVolumeNegativeTest-2108237366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8fdca1b9-116f-4bbd-a91a-5f6585815449 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:37 devstack sudo[100337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8fdca1b9-116f-4bbd-a91a-5f6585815449 Aug 11 04:41:37 devstack sudo[100337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:38 devstack sudo[100335]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-15b3757c-a0f2-4479-8a35-3c1022340b30 tempest-SnapshotsActionsTest-2089057445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.info" returned: 0 in 0.345s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:38 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-15b3757c-a0f2-4479-8a35-3c1022340b30 tempest-SnapshotsActionsTest-2089057445 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.info is being set with open permissions: ugo+rw Aug 11 04:41:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-15b3757c-a0f2-4479-8a35-3c1022340b30 tempest-SnapshotsActionsTest-2089057445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:38 devstack sudo[100337]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-82b5dd5d-7e04-4eec-b808-45970fa95e9f tempest-AttachVolumeNegativeTest-2108237366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8fdca1b9-116f-4bbd-a91a-5f6585815449" returned: 0 in 0.323s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:38 devstack sudo[100341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.info Aug 11 04:41:38 devstack sudo[100341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:38 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-82b5dd5d-7e04-4eec-b808-45970fa95e9f tempest-AttachVolumeNegativeTest-2108237366 None] Lock "cinder-quobyte-8fdca1b9-116f-4bbd-a91a-5f6585815449" released by "delete_volume" :: held 0.914s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:41:38 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-82b5dd5d-7e04-4eec-b808-45970fa95e9f tempest-AttachVolumeNegativeTest-2108237366 None] Created reservations ['01ccd208-9128-48fb-8948-c9556fb85f19', 'b97853c1-15c9-45d3-8d23-0990d2254efe', 'fcc7c409-07b8-4d2a-936a-deff95b909fa', '0d998d1c-29c4-466d-b464-c32d50bbbbdc'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:41:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-82b5dd5d-7e04-4eec-b808-45970fa95e9f tempest-AttachVolumeNegativeTest-2108237366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:41:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-82b5dd5d-7e04-4eec-b808-45970fa95e9f tempest-AttachVolumeNegativeTest-2108237366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:41:38 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-82b5dd5d-7e04-4eec-b808-45970fa95e9f tempest-AttachVolumeNegativeTest-2108237366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:41:38 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-82b5dd5d-7e04-4eec-b808-45970fa95e9f tempest-AttachVolumeNegativeTest-2108237366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:41:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-82b5dd5d-7e04-4eec-b808-45970fa95e9f tempest-AttachVolumeNegativeTest-2108237366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:41:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-82b5dd5d-7e04-4eec-b808-45970fa95e9f tempest-AttachVolumeNegativeTest-2108237366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:38 devstack sudo[100343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:41:38 devstack sudo[100343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:38 devstack sudo[100341]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-15b3757c-a0f2-4479-8a35-3c1022340b30 tempest-SnapshotsActionsTest-2089057445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.info" returned: 0 in 0.373s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-15b3757c-a0f2-4479-8a35-3c1022340b30 tempest-SnapshotsActionsTest-2089057445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.802s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:41:38 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-15b3757c-a0f2-4479-8a35-3c1022340b30 tempest-SnapshotsActionsTest-2089057445 None] Create snapshot completed successfully Aug 11 04:41:38 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c3a622e8-cbe3-4145-9e3d-aae72053ef13 tempest-AttachVolumeNegativeTest-2108237366 None] Acquiring lock "cinder-122fe640-a055-4401-9709-e8a311fefff1-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:41:38 devstack sudo[100343]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-82b5dd5d-7e04-4eec-b808-45970fa95e9f tempest-AttachVolumeNegativeTest-2108237366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.414s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:38 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-82b5dd5d-7e04-4eec-b808-45970fa95e9f tempest-AttachVolumeNegativeTest-2108237366 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:41:38 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-82b5dd5d-7e04-4eec-b808-45970fa95e9f tempest-AttachVolumeNegativeTest-2108237366 None] Deleted volume successfully. Aug 11 04:41:38 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c3a622e8-cbe3-4145-9e3d-aae72053ef13 tempest-AttachVolumeNegativeTest-2108237366 None] Lock "cinder-122fe640-a055-4401-9709-e8a311fefff1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:41:38 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-82b5dd5d-7e04-4eec-b808-45970fa95e9f tempest-AttachVolumeNegativeTest-2108237366 None] Lock "cinder-8fdca1b9-116f-4bbd-a91a-5f6585815449-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:41:38 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c3a622e8-cbe3-4145-9e3d-aae72053ef13 tempest-AttachVolumeNegativeTest-2108237366 None] Acquiring lock "cinder-quobyte-122fe640-a055-4401-9709-e8a311fefff1" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:41:38 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c3a622e8-cbe3-4145-9e3d-aae72053ef13 tempest-AttachVolumeNegativeTest-2108237366 None] Lock "cinder-quobyte-122fe640-a055-4401-9709-e8a311fefff1" acquired by "delete_volume" :: waited 0.018s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:41:38 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef609f61-518c-4624-ad92-2a6b13a083eb]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:41:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c3a622e8-cbe3-4145-9e3d-aae72053ef13 tempest-AttachVolumeNegativeTest-2108237366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-122fe640-a055-4401-9709-e8a311fefff1 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:38 devstack sudo[100350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-122fe640-a055-4401-9709-e8a311fefff1 Aug 11 04:41:38 devstack sudo[100350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:39 devstack sudo[100350]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c3a622e8-cbe3-4145-9e3d-aae72053ef13 tempest-AttachVolumeNegativeTest-2108237366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-122fe640-a055-4401-9709-e8a311fefff1" returned: 0 in 0.449s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c3a622e8-cbe3-4145-9e3d-aae72053ef13 tempest-AttachVolumeNegativeTest-2108237366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-122fe640-a055-4401-9709-e8a311fefff1 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:39 devstack sudo[100356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-122fe640-a055-4401-9709-e8a311fefff1 Aug 11 04:41:39 devstack sudo[100356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:39 devstack sudo[100356]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c3a622e8-cbe3-4145-9e3d-aae72053ef13 tempest-AttachVolumeNegativeTest-2108237366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-122fe640-a055-4401-9709-e8a311fefff1" returned: 0 in 0.335s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c3a622e8-cbe3-4145-9e3d-aae72053ef13 tempest-AttachVolumeNegativeTest-2108237366 None] Lock "cinder-quobyte-122fe640-a055-4401-9709-e8a311fefff1" released by "delete_volume" :: held 0.851s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:41:39 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-c3a622e8-cbe3-4145-9e3d-aae72053ef13 tempest-AttachVolumeNegativeTest-2108237366 None] Created reservations ['2a5ebb91-756c-4549-a3bb-ae3c52b2ffa0', '76420f05-2661-4b2e-a3c5-708cced0c804', 'f0516481-4773-4a32-9a2b-740ceeecab1d', '3451511c-dbfe-4c56-bda9-77eb32819d6c'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:41:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c3a622e8-cbe3-4145-9e3d-aae72053ef13 tempest-AttachVolumeNegativeTest-2108237366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:41:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c3a622e8-cbe3-4145-9e3d-aae72053ef13 tempest-AttachVolumeNegativeTest-2108237366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:41:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c3a622e8-cbe3-4145-9e3d-aae72053ef13 tempest-AttachVolumeNegativeTest-2108237366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:41:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c3a622e8-cbe3-4145-9e3d-aae72053ef13 tempest-AttachVolumeNegativeTest-2108237366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:41:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c3a622e8-cbe3-4145-9e3d-aae72053ef13 tempest-AttachVolumeNegativeTest-2108237366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:41:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c3a622e8-cbe3-4145-9e3d-aae72053ef13 tempest-AttachVolumeNegativeTest-2108237366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:39 devstack sudo[100361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:41:39 devstack sudo[100361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:40 devstack sudo[100361]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c3a622e8-cbe3-4145-9e3d-aae72053ef13 tempest-AttachVolumeNegativeTest-2108237366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.364s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:40 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-c3a622e8-cbe3-4145-9e3d-aae72053ef13 tempest-AttachVolumeNegativeTest-2108237366 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:41:40 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-c3a622e8-cbe3-4145-9e3d-aae72053ef13 tempest-AttachVolumeNegativeTest-2108237366 None] Deleted volume successfully. Aug 11 04:41:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c3a622e8-cbe3-4145-9e3d-aae72053ef13 tempest-AttachVolumeNegativeTest-2108237366 None] Lock "cinder-122fe640-a055-4401-9709-e8a311fefff1-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:41:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4ced2d04-6608-411f-8f27-dc340c9a92e2 tempest-SnapshotsActionsTest-2089057445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:41:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4ced2d04-6608-411f-8f27-dc340c9a92e2 tempest-SnapshotsActionsTest-2089057445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:41:40 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-4ced2d04-6608-411f-8f27-dc340c9a92e2 tempest-SnapshotsActionsTest-2089057445 None] Creating offline snapshot 30af7671-a086-4fed-a746-677a40c044e0 of volume b359c8b6-61e9-44af-a5a4-4ff6da4d6783 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 04:41:40 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1349e1-d667-470b-96ae-21114190b308]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:41:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4ced2d04-6608-411f-8f27-dc340c9a92e2 tempest-SnapshotsActionsTest-2089057445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:40 devstack sudo[100364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b Aug 11 04:41:40 devstack sudo[100364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:41 devstack sudo[100364]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4ced2d04-6608-411f-8f27-dc340c9a92e2 tempest-SnapshotsActionsTest-2089057445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b" returned: 0 in 0.566s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-4ced2d04-6608-411f-8f27-dc340c9a92e2 tempest-SnapshotsActionsTest-2089057445 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:41:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4ced2d04-6608-411f-8f27-dc340c9a92e2 tempest-SnapshotsActionsTest-2089057445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.30af7671-a086-4fed-a746-677a40c044e0 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:41 devstack sudo[100374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.30af7671-a086-4fed-a746-677a40c044e0 1G Aug 11 04:41:41 devstack sudo[100374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:41 devstack sudo[100374]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4ced2d04-6608-411f-8f27-dc340c9a92e2 tempest-SnapshotsActionsTest-2089057445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.30af7671-a086-4fed-a746-677a40c044e0 1G" returned: 0 in 0.676s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4ced2d04-6608-411f-8f27-dc340c9a92e2 tempest-SnapshotsActionsTest-2089057445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.30af7671-a086-4fed-a746-677a40c044e0 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:41 devstack sudo[100391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.30af7671-a086-4fed-a746-677a40c044e0 Aug 11 04:41:41 devstack sudo[100391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:42 devstack sudo[100391]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4ced2d04-6608-411f-8f27-dc340c9a92e2 tempest-SnapshotsActionsTest-2089057445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.30af7671-a086-4fed-a746-677a40c044e0" returned: 0 in 0.406s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:42 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-4ced2d04-6608-411f-8f27-dc340c9a92e2 tempest-SnapshotsActionsTest-2089057445 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.30af7671-a086-4fed-a746-677a40c044e0 is being set with open permissions: ugo+rw Aug 11 04:41:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4ced2d04-6608-411f-8f27-dc340c9a92e2 tempest-SnapshotsActionsTest-2089057445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.30af7671-a086-4fed-a746-677a40c044e0 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:42 devstack sudo[100400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.30af7671-a086-4fed-a746-677a40c044e0 Aug 11 04:41:42 devstack sudo[100400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:42 devstack sudo[100400]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4ced2d04-6608-411f-8f27-dc340c9a92e2 tempest-SnapshotsActionsTest-2089057445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.30af7671-a086-4fed-a746-677a40c044e0" returned: 0 in 0.346s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4ced2d04-6608-411f-8f27-dc340c9a92e2 tempest-SnapshotsActionsTest-2089057445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.155s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:41:42 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-4ced2d04-6608-411f-8f27-dc340c9a92e2 tempest-SnapshotsActionsTest-2089057445 None] Create snapshot completed successfully Aug 11 04:41:43 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-3102bcfe-5188-4075-80d5-04c85fc1290e tempest-VolumeQuotasNegativeTestJSON-589529434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:41:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3102bcfe-5188-4075-80d5-04c85fc1290e tempest-VolumeQuotasNegativeTestJSON-589529434 None] Flow 'volume_create_manager' (38f43eb9-14e6-419f-9e92-8542de31318c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:41:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3102bcfe-5188-4075-80d5-04c85fc1290e tempest-VolumeQuotasNegativeTestJSON-589529434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (061ff7bb-3ce8-4b50-bd88-a632cdf6dda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:41:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3102bcfe-5188-4075-80d5-04c85fc1290e tempest-VolumeQuotasNegativeTestJSON-589529434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (061ff7bb-3ce8-4b50-bd88-a632cdf6dda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2095876403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fa02821-697a-4dfd-939e-ab215583d507,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cff9d6b53dae484591368a4779939077',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:41:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:41:44Z,use_quota=True,user_id='6e02bcfe81194dec8b642963d9f7dd45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:41:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3102bcfe-5188-4075-80d5-04c85fc1290e tempest-VolumeQuotasNegativeTestJSON-589529434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (528cb3d1-9ba4-48c3-91d2-e25a43734887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:41:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3102bcfe-5188-4075-80d5-04c85fc1290e tempest-VolumeQuotasNegativeTestJSON-589529434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (528cb3d1-9ba4-48c3-91d2-e25a43734887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:41:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3102bcfe-5188-4075-80d5-04c85fc1290e tempest-VolumeQuotasNegativeTestJSON-589529434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adde4d0f-ed62-44ef-bfa7-3b91512483b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:41:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3102bcfe-5188-4075-80d5-04c85fc1290e tempest-VolumeQuotasNegativeTestJSON-589529434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adde4d0f-ed62-44ef-bfa7-3b91512483b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fa02821-697a-4dfd-939e-ab215583d507', 'volume_name': 'volume-2fa02821-697a-4dfd-939e-ab215583d507', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:41:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3102bcfe-5188-4075-80d5-04c85fc1290e tempest-VolumeQuotasNegativeTestJSON-589529434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d263f2c-6f5d-4976-b724-d0344f72e5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:41:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3102bcfe-5188-4075-80d5-04c85fc1290e tempest-VolumeQuotasNegativeTestJSON-589529434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d263f2c-6f5d-4976-b724-d0344f72e5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:41:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3102bcfe-5188-4075-80d5-04c85fc1290e tempest-VolumeQuotasNegativeTestJSON-589529434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d336d06-b2e8-478f-b020-1a052bac13f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:41:43 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-3102bcfe-5188-4075-80d5-04c85fc1290e tempest-VolumeQuotasNegativeTestJSON-589529434 None] Volume 2fa02821-697a-4dfd-939e-ab215583d507: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fa02821-697a-4dfd-939e-ab215583d507', 'volume_size': 1} Aug 11 04:41:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3102bcfe-5188-4075-80d5-04c85fc1290e tempest-VolumeQuotasNegativeTestJSON-589529434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:41:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3102bcfe-5188-4075-80d5-04c85fc1290e tempest-VolumeQuotasNegativeTestJSON-589529434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:41:43 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3102bcfe-5188-4075-80d5-04c85fc1290e tempest-VolumeQuotasNegativeTestJSON-589529434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2095876403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fa02821-697a-4dfd-939e-ab215583d507,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cff9d6b53dae484591368a4779939077',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:41:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:41:44Z,use_quota=True,user_id='6e02bcfe81194dec8b642963d9f7dd45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:41:43 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-3102bcfe-5188-4075-80d5-04c85fc1290e tempest-VolumeQuotasNegativeTestJSON-589529434 None] Creating volume 2fa02821-697a-4dfd-939e-ab215583d507 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:41:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3102bcfe-5188-4075-80d5-04c85fc1290e tempest-VolumeQuotasNegativeTestJSON-589529434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:41:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3102bcfe-5188-4075-80d5-04c85fc1290e tempest-VolumeQuotasNegativeTestJSON-589529434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:41:43 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3102bcfe-5188-4075-80d5-04c85fc1290e tempest-VolumeQuotasNegativeTestJSON-589529434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:41:43 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3102bcfe-5188-4075-80d5-04c85fc1290e tempest-VolumeQuotasNegativeTestJSON-589529434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:41:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3102bcfe-5188-4075-80d5-04c85fc1290e tempest-VolumeQuotasNegativeTestJSON-589529434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:41:43 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3102bcfe-5188-4075-80d5-04c85fc1290e tempest-VolumeQuotasNegativeTestJSON-589529434 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:41:43 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-3102bcfe-5188-4075-80d5-04c85fc1290e tempest-VolumeQuotasNegativeTestJSON-589529434 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:41:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3102bcfe-5188-4075-80d5-04c85fc1290e tempest-VolumeQuotasNegativeTestJSON-589529434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2fa02821-697a-4dfd-939e-ab215583d507 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:43 devstack sudo[100406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2fa02821-697a-4dfd-939e-ab215583d507 1073741824 Aug 11 04:41:43 devstack sudo[100406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7ac3b01a-ba3e-4da7-bc65-8bca317f61cd tempest-SnapshotsActionsTest-966804718 None] Acquiring lock "cinder-30af7671-a086-4fed-a746-677a40c044e0-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:41:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7ac3b01a-ba3e-4da7-bc65-8bca317f61cd tempest-SnapshotsActionsTest-966804718 None] Lock "cinder-30af7671-a086-4fed-a746-677a40c044e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:41:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7ac3b01a-ba3e-4da7-bc65-8bca317f61cd tempest-SnapshotsActionsTest-966804718 None] Acquiring lock "cinder-quobyte-b359c8b6-61e9-44af-a5a4-4ff6da4d6783" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:41:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7ac3b01a-ba3e-4da7-bc65-8bca317f61cd tempest-SnapshotsActionsTest-966804718 None] Lock "cinder-quobyte-b359c8b6-61e9-44af-a5a4-4ff6da4d6783" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:41:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7ac3b01a-ba3e-4da7-bc65-8bca317f61cd tempest-SnapshotsActionsTest-966804718 None] Acquiring lock "cinder-quobyte-30af7671-a086-4fed-a746-677a40c044e0" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:41:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7ac3b01a-ba3e-4da7-bc65-8bca317f61cd tempest-SnapshotsActionsTest-966804718 None] Lock "cinder-quobyte-30af7671-a086-4fed-a746-677a40c044e0" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:41:43 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-7ac3b01a-ba3e-4da7-bc65-8bca317f61cd tempest-SnapshotsActionsTest-966804718 None] Deleting offline snapshot 30af7671-a086-4fed-a746-677a40c044e0 of volume b359c8b6-61e9-44af-a5a4-4ff6da4d6783 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 04:41:43 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-7ac3b01a-ba3e-4da7-bc65-8bca317f61cd tempest-SnapshotsActionsTest-966804718 None] snapshot_file for this snap is: volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.30af7671-a086-4fed-a746-677a40c044e0 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 04:41:43 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83b18d2-20b6-41a1-9958-dd14dc4981f1]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:41:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7ac3b01a-ba3e-4da7-bc65-8bca317f61cd tempest-SnapshotsActionsTest-966804718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.30af7671-a086-4fed-a746-677a40c044e0 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:44 devstack sudo[100408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.30af7671-a086-4fed-a746-677a40c044e0 Aug 11 04:41:44 devstack sudo[100408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:44 devstack sudo[100406]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3102bcfe-5188-4075-80d5-04c85fc1290e tempest-VolumeQuotasNegativeTestJSON-589529434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2fa02821-697a-4dfd-939e-ab215583d507 1073741824" returned: 0 in 0.621s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3102bcfe-5188-4075-80d5-04c85fc1290e tempest-VolumeQuotasNegativeTestJSON-589529434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2fa02821-697a-4dfd-939e-ab215583d507 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:44 devstack sudo[100428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2fa02821-697a-4dfd-939e-ab215583d507 Aug 11 04:41:44 devstack sudo[100428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:44 devstack sudo[100408]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7ac3b01a-ba3e-4da7-bc65-8bca317f61cd tempest-SnapshotsActionsTest-966804718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.30af7671-a086-4fed-a746-677a40c044e0" returned: 0 in 0.674s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:44 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-7ac3b01a-ba3e-4da7-bc65-8bca317f61cd tempest-SnapshotsActionsTest-966804718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:41:44 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[867a3440-5e5d-45a9-8e6f-e36c75fd30a9]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:41:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7ac3b01a-ba3e-4da7-bc65-8bca317f61cd tempest-SnapshotsActionsTest-966804718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:44 devstack sudo[100443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b Aug 11 04:41:44 devstack sudo[100443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:45 devstack sudo[100428]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3102bcfe-5188-4075-80d5-04c85fc1290e tempest-VolumeQuotasNegativeTestJSON-589529434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2fa02821-697a-4dfd-939e-ab215583d507" returned: 0 in 0.605s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:45 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3102bcfe-5188-4075-80d5-04c85fc1290e tempest-VolumeQuotasNegativeTestJSON-589529434 None] <== create_volume: return (1314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:41:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3102bcfe-5188-4075-80d5-04c85fc1290e tempest-VolumeQuotasNegativeTestJSON-589529434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.317s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:41:45 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3102bcfe-5188-4075-80d5-04c85fc1290e tempest-VolumeQuotasNegativeTestJSON-589529434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d336d06-b2e8-478f-b020-1a052bac13f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fa02821-697a-4dfd-939e-ab215583d507', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:41:45 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3102bcfe-5188-4075-80d5-04c85fc1290e tempest-VolumeQuotasNegativeTestJSON-589529434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48263065-611a-4e64-a935-b1474636196b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:41:45 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-3102bcfe-5188-4075-80d5-04c85fc1290e tempest-VolumeQuotasNegativeTestJSON-589529434 None] Volume volume-2fa02821-697a-4dfd-939e-ab215583d507 (2fa02821-697a-4dfd-939e-ab215583d507): created successfully Aug 11 04:41:45 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3102bcfe-5188-4075-80d5-04c85fc1290e tempest-VolumeQuotasNegativeTestJSON-589529434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48263065-611a-4e64-a935-b1474636196b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:41:45 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3102bcfe-5188-4075-80d5-04c85fc1290e tempest-VolumeQuotasNegativeTestJSON-589529434 None] Flow 'volume_create_manager' (38f43eb9-14e6-419f-9e92-8542de31318c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:41:45 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-3102bcfe-5188-4075-80d5-04c85fc1290e tempest-VolumeQuotasNegativeTestJSON-589529434 None] Created volume successfully. Aug 11 04:41:45 devstack sudo[100443]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7ac3b01a-ba3e-4da7-bc65-8bca317f61cd tempest-SnapshotsActionsTest-966804718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b" returned: 0 in 0.634s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:45 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-7ac3b01a-ba3e-4da7-bc65-8bca317f61cd tempest-SnapshotsActionsTest-966804718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:41:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7ac3b01a-ba3e-4da7-bc65-8bca317f61cd tempest-SnapshotsActionsTest-966804718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.30af7671-a086-4fed-a746-677a40c044e0 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:45 devstack sudo[100458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.30af7671-a086-4fed-a746-677a40c044e0 Aug 11 04:41:45 devstack sudo[100458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:45 devstack sudo[100458]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7ac3b01a-ba3e-4da7-bc65-8bca317f61cd tempest-SnapshotsActionsTest-966804718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.30af7671-a086-4fed-a746-677a40c044e0" returned: 0 in 0.578s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7ac3b01a-ba3e-4da7-bc65-8bca317f61cd tempest-SnapshotsActionsTest-966804718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.30af7671-a086-4fed-a746-677a40c044e0 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:45 devstack sudo[100477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.30af7671-a086-4fed-a746-677a40c044e0 Aug 11 04:41:45 devstack sudo[100477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:46 devstack sudo[100477]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7ac3b01a-ba3e-4da7-bc65-8bca317f61cd tempest-SnapshotsActionsTest-966804718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.30af7671-a086-4fed-a746-677a40c044e0" returned: 0 in 0.321s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:46 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7ac3b01a-ba3e-4da7-bc65-8bca317f61cd tempest-SnapshotsActionsTest-966804718 None] Lock "cinder-quobyte-30af7671-a086-4fed-a746-677a40c044e0" released by "_delete_snapshot" :: held 2.336s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:41:46 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7ac3b01a-ba3e-4da7-bc65-8bca317f61cd tempest-SnapshotsActionsTest-966804718 None] Lock "cinder-quobyte-b359c8b6-61e9-44af-a5a4-4ff6da4d6783" released by "delete_snapshot" :: held 2.371s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:41:46 devstack cinder-volume[94472]: WARNING cinder.quota [None req-7ac3b01a-ba3e-4da7-bc65-8bca317f61cd tempest-SnapshotsActionsTest-966804718 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 11 04:41:46 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-7ac3b01a-ba3e-4da7-bc65-8bca317f61cd tempest-SnapshotsActionsTest-966804718 None] Created reservations ['6db41699-9f49-4ec1-9f6f-e667ff284247', 'b49143a4-c4cf-408f-9617-d6f3522e6a71', '5df9a784-e6c2-42f1-815f-3355fdaddc24', '16c96dc7-db5b-4fe5-9dbd-3e95826cbc4c'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:41:46 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-7ac3b01a-ba3e-4da7-bc65-8bca317f61cd tempest-SnapshotsActionsTest-966804718 None] Delete snapshot completed successfully. Aug 11 04:41:46 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7ac3b01a-ba3e-4da7-bc65-8bca317f61cd tempest-SnapshotsActionsTest-966804718 None] Lock "cinder-30af7671-a086-4fed-a746-677a40c044e0-delete_snapshot" released by "delete_snapshot" :: held 2.562s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:41:47 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fc35cca4-7b5d-4e1d-8a63-dfe000d90358 tempest-VolumeQuotasNegativeTestJSON-589529434 None] Acquiring lock "cinder-2fa02821-697a-4dfd-939e-ab215583d507-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:41:47 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fc35cca4-7b5d-4e1d-8a63-dfe000d90358 tempest-VolumeQuotasNegativeTestJSON-589529434 None] Lock "cinder-2fa02821-697a-4dfd-939e-ab215583d507-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:41:47 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fc35cca4-7b5d-4e1d-8a63-dfe000d90358 tempest-VolumeQuotasNegativeTestJSON-589529434 None] Acquiring lock "cinder-quobyte-2fa02821-697a-4dfd-939e-ab215583d507" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:41:47 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fc35cca4-7b5d-4e1d-8a63-dfe000d90358 tempest-VolumeQuotasNegativeTestJSON-589529434 None] Lock "cinder-quobyte-2fa02821-697a-4dfd-939e-ab215583d507" acquired by "delete_volume" :: waited 0.044s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:41:47 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22ca4d7-252a-4260-aa01-e468a7a88ff3]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:41:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fc35cca4-7b5d-4e1d-8a63-dfe000d90358 tempest-VolumeQuotasNegativeTestJSON-589529434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2fa02821-697a-4dfd-939e-ab215583d507 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:48 devstack sudo[100510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2fa02821-697a-4dfd-939e-ab215583d507 Aug 11 04:41:48 devstack sudo[100510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bdf09f12-1d79-4232-b48c-22326cab67ec tempest-SnapshotsActionsTest-2089057445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:41:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bdf09f12-1d79-4232-b48c-22326cab67ec tempest-SnapshotsActionsTest-2089057445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:41:48 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-bdf09f12-1d79-4232-b48c-22326cab67ec tempest-SnapshotsActionsTest-2089057445 None] Creating offline snapshot 54a958b0-d2c0-4c17-add5-ccf408f35b75 of volume b359c8b6-61e9-44af-a5a4-4ff6da4d6783 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 04:41:48 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7b5a25-4e18-46c0-b636-b6afcf76a852]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:41:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bdf09f12-1d79-4232-b48c-22326cab67ec tempest-SnapshotsActionsTest-2089057445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:48 devstack sudo[100512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b Aug 11 04:41:48 devstack sudo[100512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:48 devstack sudo[100510]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fc35cca4-7b5d-4e1d-8a63-dfe000d90358 tempest-VolumeQuotasNegativeTestJSON-589529434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2fa02821-697a-4dfd-939e-ab215583d507" returned: 0 in 0.907s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fc35cca4-7b5d-4e1d-8a63-dfe000d90358 tempest-VolumeQuotasNegativeTestJSON-589529434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2fa02821-697a-4dfd-939e-ab215583d507 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:48 devstack sudo[100517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2fa02821-697a-4dfd-939e-ab215583d507 Aug 11 04:41:48 devstack sudo[100517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:49 devstack sudo[100512]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bdf09f12-1d79-4232-b48c-22326cab67ec tempest-SnapshotsActionsTest-2089057445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b" returned: 0 in 0.694s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:49 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-bdf09f12-1d79-4232-b48c-22326cab67ec tempest-SnapshotsActionsTest-2089057445 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:41:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bdf09f12-1d79-4232-b48c-22326cab67ec tempest-SnapshotsActionsTest-2089057445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.54a958b0-d2c0-4c17-add5-ccf408f35b75 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:49 devstack sudo[100522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.54a958b0-d2c0-4c17-add5-ccf408f35b75 1G Aug 11 04:41:49 devstack sudo[100522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:49 devstack sudo[100517]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fc35cca4-7b5d-4e1d-8a63-dfe000d90358 tempest-VolumeQuotasNegativeTestJSON-589529434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2fa02821-697a-4dfd-939e-ab215583d507" returned: 0 in 0.478s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:49 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fc35cca4-7b5d-4e1d-8a63-dfe000d90358 tempest-VolumeQuotasNegativeTestJSON-589529434 None] Lock "cinder-quobyte-2fa02821-697a-4dfd-939e-ab215583d507" released by "delete_volume" :: held 1.501s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:41:49 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-fc35cca4-7b5d-4e1d-8a63-dfe000d90358 tempest-VolumeQuotasNegativeTestJSON-589529434 None] Created reservations ['0b70b91a-6807-418a-97fb-4c6925c8941d', '81c9fa83-87cd-4ce8-bac1-63bfdb42e81e', 'b27d38f8-8f4c-43b4-9454-505e6d445785', '37ed2bab-5feb-485d-9902-691996fab0cc'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:41:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fc35cca4-7b5d-4e1d-8a63-dfe000d90358 tempest-VolumeQuotasNegativeTestJSON-589529434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:41:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fc35cca4-7b5d-4e1d-8a63-dfe000d90358 tempest-VolumeQuotasNegativeTestJSON-589529434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:41:49 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-fc35cca4-7b5d-4e1d-8a63-dfe000d90358 tempest-VolumeQuotasNegativeTestJSON-589529434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:41:49 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-fc35cca4-7b5d-4e1d-8a63-dfe000d90358 tempest-VolumeQuotasNegativeTestJSON-589529434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:41:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fc35cca4-7b5d-4e1d-8a63-dfe000d90358 tempest-VolumeQuotasNegativeTestJSON-589529434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:41:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fc35cca4-7b5d-4e1d-8a63-dfe000d90358 tempest-VolumeQuotasNegativeTestJSON-589529434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:49 devstack sudo[100529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:41:49 devstack sudo[100529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:49 devstack sudo[100522]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bdf09f12-1d79-4232-b48c-22326cab67ec tempest-SnapshotsActionsTest-2089057445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.54a958b0-d2c0-4c17-add5-ccf408f35b75 1G" returned: 0 in 0.757s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bdf09f12-1d79-4232-b48c-22326cab67ec tempest-SnapshotsActionsTest-2089057445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.54a958b0-d2c0-4c17-add5-ccf408f35b75 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:49 devstack sudo[100531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.54a958b0-d2c0-4c17-add5-ccf408f35b75 Aug 11 04:41:49 devstack sudo[100531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:50 devstack sudo[100529]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fc35cca4-7b5d-4e1d-8a63-dfe000d90358 tempest-VolumeQuotasNegativeTestJSON-589529434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.562s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:50 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-fc35cca4-7b5d-4e1d-8a63-dfe000d90358 tempest-VolumeQuotasNegativeTestJSON-589529434 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:41:50 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-fc35cca4-7b5d-4e1d-8a63-dfe000d90358 tempest-VolumeQuotasNegativeTestJSON-589529434 None] Deleted volume successfully. Aug 11 04:41:50 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fc35cca4-7b5d-4e1d-8a63-dfe000d90358 tempest-VolumeQuotasNegativeTestJSON-589529434 None] Lock "cinder-2fa02821-697a-4dfd-939e-ab215583d507-delete_volume" released by "delete_volume" :: held 2.459s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:41:50 devstack sudo[100531]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bdf09f12-1d79-4232-b48c-22326cab67ec tempest-SnapshotsActionsTest-2089057445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.54a958b0-d2c0-4c17-add5-ccf408f35b75" returned: 0 in 0.594s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:50 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-bdf09f12-1d79-4232-b48c-22326cab67ec tempest-SnapshotsActionsTest-2089057445 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.54a958b0-d2c0-4c17-add5-ccf408f35b75 is being set with open permissions: ugo+rw Aug 11 04:41:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bdf09f12-1d79-4232-b48c-22326cab67ec tempest-SnapshotsActionsTest-2089057445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.54a958b0-d2c0-4c17-add5-ccf408f35b75 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:50 devstack sudo[100542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.54a958b0-d2c0-4c17-add5-ccf408f35b75 Aug 11 04:41:50 devstack sudo[100542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:50 devstack sudo[100542]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bdf09f12-1d79-4232-b48c-22326cab67ec tempest-SnapshotsActionsTest-2089057445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.54a958b0-d2c0-4c17-add5-ccf408f35b75" returned: 0 in 0.452s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bdf09f12-1d79-4232-b48c-22326cab67ec tempest-SnapshotsActionsTest-2089057445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.761s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:41:51 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-bdf09f12-1d79-4232-b48c-22326cab67ec tempest-SnapshotsActionsTest-2089057445 None] Create snapshot completed successfully Aug 11 04:41:51 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-13695982-8c88-41bd-855e-5d673636d7c8 tempest-SnapshotsActionsTest-966804718 None] Acquiring lock "cinder-54a958b0-d2c0-4c17-add5-ccf408f35b75-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:41:51 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-13695982-8c88-41bd-855e-5d673636d7c8 tempest-SnapshotsActionsTest-966804718 None] Lock "cinder-54a958b0-d2c0-4c17-add5-ccf408f35b75-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:41:51 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-13695982-8c88-41bd-855e-5d673636d7c8 tempest-SnapshotsActionsTest-966804718 None] Acquiring lock "cinder-quobyte-b359c8b6-61e9-44af-a5a4-4ff6da4d6783" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:41:51 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-13695982-8c88-41bd-855e-5d673636d7c8 tempest-SnapshotsActionsTest-966804718 None] Lock "cinder-quobyte-b359c8b6-61e9-44af-a5a4-4ff6da4d6783" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:41:51 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-13695982-8c88-41bd-855e-5d673636d7c8 tempest-SnapshotsActionsTest-966804718 None] Acquiring lock "cinder-quobyte-54a958b0-d2c0-4c17-add5-ccf408f35b75" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:41:51 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-13695982-8c88-41bd-855e-5d673636d7c8 tempest-SnapshotsActionsTest-966804718 None] Lock "cinder-quobyte-54a958b0-d2c0-4c17-add5-ccf408f35b75" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:41:51 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-13695982-8c88-41bd-855e-5d673636d7c8 tempest-SnapshotsActionsTest-966804718 None] Deleting offline snapshot 54a958b0-d2c0-4c17-add5-ccf408f35b75 of volume b359c8b6-61e9-44af-a5a4-4ff6da4d6783 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 04:41:51 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-13695982-8c88-41bd-855e-5d673636d7c8 tempest-SnapshotsActionsTest-966804718 None] snapshot_file for this snap is: volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.54a958b0-d2c0-4c17-add5-ccf408f35b75 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 04:41:51 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0cdb8f6-942d-4f3c-833e-b659cdaee195]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:41:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-13695982-8c88-41bd-855e-5d673636d7c8 tempest-SnapshotsActionsTest-966804718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.54a958b0-d2c0-4c17-add5-ccf408f35b75 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:51 devstack sudo[100547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.54a958b0-d2c0-4c17-add5-ccf408f35b75 Aug 11 04:41:51 devstack sudo[100547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:52 devstack sudo[100547]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-13695982-8c88-41bd-855e-5d673636d7c8 tempest-SnapshotsActionsTest-966804718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.54a958b0-d2c0-4c17-add5-ccf408f35b75" returned: 0 in 0.508s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-13695982-8c88-41bd-855e-5d673636d7c8 tempest-SnapshotsActionsTest-966804718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:41:52 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[8266a5a8-82be-44d1-83ec-55cdc868034a]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:41:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-13695982-8c88-41bd-855e-5d673636d7c8 tempest-SnapshotsActionsTest-966804718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:52 devstack sudo[100552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b Aug 11 04:41:52 devstack sudo[100552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:52 devstack sudo[100552]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-13695982-8c88-41bd-855e-5d673636d7c8 tempest-SnapshotsActionsTest-966804718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b" returned: 0 in 0.586s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-13695982-8c88-41bd-855e-5d673636d7c8 tempest-SnapshotsActionsTest-966804718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:41:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-13695982-8c88-41bd-855e-5d673636d7c8 tempest-SnapshotsActionsTest-966804718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.54a958b0-d2c0-4c17-add5-ccf408f35b75 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:52 devstack sudo[100558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.54a958b0-d2c0-4c17-add5-ccf408f35b75 Aug 11 04:41:52 devstack sudo[100558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:53 devstack sudo[100558]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-13695982-8c88-41bd-855e-5d673636d7c8 tempest-SnapshotsActionsTest-966804718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.54a958b0-d2c0-4c17-add5-ccf408f35b75" returned: 0 in 0.523s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-13695982-8c88-41bd-855e-5d673636d7c8 tempest-SnapshotsActionsTest-966804718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.54a958b0-d2c0-4c17-add5-ccf408f35b75 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:53 devstack sudo[100564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.54a958b0-d2c0-4c17-add5-ccf408f35b75 Aug 11 04:41:53 devstack sudo[100564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:53 devstack sudo[100564]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-13695982-8c88-41bd-855e-5d673636d7c8 tempest-SnapshotsActionsTest-966804718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.54a958b0-d2c0-4c17-add5-ccf408f35b75" returned: 0 in 0.379s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:53 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-13695982-8c88-41bd-855e-5d673636d7c8 tempest-SnapshotsActionsTest-966804718 None] Lock "cinder-quobyte-54a958b0-d2c0-4c17-add5-ccf408f35b75" released by "_delete_snapshot" :: held 2.122s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:41:53 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-13695982-8c88-41bd-855e-5d673636d7c8 tempest-SnapshotsActionsTest-966804718 None] Lock "cinder-quobyte-b359c8b6-61e9-44af-a5a4-4ff6da4d6783" released by "delete_snapshot" :: held 2.163s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:41:53 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-13695982-8c88-41bd-855e-5d673636d7c8 tempest-SnapshotsActionsTest-966804718 None] Created reservations ['120e32c9-7c22-4e39-901e-b45a67802965', '58613dc3-2ca5-4b73-98fd-511f495dbf81', '979f8386-a475-4c42-99d6-5bb70f02a08f', 'e0ec36af-3b14-40ea-81ed-42dd84df0a3a'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:41:54 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-13695982-8c88-41bd-855e-5d673636d7c8 tempest-SnapshotsActionsTest-966804718 None] Delete snapshot completed successfully. Aug 11 04:41:54 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-13695982-8c88-41bd-855e-5d673636d7c8 tempest-SnapshotsActionsTest-966804718 None] Lock "cinder-54a958b0-d2c0-4c17-add5-ccf408f35b75-delete_snapshot" released by "delete_snapshot" :: held 2.385s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:41:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-604f1e6c-66cb-4fa1-90e0-27970a0e2ae2 tempest-SnapshotsActionsTest-2089057445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:41:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-604f1e6c-66cb-4fa1-90e0-27970a0e2ae2 tempest-SnapshotsActionsTest-2089057445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:41:55 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-604f1e6c-66cb-4fa1-90e0-27970a0e2ae2 tempest-SnapshotsActionsTest-2089057445 None] Creating offline snapshot 7938ac92-9596-4f0c-a4ff-761184cfcdf0 of volume b359c8b6-61e9-44af-a5a4-4ff6da4d6783 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 04:41:55 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[db411966-9bf4-4906-8712-13c5ed39f303]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:41:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-604f1e6c-66cb-4fa1-90e0-27970a0e2ae2 tempest-SnapshotsActionsTest-2089057445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:55 devstack sudo[100567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b Aug 11 04:41:55 devstack sudo[100567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:55 devstack sudo[100567]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-604f1e6c-66cb-4fa1-90e0-27970a0e2ae2 tempest-SnapshotsActionsTest-2089057445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b" returned: 0 in 0.417s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:55 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-604f1e6c-66cb-4fa1-90e0-27970a0e2ae2 tempest-SnapshotsActionsTest-2089057445 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:41:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-604f1e6c-66cb-4fa1-90e0-27970a0e2ae2 tempest-SnapshotsActionsTest-2089057445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.7938ac92-9596-4f0c-a4ff-761184cfcdf0 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:55 devstack sudo[100573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.7938ac92-9596-4f0c-a4ff-761184cfcdf0 1G Aug 11 04:41:55 devstack sudo[100573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:56 devstack sudo[100573]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-604f1e6c-66cb-4fa1-90e0-27970a0e2ae2 tempest-SnapshotsActionsTest-2089057445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.7938ac92-9596-4f0c-a4ff-761184cfcdf0 1G" returned: 0 in 0.585s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-604f1e6c-66cb-4fa1-90e0-27970a0e2ae2 tempest-SnapshotsActionsTest-2089057445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.7938ac92-9596-4f0c-a4ff-761184cfcdf0 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:56 devstack sudo[100579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.7938ac92-9596-4f0c-a4ff-761184cfcdf0 Aug 11 04:41:56 devstack sudo[100579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:56 devstack sudo[100579]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-604f1e6c-66cb-4fa1-90e0-27970a0e2ae2 tempest-SnapshotsActionsTest-2089057445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.7938ac92-9596-4f0c-a4ff-761184cfcdf0" returned: 0 in 0.361s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:56 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-604f1e6c-66cb-4fa1-90e0-27970a0e2ae2 tempest-SnapshotsActionsTest-2089057445 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.7938ac92-9596-4f0c-a4ff-761184cfcdf0 is being set with open permissions: ugo+rw Aug 11 04:41:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-604f1e6c-66cb-4fa1-90e0-27970a0e2ae2 tempest-SnapshotsActionsTest-2089057445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.7938ac92-9596-4f0c-a4ff-761184cfcdf0 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:56 devstack sudo[100585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.7938ac92-9596-4f0c-a4ff-761184cfcdf0 Aug 11 04:41:56 devstack sudo[100585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:57 devstack sudo[100585]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-604f1e6c-66cb-4fa1-90e0-27970a0e2ae2 tempest-SnapshotsActionsTest-2089057445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.7938ac92-9596-4f0c-a4ff-761184cfcdf0" returned: 0 in 0.418s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-604f1e6c-66cb-4fa1-90e0-27970a0e2ae2 tempest-SnapshotsActionsTest-2089057445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.927s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:41:57 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-604f1e6c-66cb-4fa1-90e0-27970a0e2ae2 tempest-SnapshotsActionsTest-2089057445 None] Create snapshot completed successfully Aug 11 04:41:57 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0de5135f-6da6-4316-a153-b6fc3d48888f tempest-SnapshotsActionsTest-966804718 None] Acquiring lock "cinder-7938ac92-9596-4f0c-a4ff-761184cfcdf0-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:41:57 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0de5135f-6da6-4316-a153-b6fc3d48888f tempest-SnapshotsActionsTest-966804718 None] Lock "cinder-7938ac92-9596-4f0c-a4ff-761184cfcdf0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:41:57 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0de5135f-6da6-4316-a153-b6fc3d48888f tempest-SnapshotsActionsTest-966804718 None] Acquiring lock "cinder-quobyte-b359c8b6-61e9-44af-a5a4-4ff6da4d6783" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:41:57 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0de5135f-6da6-4316-a153-b6fc3d48888f tempest-SnapshotsActionsTest-966804718 None] Lock "cinder-quobyte-b359c8b6-61e9-44af-a5a4-4ff6da4d6783" acquired by "delete_snapshot" :: waited 0.032s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:41:57 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0de5135f-6da6-4316-a153-b6fc3d48888f tempest-SnapshotsActionsTest-966804718 None] Acquiring lock "cinder-quobyte-7938ac92-9596-4f0c-a4ff-761184cfcdf0" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:41:57 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0de5135f-6da6-4316-a153-b6fc3d48888f tempest-SnapshotsActionsTest-966804718 None] Lock "cinder-quobyte-7938ac92-9596-4f0c-a4ff-761184cfcdf0" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:41:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-0de5135f-6da6-4316-a153-b6fc3d48888f tempest-SnapshotsActionsTest-966804718 None] Deleting offline snapshot 7938ac92-9596-4f0c-a4ff-761184cfcdf0 of volume b359c8b6-61e9-44af-a5a4-4ff6da4d6783 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 04:41:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-0de5135f-6da6-4316-a153-b6fc3d48888f tempest-SnapshotsActionsTest-966804718 None] snapshot_file for this snap is: volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.7938ac92-9596-4f0c-a4ff-761184cfcdf0 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 04:41:57 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5501e0-80ae-4671-8b4c-38c4a2400611]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:41:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0de5135f-6da6-4316-a153-b6fc3d48888f tempest-SnapshotsActionsTest-966804718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.7938ac92-9596-4f0c-a4ff-761184cfcdf0 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:57 devstack sudo[100588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.7938ac92-9596-4f0c-a4ff-761184cfcdf0 Aug 11 04:41:57 devstack sudo[100588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:58 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4cd51c4-8de3-4c02-97e5-51ee08a331b7 tempest-VolumesServicesTestJSON-1205899204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:41:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b4cd51c4-8de3-4c02-97e5-51ee08a331b7 tempest-VolumesServicesTestJSON-1205899204 None] Flow 'volume_create_manager' (59d6004a-7e47-445d-a78f-4eb4f2d00b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:41:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b4cd51c4-8de3-4c02-97e5-51ee08a331b7 tempest-VolumesServicesTestJSON-1205899204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b67140b0-542e-4e15-a0c5-7a04a3edd92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:41:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b4cd51c4-8de3-4c02-97e5-51ee08a331b7 tempest-VolumesServicesTestJSON-1205899204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b67140b0-542e-4e15-a0c5-7a04a3edd92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1390632393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f152c790-86e3-491c-b74d-2f07a75b7a51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a0d89b75b8a4ad2ad49bbeed146574a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:41:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:41:58Z,use_quota=True,user_id='ef49bd55b3d14807bb04b28e76edbda3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:41:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b4cd51c4-8de3-4c02-97e5-51ee08a331b7 tempest-VolumesServicesTestJSON-1205899204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a442f8c-67ce-46b5-9ad5-341022750d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:41:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b4cd51c4-8de3-4c02-97e5-51ee08a331b7 tempest-VolumesServicesTestJSON-1205899204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a442f8c-67ce-46b5-9ad5-341022750d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:41:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b4cd51c4-8de3-4c02-97e5-51ee08a331b7 tempest-VolumesServicesTestJSON-1205899204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06cb1df0-c644-4e6b-bbac-0c8f40ec41c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:41:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b4cd51c4-8de3-4c02-97e5-51ee08a331b7 tempest-VolumesServicesTestJSON-1205899204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06cb1df0-c644-4e6b-bbac-0c8f40ec41c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f152c790-86e3-491c-b74d-2f07a75b7a51', 'volume_name': 'volume-f152c790-86e3-491c-b74d-2f07a75b7a51', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:41:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b4cd51c4-8de3-4c02-97e5-51ee08a331b7 tempest-VolumesServicesTestJSON-1205899204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d61a392-1831-4faa-8bda-c7b64ac0f80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:41:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b4cd51c4-8de3-4c02-97e5-51ee08a331b7 tempest-VolumesServicesTestJSON-1205899204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d61a392-1831-4faa-8bda-c7b64ac0f80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:41:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b4cd51c4-8de3-4c02-97e5-51ee08a331b7 tempest-VolumesServicesTestJSON-1205899204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45463e33-e671-4774-99a8-b738b7e6ce50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:41:58 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-b4cd51c4-8de3-4c02-97e5-51ee08a331b7 tempest-VolumesServicesTestJSON-1205899204 None] Volume f152c790-86e3-491c-b74d-2f07a75b7a51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f152c790-86e3-491c-b74d-2f07a75b7a51', 'volume_size': 1} Aug 11 04:41:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b4cd51c4-8de3-4c02-97e5-51ee08a331b7 tempest-VolumesServicesTestJSON-1205899204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:41:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b4cd51c4-8de3-4c02-97e5-51ee08a331b7 tempest-VolumesServicesTestJSON-1205899204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:41:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b4cd51c4-8de3-4c02-97e5-51ee08a331b7 tempest-VolumesServicesTestJSON-1205899204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1390632393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f152c790-86e3-491c-b74d-2f07a75b7a51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a0d89b75b8a4ad2ad49bbeed146574a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:41:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:41:58Z,use_quota=True,user_id='ef49bd55b3d14807bb04b28e76edbda3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:41:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-b4cd51c4-8de3-4c02-97e5-51ee08a331b7 tempest-VolumesServicesTestJSON-1205899204 None] Creating volume f152c790-86e3-491c-b74d-2f07a75b7a51 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:41:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b4cd51c4-8de3-4c02-97e5-51ee08a331b7 tempest-VolumesServicesTestJSON-1205899204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:41:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b4cd51c4-8de3-4c02-97e5-51ee08a331b7 tempest-VolumesServicesTestJSON-1205899204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:41:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b4cd51c4-8de3-4c02-97e5-51ee08a331b7 tempest-VolumesServicesTestJSON-1205899204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:41:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b4cd51c4-8de3-4c02-97e5-51ee08a331b7 tempest-VolumesServicesTestJSON-1205899204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:41:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b4cd51c4-8de3-4c02-97e5-51ee08a331b7 tempest-VolumesServicesTestJSON-1205899204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:41:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b4cd51c4-8de3-4c02-97e5-51ee08a331b7 tempest-VolumesServicesTestJSON-1205899204 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:41:58 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-b4cd51c4-8de3-4c02-97e5-51ee08a331b7 tempest-VolumesServicesTestJSON-1205899204 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:41:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b4cd51c4-8de3-4c02-97e5-51ee08a331b7 tempest-VolumesServicesTestJSON-1205899204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f152c790-86e3-491c-b74d-2f07a75b7a51 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:58 devstack sudo[100592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f152c790-86e3-491c-b74d-2f07a75b7a51 1073741824 Aug 11 04:41:58 devstack sudo[100592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:58 devstack sudo[100588]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0de5135f-6da6-4316-a153-b6fc3d48888f tempest-SnapshotsActionsTest-966804718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.7938ac92-9596-4f0c-a4ff-761184cfcdf0" returned: 0 in 0.608s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-0de5135f-6da6-4316-a153-b6fc3d48888f tempest-SnapshotsActionsTest-966804718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:41:58 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace2d237-09ff-4e2c-9d32-73aa4e9c56b8]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:41:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0de5135f-6da6-4316-a153-b6fc3d48888f tempest-SnapshotsActionsTest-966804718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:58 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 04:41:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:41:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:41:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:41:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:41:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:41:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:58 devstack sudo[100596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:41:58 devstack sudo[100596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:58 devstack sudo[100595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b Aug 11 04:41:58 devstack sudo[100595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:58 devstack sudo[100592]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b4cd51c4-8de3-4c02-97e5-51ee08a331b7 tempest-VolumesServicesTestJSON-1205899204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f152c790-86e3-491c-b74d-2f07a75b7a51 1073741824" returned: 0 in 0.526s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:58 devstack sudo[100596]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.388s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:58 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:41:58 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running periodic task VolumeManager._thread_info {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 04:41:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] thread count: 8 {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 11 04:41:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] thread info: [<_MainThread(MainThread, started 133315846115456)>, , , , , , , ] {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 11 04:41:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b4cd51c4-8de3-4c02-97e5-51ee08a331b7 tempest-VolumesServicesTestJSON-1205899204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f152c790-86e3-491c-b74d-2f07a75b7a51 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:58 devstack sudo[100604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f152c790-86e3-491c-b74d-2f07a75b7a51 Aug 11 04:41:58 devstack sudo[100604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:59 devstack sudo[100595]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0de5135f-6da6-4316-a153-b6fc3d48888f tempest-SnapshotsActionsTest-966804718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b" returned: 0 in 0.634s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:59 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-0de5135f-6da6-4316-a153-b6fc3d48888f tempest-SnapshotsActionsTest-966804718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:41:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0de5135f-6da6-4316-a153-b6fc3d48888f tempest-SnapshotsActionsTest-966804718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.7938ac92-9596-4f0c-a4ff-761184cfcdf0 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:59 devstack sudo[100609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.7938ac92-9596-4f0c-a4ff-761184cfcdf0 Aug 11 04:41:59 devstack sudo[100609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:59 devstack sudo[100604]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b4cd51c4-8de3-4c02-97e5-51ee08a331b7 tempest-VolumesServicesTestJSON-1205899204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f152c790-86e3-491c-b74d-2f07a75b7a51" returned: 0 in 0.354s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:59 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b4cd51c4-8de3-4c02-97e5-51ee08a331b7 tempest-VolumesServicesTestJSON-1205899204 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:41:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b4cd51c4-8de3-4c02-97e5-51ee08a331b7 tempest-VolumesServicesTestJSON-1205899204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:41:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b4cd51c4-8de3-4c02-97e5-51ee08a331b7 tempest-VolumesServicesTestJSON-1205899204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45463e33-e671-4774-99a8-b738b7e6ce50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f152c790-86e3-491c-b74d-2f07a75b7a51', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:41:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b4cd51c4-8de3-4c02-97e5-51ee08a331b7 tempest-VolumesServicesTestJSON-1205899204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e9eb3fb-b337-4c1d-a1c0-8f710346d8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:41:59 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-b4cd51c4-8de3-4c02-97e5-51ee08a331b7 tempest-VolumesServicesTestJSON-1205899204 None] Volume volume-f152c790-86e3-491c-b74d-2f07a75b7a51 (f152c790-86e3-491c-b74d-2f07a75b7a51): created successfully Aug 11 04:41:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b4cd51c4-8de3-4c02-97e5-51ee08a331b7 tempest-VolumesServicesTestJSON-1205899204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e9eb3fb-b337-4c1d-a1c0-8f710346d8f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:41:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b4cd51c4-8de3-4c02-97e5-51ee08a331b7 tempest-VolumesServicesTestJSON-1205899204 None] Flow 'volume_create_manager' (59d6004a-7e47-445d-a78f-4eb4f2d00b90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:41:59 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-b4cd51c4-8de3-4c02-97e5-51ee08a331b7 tempest-VolumesServicesTestJSON-1205899204 None] Created volume successfully. Aug 11 04:41:59 devstack sudo[100609]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0de5135f-6da6-4316-a153-b6fc3d48888f tempest-SnapshotsActionsTest-966804718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.7938ac92-9596-4f0c-a4ff-761184cfcdf0" returned: 0 in 0.450s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0de5135f-6da6-4316-a153-b6fc3d48888f tempest-SnapshotsActionsTest-966804718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.7938ac92-9596-4f0c-a4ff-761184cfcdf0 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:41:59 devstack sudo[100615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.7938ac92-9596-4f0c-a4ff-761184cfcdf0 Aug 11 04:41:59 devstack sudo[100615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:41:59 devstack sudo[100615]: pam_unix(sudo:session): session closed for user root Aug 11 04:41:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0de5135f-6da6-4316-a153-b6fc3d48888f tempest-SnapshotsActionsTest-966804718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.7938ac92-9596-4f0c-a4ff-761184cfcdf0" returned: 0 in 0.294s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:41:59 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0de5135f-6da6-4316-a153-b6fc3d48888f tempest-SnapshotsActionsTest-966804718 None] Lock "cinder-quobyte-7938ac92-9596-4f0c-a4ff-761184cfcdf0" released by "_delete_snapshot" :: held 2.133s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:41:59 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0de5135f-6da6-4316-a153-b6fc3d48888f tempest-SnapshotsActionsTest-966804718 None] Lock "cinder-quobyte-b359c8b6-61e9-44af-a5a4-4ff6da4d6783" released by "delete_snapshot" :: held 2.170s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:41:59 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-0de5135f-6da6-4316-a153-b6fc3d48888f tempest-SnapshotsActionsTest-966804718 None] Created reservations ['5d64b1ae-548a-46c6-96ec-569c440ea597', 'ab208652-87b1-45d4-b4e7-e57eee239444', 'eaf4e7d7-a839-426f-b39c-4d6abc60427a', 'f6a7b6a0-27bc-4843-af01-b92c779b5be4'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:42:00 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-0de5135f-6da6-4316-a153-b6fc3d48888f tempest-SnapshotsActionsTest-966804718 None] Delete snapshot completed successfully. Aug 11 04:42:00 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0de5135f-6da6-4316-a153-b6fc3d48888f tempest-SnapshotsActionsTest-966804718 None] Lock "cinder-7938ac92-9596-4f0c-a4ff-761184cfcdf0-delete_snapshot" released by "delete_snapshot" :: held 2.380s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:42:00 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ddf66083-0be2-4eb5-9ec0-f12cc6eb0a4c tempest-VolumesServicesTestJSON-1205899204 None] Acquiring lock "cinder-f152c790-86e3-491c-b74d-2f07a75b7a51-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:42:00 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ddf66083-0be2-4eb5-9ec0-f12cc6eb0a4c tempest-VolumesServicesTestJSON-1205899204 None] Lock "cinder-f152c790-86e3-491c-b74d-2f07a75b7a51-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:42:00 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ddf66083-0be2-4eb5-9ec0-f12cc6eb0a4c tempest-VolumesServicesTestJSON-1205899204 None] Acquiring lock "cinder-quobyte-f152c790-86e3-491c-b74d-2f07a75b7a51" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:42:00 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ddf66083-0be2-4eb5-9ec0-f12cc6eb0a4c tempest-VolumesServicesTestJSON-1205899204 None] Lock "cinder-quobyte-f152c790-86e3-491c-b74d-2f07a75b7a51" acquired by "delete_volume" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:42:00 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc2239d-917c-47bf-b8d3-8c10915544ac]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:42:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ddf66083-0be2-4eb5-9ec0-f12cc6eb0a4c tempest-VolumesServicesTestJSON-1205899204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f152c790-86e3-491c-b74d-2f07a75b7a51 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:00 devstack sudo[100634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f152c790-86e3-491c-b74d-2f07a75b7a51 Aug 11 04:42:00 devstack sudo[100634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:00 devstack sudo[100634]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ddf66083-0be2-4eb5-9ec0-f12cc6eb0a4c tempest-VolumesServicesTestJSON-1205899204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f152c790-86e3-491c-b74d-2f07a75b7a51" returned: 0 in 0.367s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ddf66083-0be2-4eb5-9ec0-f12cc6eb0a4c tempest-VolumesServicesTestJSON-1205899204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f152c790-86e3-491c-b74d-2f07a75b7a51 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:00 devstack sudo[100639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f152c790-86e3-491c-b74d-2f07a75b7a51 Aug 11 04:42:00 devstack sudo[100639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:01 devstack sudo[100639]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ddf66083-0be2-4eb5-9ec0-f12cc6eb0a4c tempest-VolumesServicesTestJSON-1205899204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f152c790-86e3-491c-b74d-2f07a75b7a51" returned: 0 in 0.307s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:01 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ddf66083-0be2-4eb5-9ec0-f12cc6eb0a4c tempest-VolumesServicesTestJSON-1205899204 None] Lock "cinder-quobyte-f152c790-86e3-491c-b74d-2f07a75b7a51" released by "delete_volume" :: held 0.731s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:42:01 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-ddf66083-0be2-4eb5-9ec0-f12cc6eb0a4c tempest-VolumesServicesTestJSON-1205899204 None] Created reservations ['9ebefe11-eceb-4f63-8d85-c2fcb184299e', '983dd30b-aa52-4153-bc97-768e6a2d2da2', '542ea82e-a3eb-4880-8c48-dd10178a976a', 'cf70c749-2e25-4252-a853-49d42c86c3f3'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:42:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-129dee74-7c3c-43ee-9d83-7acb503cbade tempest-SnapshotsActionsTest-2089057445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:42:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-129dee74-7c3c-43ee-9d83-7acb503cbade tempest-SnapshotsActionsTest-2089057445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:42:01 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-129dee74-7c3c-43ee-9d83-7acb503cbade tempest-SnapshotsActionsTest-2089057445 None] Creating offline snapshot 383635b0-1ce4-4969-b38d-4be5f39125ce of volume b359c8b6-61e9-44af-a5a4-4ff6da4d6783 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 04:42:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ddf66083-0be2-4eb5-9ec0-f12cc6eb0a4c tempest-VolumesServicesTestJSON-1205899204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:42:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ddf66083-0be2-4eb5-9ec0-f12cc6eb0a4c tempest-VolumesServicesTestJSON-1205899204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:42:01 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ddf66083-0be2-4eb5-9ec0-f12cc6eb0a4c tempest-VolumesServicesTestJSON-1205899204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:42:01 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ddf66083-0be2-4eb5-9ec0-f12cc6eb0a4c tempest-VolumesServicesTestJSON-1205899204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:42:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ddf66083-0be2-4eb5-9ec0-f12cc6eb0a4c tempest-VolumesServicesTestJSON-1205899204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:42:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ddf66083-0be2-4eb5-9ec0-f12cc6eb0a4c tempest-VolumesServicesTestJSON-1205899204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:01 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[26eef0af-bf44-49e8-a04f-14cfb9a23071]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:42:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-129dee74-7c3c-43ee-9d83-7acb503cbade tempest-SnapshotsActionsTest-2089057445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:01 devstack sudo[100642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:42:01 devstack sudo[100642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:01 devstack sudo[100643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b Aug 11 04:42:01 devstack sudo[100643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:01 devstack sudo[100642]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ddf66083-0be2-4eb5-9ec0-f12cc6eb0a4c tempest-VolumesServicesTestJSON-1205899204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.302s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:01 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-ddf66083-0be2-4eb5-9ec0-f12cc6eb0a4c tempest-VolumesServicesTestJSON-1205899204 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:42:01 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-ddf66083-0be2-4eb5-9ec0-f12cc6eb0a4c tempest-VolumesServicesTestJSON-1205899204 None] Deleted volume successfully. Aug 11 04:42:01 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ddf66083-0be2-4eb5-9ec0-f12cc6eb0a4c tempest-VolumesServicesTestJSON-1205899204 None] Lock "cinder-f152c790-86e3-491c-b74d-2f07a75b7a51-delete_volume" released by "delete_volume" :: held 1.332s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:42:01 devstack sudo[100643]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-129dee74-7c3c-43ee-9d83-7acb503cbade tempest-SnapshotsActionsTest-2089057445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b" returned: 0 in 0.474s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:01 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-129dee74-7c3c-43ee-9d83-7acb503cbade tempest-SnapshotsActionsTest-2089057445 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:42:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-129dee74-7c3c-43ee-9d83-7acb503cbade tempest-SnapshotsActionsTest-2089057445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.383635b0-1ce4-4969-b38d-4be5f39125ce 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:01 devstack sudo[100650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.383635b0-1ce4-4969-b38d-4be5f39125ce 1G Aug 11 04:42:01 devstack sudo[100650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:02 devstack sudo[100650]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-129dee74-7c3c-43ee-9d83-7acb503cbade tempest-SnapshotsActionsTest-2089057445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.383635b0-1ce4-4969-b38d-4be5f39125ce 1G" returned: 0 in 0.550s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-129dee74-7c3c-43ee-9d83-7acb503cbade tempest-SnapshotsActionsTest-2089057445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.383635b0-1ce4-4969-b38d-4be5f39125ce {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:02 devstack sudo[100655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.383635b0-1ce4-4969-b38d-4be5f39125ce Aug 11 04:42:02 devstack sudo[100655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:02 devstack sudo[100655]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-129dee74-7c3c-43ee-9d83-7acb503cbade tempest-SnapshotsActionsTest-2089057445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.383635b0-1ce4-4969-b38d-4be5f39125ce" returned: 0 in 0.309s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:02 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-129dee74-7c3c-43ee-9d83-7acb503cbade tempest-SnapshotsActionsTest-2089057445 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.383635b0-1ce4-4969-b38d-4be5f39125ce is being set with open permissions: ugo+rw Aug 11 04:42:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-129dee74-7c3c-43ee-9d83-7acb503cbade tempest-SnapshotsActionsTest-2089057445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.383635b0-1ce4-4969-b38d-4be5f39125ce {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:02 devstack sudo[100661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.383635b0-1ce4-4969-b38d-4be5f39125ce Aug 11 04:42:02 devstack sudo[100661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:02 devstack sudo[100661]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-129dee74-7c3c-43ee-9d83-7acb503cbade tempest-SnapshotsActionsTest-2089057445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.383635b0-1ce4-4969-b38d-4be5f39125ce" returned: 0 in 0.283s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-129dee74-7c3c-43ee-9d83-7acb503cbade tempest-SnapshotsActionsTest-2089057445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.741s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:42:03 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-129dee74-7c3c-43ee-9d83-7acb503cbade tempest-SnapshotsActionsTest-2089057445 None] Create snapshot completed successfully Aug 11 04:42:03 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-87fc118e-adc4-4689-8fd3-0f40d9c73eb8 tempest-SnapshotsActionsTest-966804718 None] Acquiring lock "cinder-383635b0-1ce4-4969-b38d-4be5f39125ce-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:42:03 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-87fc118e-adc4-4689-8fd3-0f40d9c73eb8 tempest-SnapshotsActionsTest-966804718 None] Lock "cinder-383635b0-1ce4-4969-b38d-4be5f39125ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:42:03 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-87fc118e-adc4-4689-8fd3-0f40d9c73eb8 tempest-SnapshotsActionsTest-966804718 None] Acquiring lock "cinder-quobyte-b359c8b6-61e9-44af-a5a4-4ff6da4d6783" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:42:03 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-87fc118e-adc4-4689-8fd3-0f40d9c73eb8 tempest-SnapshotsActionsTest-966804718 None] Lock "cinder-quobyte-b359c8b6-61e9-44af-a5a4-4ff6da4d6783" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:42:03 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-87fc118e-adc4-4689-8fd3-0f40d9c73eb8 tempest-SnapshotsActionsTest-966804718 None] Acquiring lock "cinder-quobyte-383635b0-1ce4-4969-b38d-4be5f39125ce" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:42:03 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-87fc118e-adc4-4689-8fd3-0f40d9c73eb8 tempest-SnapshotsActionsTest-966804718 None] Lock "cinder-quobyte-383635b0-1ce4-4969-b38d-4be5f39125ce" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:42:03 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-87fc118e-adc4-4689-8fd3-0f40d9c73eb8 tempest-SnapshotsActionsTest-966804718 None] Deleting offline snapshot 383635b0-1ce4-4969-b38d-4be5f39125ce of volume b359c8b6-61e9-44af-a5a4-4ff6da4d6783 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 04:42:03 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-87fc118e-adc4-4689-8fd3-0f40d9c73eb8 tempest-SnapshotsActionsTest-966804718 None] snapshot_file for this snap is: volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.383635b0-1ce4-4969-b38d-4be5f39125ce {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 04:42:03 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc819cb4-7164-49a2-9067-845258bd6a06]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:42:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87fc118e-adc4-4689-8fd3-0f40d9c73eb8 tempest-SnapshotsActionsTest-966804718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.383635b0-1ce4-4969-b38d-4be5f39125ce {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:03 devstack sudo[100665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.383635b0-1ce4-4969-b38d-4be5f39125ce Aug 11 04:42:03 devstack sudo[100665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:03 devstack sudo[100665]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87fc118e-adc4-4689-8fd3-0f40d9c73eb8 tempest-SnapshotsActionsTest-966804718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.383635b0-1ce4-4969-b38d-4be5f39125ce" returned: 0 in 0.403s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:03 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-87fc118e-adc4-4689-8fd3-0f40d9c73eb8 tempest-SnapshotsActionsTest-966804718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:42:04 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbff4dc-d174-4964-ac7a-20bec93c8b59]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:42:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87fc118e-adc4-4689-8fd3-0f40d9c73eb8 tempest-SnapshotsActionsTest-966804718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:04 devstack sudo[100670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b Aug 11 04:42:04 devstack sudo[100670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:04 devstack sudo[100670]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87fc118e-adc4-4689-8fd3-0f40d9c73eb8 tempest-SnapshotsActionsTest-966804718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b" returned: 0 in 0.409s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:04 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-87fc118e-adc4-4689-8fd3-0f40d9c73eb8 tempest-SnapshotsActionsTest-966804718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:42:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87fc118e-adc4-4689-8fd3-0f40d9c73eb8 tempest-SnapshotsActionsTest-966804718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.383635b0-1ce4-4969-b38d-4be5f39125ce {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:04 devstack sudo[100675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.383635b0-1ce4-4969-b38d-4be5f39125ce Aug 11 04:42:04 devstack sudo[100675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:04 devstack sudo[100675]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87fc118e-adc4-4689-8fd3-0f40d9c73eb8 tempest-SnapshotsActionsTest-966804718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.383635b0-1ce4-4969-b38d-4be5f39125ce" returned: 0 in 0.448s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87fc118e-adc4-4689-8fd3-0f40d9c73eb8 tempest-SnapshotsActionsTest-966804718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.383635b0-1ce4-4969-b38d-4be5f39125ce {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:04 devstack sudo[100680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.383635b0-1ce4-4969-b38d-4be5f39125ce Aug 11 04:42:04 devstack sudo[100680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:05 devstack sudo[100680]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87fc118e-adc4-4689-8fd3-0f40d9c73eb8 tempest-SnapshotsActionsTest-966804718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.383635b0-1ce4-4969-b38d-4be5f39125ce" returned: 0 in 0.316s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:05 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-87fc118e-adc4-4689-8fd3-0f40d9c73eb8 tempest-SnapshotsActionsTest-966804718 None] Lock "cinder-quobyte-383635b0-1ce4-4969-b38d-4be5f39125ce" released by "_delete_snapshot" :: held 1.697s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:42:05 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-87fc118e-adc4-4689-8fd3-0f40d9c73eb8 tempest-SnapshotsActionsTest-966804718 None] Lock "cinder-quobyte-b359c8b6-61e9-44af-a5a4-4ff6da4d6783" released by "delete_snapshot" :: held 1.719s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:42:05 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-87fc118e-adc4-4689-8fd3-0f40d9c73eb8 tempest-SnapshotsActionsTest-966804718 None] Created reservations ['2745e19d-3583-423d-ba01-533f98d3c297', 'a423a545-d0ac-4a53-b0ee-55fbfa65e3c1', 'd4a9c3c3-f70c-44fd-9a73-7de1d418eac9', '8568cfd9-bb41-4047-83d7-e5968a999d8c'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:42:05 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-87fc118e-adc4-4689-8fd3-0f40d9c73eb8 tempest-SnapshotsActionsTest-966804718 None] Delete snapshot completed successfully. Aug 11 04:42:05 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-87fc118e-adc4-4689-8fd3-0f40d9c73eb8 tempest-SnapshotsActionsTest-966804718 None] Lock "cinder-383635b0-1ce4-4969-b38d-4be5f39125ce-delete_snapshot" released by "delete_snapshot" :: held 1.899s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:42:06 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b34114e3-bb2e-46ff-a4ad-b5afc95892be tempest-SnapshotsActionsTest-2089057445 None] Acquiring lock "cinder-80fe623f-7dce-40fb-999e-3a5a6a74ee8b-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:42:06 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b34114e3-bb2e-46ff-a4ad-b5afc95892be tempest-SnapshotsActionsTest-2089057445 None] Lock "cinder-80fe623f-7dce-40fb-999e-3a5a6a74ee8b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:42:06 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b34114e3-bb2e-46ff-a4ad-b5afc95892be tempest-SnapshotsActionsTest-2089057445 None] Acquiring lock "cinder-quobyte-b359c8b6-61e9-44af-a5a4-4ff6da4d6783" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:42:06 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b34114e3-bb2e-46ff-a4ad-b5afc95892be tempest-SnapshotsActionsTest-2089057445 None] Lock "cinder-quobyte-b359c8b6-61e9-44af-a5a4-4ff6da4d6783" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:42:06 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b34114e3-bb2e-46ff-a4ad-b5afc95892be tempest-SnapshotsActionsTest-2089057445 None] Acquiring lock "cinder-quobyte-80fe623f-7dce-40fb-999e-3a5a6a74ee8b" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:42:06 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b34114e3-bb2e-46ff-a4ad-b5afc95892be tempest-SnapshotsActionsTest-2089057445 None] Lock "cinder-quobyte-80fe623f-7dce-40fb-999e-3a5a6a74ee8b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:42:06 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-b34114e3-bb2e-46ff-a4ad-b5afc95892be tempest-SnapshotsActionsTest-2089057445 None] Deleting offline snapshot 80fe623f-7dce-40fb-999e-3a5a6a74ee8b of volume b359c8b6-61e9-44af-a5a4-4ff6da4d6783 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 04:42:06 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-b34114e3-bb2e-46ff-a4ad-b5afc95892be tempest-SnapshotsActionsTest-2089057445 None] snapshot_file for this snap is: volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 04:42:06 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[59cb59cd-d39e-4d06-9261-69dcde8ce60d]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:42:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b34114e3-bb2e-46ff-a4ad-b5afc95892be tempest-SnapshotsActionsTest-2089057445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:06 devstack sudo[100683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b Aug 11 04:42:06 devstack sudo[100683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:06 devstack sudo[100683]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b34114e3-bb2e-46ff-a4ad-b5afc95892be tempest-SnapshotsActionsTest-2089057445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b" returned: 0 in 0.405s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:06 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-b34114e3-bb2e-46ff-a4ad-b5afc95892be tempest-SnapshotsActionsTest-2089057445 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:42:06 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ffe2a4-9cc7-41b0-bdca-dcf61a46150e]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:42:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b34114e3-bb2e-46ff-a4ad-b5afc95892be tempest-SnapshotsActionsTest-2089057445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:06 devstack sudo[100689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783 Aug 11 04:42:06 devstack sudo[100689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:07 devstack sudo[100689]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b34114e3-bb2e-46ff-a4ad-b5afc95892be tempest-SnapshotsActionsTest-2089057445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783" returned: 0 in 0.433s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b34114e3-bb2e-46ff-a4ad-b5afc95892be tempest-SnapshotsActionsTest-2089057445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:07 devstack sudo[100694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b Aug 11 04:42:07 devstack sudo[100694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:07 devstack sudo[100694]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b34114e3-bb2e-46ff-a4ad-b5afc95892be tempest-SnapshotsActionsTest-2089057445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b" returned: 0 in 0.642s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b34114e3-bb2e-46ff-a4ad-b5afc95892be tempest-SnapshotsActionsTest-2089057445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:07 devstack sudo[100699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b Aug 11 04:42:07 devstack sudo[100699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:08 devstack sudo[100699]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b34114e3-bb2e-46ff-a4ad-b5afc95892be tempest-SnapshotsActionsTest-2089057445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783.80fe623f-7dce-40fb-999e-3a5a6a74ee8b" returned: 0 in 0.352s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:08 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b34114e3-bb2e-46ff-a4ad-b5afc95892be tempest-SnapshotsActionsTest-2089057445 None] Lock "cinder-quobyte-80fe623f-7dce-40fb-999e-3a5a6a74ee8b" released by "_delete_snapshot" :: held 2.002s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:42:08 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b34114e3-bb2e-46ff-a4ad-b5afc95892be tempest-SnapshotsActionsTest-2089057445 None] Lock "cinder-quobyte-b359c8b6-61e9-44af-a5a4-4ff6da4d6783" released by "delete_snapshot" :: held 2.032s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:42:08 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-b34114e3-bb2e-46ff-a4ad-b5afc95892be tempest-SnapshotsActionsTest-2089057445 None] Created reservations ['d7aa140b-0dd7-4978-871c-b495bbfe0424', '2eb9dba6-fb97-4722-8deb-bb88e007731e', '32d4ad36-1d56-4f76-b0aa-623bbb95fe80', 'dc22ea08-f8ee-4b4d-8652-d10070095b08'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:42:08 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-b34114e3-bb2e-46ff-a4ad-b5afc95892be tempest-SnapshotsActionsTest-2089057445 None] Delete snapshot completed successfully. Aug 11 04:42:08 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b34114e3-bb2e-46ff-a4ad-b5afc95892be tempest-SnapshotsActionsTest-2089057445 None] Lock "cinder-80fe623f-7dce-40fb-999e-3a5a6a74ee8b-delete_snapshot" released by "delete_snapshot" :: held 2.253s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:42:08 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-b71e8409-1ac8-4a5d-9fb8-ca87773370c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:42:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b71e8409-1ac8-4a5d-9fb8-ca87773370c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Flow 'volume_create_manager' (f8cbf1d0-4fe1-4905-a5f6-57dcc3dee18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:42:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b71e8409-1ac8-4a5d-9fb8-ca87773370c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b3fe9f0-aa13-41e7-8b39-a7f00d51c727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b71e8409-1ac8-4a5d-9fb8-ca87773370c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b3fe9f0-aa13-41e7-8b39-a7f00d51c727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:42:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-30614603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e00235d-3861-403a-afd4-6db7e5f9e890,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddf89670d6a247a0b4ec8fdd5c95253f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:42:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:42:08Z,use_quota=True,user_id='6cad3da99ead4eb094a4452acbbd845a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b71e8409-1ac8-4a5d-9fb8-ca87773370c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f7dcb53-d9e5-4638-a03b-f553d7fcfeb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b71e8409-1ac8-4a5d-9fb8-ca87773370c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f7dcb53-d9e5-4638-a03b-f553d7fcfeb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b71e8409-1ac8-4a5d-9fb8-ca87773370c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a45393e-6d51-4c0d-97b0-db7f1e42a215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b71e8409-1ac8-4a5d-9fb8-ca87773370c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a45393e-6d51-4c0d-97b0-db7f1e42a215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e00235d-3861-403a-afd4-6db7e5f9e890', 'volume_name': 'volume-7e00235d-3861-403a-afd4-6db7e5f9e890', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b71e8409-1ac8-4a5d-9fb8-ca87773370c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bf1e05f-ff74-4d89-bc20-0086da822705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b71e8409-1ac8-4a5d-9fb8-ca87773370c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bf1e05f-ff74-4d89-bc20-0086da822705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b71e8409-1ac8-4a5d-9fb8-ca87773370c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (023ff65d-2e2b-46b8-9500-db9611e850b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:08 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-b71e8409-1ac8-4a5d-9fb8-ca87773370c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Volume 7e00235d-3861-403a-afd4-6db7e5f9e890: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e00235d-3861-403a-afd4-6db7e5f9e890', 'volume_size': 1} Aug 11 04:42:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b71e8409-1ac8-4a5d-9fb8-ca87773370c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:42:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b71e8409-1ac8-4a5d-9fb8-ca87773370c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:42:08 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b71e8409-1ac8-4a5d-9fb8-ca87773370c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:42:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-30614603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e00235d-3861-403a-afd4-6db7e5f9e890,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddf89670d6a247a0b4ec8fdd5c95253f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:42:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:42:08Z,use_quota=True,user_id='6cad3da99ead4eb094a4452acbbd845a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:42:08 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-b71e8409-1ac8-4a5d-9fb8-ca87773370c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Creating volume 7e00235d-3861-403a-afd4-6db7e5f9e890 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:42:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b71e8409-1ac8-4a5d-9fb8-ca87773370c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:42:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b71e8409-1ac8-4a5d-9fb8-ca87773370c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:42:08 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b71e8409-1ac8-4a5d-9fb8-ca87773370c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:42:08 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b71e8409-1ac8-4a5d-9fb8-ca87773370c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:42:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b71e8409-1ac8-4a5d-9fb8-ca87773370c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:42:08 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b71e8409-1ac8-4a5d-9fb8-ca87773370c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:42:08 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-b71e8409-1ac8-4a5d-9fb8-ca87773370c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:42:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b71e8409-1ac8-4a5d-9fb8-ca87773370c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7e00235d-3861-403a-afd4-6db7e5f9e890 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:08 devstack sudo[100702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7e00235d-3861-403a-afd4-6db7e5f9e890 1073741824 Aug 11 04:42:08 devstack sudo[100702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:09 devstack sudo[100702]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b71e8409-1ac8-4a5d-9fb8-ca87773370c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7e00235d-3861-403a-afd4-6db7e5f9e890 1073741824" returned: 0 in 0.522s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b71e8409-1ac8-4a5d-9fb8-ca87773370c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7e00235d-3861-403a-afd4-6db7e5f9e890 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:09 devstack sudo[100708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7e00235d-3861-403a-afd4-6db7e5f9e890 Aug 11 04:42:09 devstack sudo[100708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:09 devstack sudo[100708]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b71e8409-1ac8-4a5d-9fb8-ca87773370c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7e00235d-3861-403a-afd4-6db7e5f9e890" returned: 0 in 0.338s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b71e8409-1ac8-4a5d-9fb8-ca87773370c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:42:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b71e8409-1ac8-4a5d-9fb8-ca87773370c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:42:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b71e8409-1ac8-4a5d-9fb8-ca87773370c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (023ff65d-2e2b-46b8-9500-db9611e850b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e00235d-3861-403a-afd4-6db7e5f9e890', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b71e8409-1ac8-4a5d-9fb8-ca87773370c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9852787a-0384-41a1-b369-5de87917cd76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:09 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-b71e8409-1ac8-4a5d-9fb8-ca87773370c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Volume volume-7e00235d-3861-403a-afd4-6db7e5f9e890 (7e00235d-3861-403a-afd4-6db7e5f9e890): created successfully Aug 11 04:42:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b71e8409-1ac8-4a5d-9fb8-ca87773370c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9852787a-0384-41a1-b369-5de87917cd76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b71e8409-1ac8-4a5d-9fb8-ca87773370c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Flow 'volume_create_manager' (f8cbf1d0-4fe1-4905-a5f6-57dcc3dee18c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:42:09 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-263168dd-aa12-47c7-a728-f54542394a15 tempest-SnapshotsActionsTest-2089057445 None] Acquiring lock "cinder-b359c8b6-61e9-44af-a5a4-4ff6da4d6783-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:42:09 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-b71e8409-1ac8-4a5d-9fb8-ca87773370c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Created volume successfully. Aug 11 04:42:09 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-263168dd-aa12-47c7-a728-f54542394a15 tempest-SnapshotsActionsTest-2089057445 None] Lock "cinder-b359c8b6-61e9-44af-a5a4-4ff6da4d6783-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:42:09 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-263168dd-aa12-47c7-a728-f54542394a15 tempest-SnapshotsActionsTest-2089057445 None] Acquiring lock "cinder-quobyte-b359c8b6-61e9-44af-a5a4-4ff6da4d6783" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:42:09 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-263168dd-aa12-47c7-a728-f54542394a15 tempest-SnapshotsActionsTest-2089057445 None] Lock "cinder-quobyte-b359c8b6-61e9-44af-a5a4-4ff6da4d6783" acquired by "delete_volume" :: waited 0.018s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:42:09 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[4266ebd5-1130-4934-81ab-959b76f36946]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:42:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-263168dd-aa12-47c7-a728-f54542394a15 tempest-SnapshotsActionsTest-2089057445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:09 devstack sudo[100747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783 Aug 11 04:42:09 devstack sudo[100747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:09 devstack sudo[100747]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-263168dd-aa12-47c7-a728-f54542394a15 tempest-SnapshotsActionsTest-2089057445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783" returned: 0 in 0.373s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-263168dd-aa12-47c7-a728-f54542394a15 tempest-SnapshotsActionsTest-2089057445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:10 devstack sudo[100752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783 Aug 11 04:42:10 devstack sudo[100752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:10 devstack sudo[100752]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-263168dd-aa12-47c7-a728-f54542394a15 tempest-SnapshotsActionsTest-2089057445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b359c8b6-61e9-44af-a5a4-4ff6da4d6783" returned: 0 in 0.247s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-263168dd-aa12-47c7-a728-f54542394a15 tempest-SnapshotsActionsTest-2089057445 None] Lock "cinder-quobyte-b359c8b6-61e9-44af-a5a4-4ff6da4d6783" released by "delete_volume" :: held 0.683s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:42:10 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-263168dd-aa12-47c7-a728-f54542394a15 tempest-SnapshotsActionsTest-2089057445 None] Created reservations ['645835f1-2429-4238-ad71-d8206bef1dfe', '1fa2a20a-264c-469d-b250-62c5a4d5371a', 'bc69a515-7405-4ebe-bc4b-72a6dd082812', 'fabf1099-aa9c-47c0-a0e3-ffbbae02b835'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:42:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-263168dd-aa12-47c7-a728-f54542394a15 tempest-SnapshotsActionsTest-2089057445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:42:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-263168dd-aa12-47c7-a728-f54542394a15 tempest-SnapshotsActionsTest-2089057445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:42:10 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-263168dd-aa12-47c7-a728-f54542394a15 tempest-SnapshotsActionsTest-2089057445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:42:10 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-263168dd-aa12-47c7-a728-f54542394a15 tempest-SnapshotsActionsTest-2089057445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:42:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-263168dd-aa12-47c7-a728-f54542394a15 tempest-SnapshotsActionsTest-2089057445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:42:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-263168dd-aa12-47c7-a728-f54542394a15 tempest-SnapshotsActionsTest-2089057445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:10 devstack sudo[100755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:42:10 devstack sudo[100755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:10 devstack sudo[100755]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-263168dd-aa12-47c7-a728-f54542394a15 tempest-SnapshotsActionsTest-2089057445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.333s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:10 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-263168dd-aa12-47c7-a728-f54542394a15 tempest-SnapshotsActionsTest-2089057445 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:42:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7b7d045a-113d-4611-b46e-3562b668c424 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:42:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7b7d045a-113d-4611-b46e-3562b668c424 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:42:10 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-263168dd-aa12-47c7-a728-f54542394a15 tempest-SnapshotsActionsTest-2089057445 None] Deleted volume successfully. Aug 11 04:42:10 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-7b7d045a-113d-4611-b46e-3562b668c424 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Creating offline snapshot adab9e12-302c-411a-afb0-d6dd373f5b8d of volume 7e00235d-3861-403a-afd4-6db7e5f9e890 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 04:42:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-263168dd-aa12-47c7-a728-f54542394a15 tempest-SnapshotsActionsTest-2089057445 None] Lock "cinder-b359c8b6-61e9-44af-a5a4-4ff6da4d6783-delete_volume" released by "delete_volume" :: held 1.261s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:42:10 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[124be6bc-fea5-4504-ad12-1e2f140243c7]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:42:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7b7d045a-113d-4611-b46e-3562b668c424 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7e00235d-3861-403a-afd4-6db7e5f9e890 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:10 devstack sudo[100761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7e00235d-3861-403a-afd4-6db7e5f9e890 Aug 11 04:42:10 devstack sudo[100761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:11 devstack sudo[100761]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7b7d045a-113d-4611-b46e-3562b668c424 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7e00235d-3861-403a-afd4-6db7e5f9e890" returned: 0 in 0.455s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7b7d045a-113d-4611-b46e-3562b668c424 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7e00235d-3861-403a-afd4-6db7e5f9e890,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7e00235d-3861-403a-afd4-6db7e5f9e890.adab9e12-302c-411a-afb0-d6dd373f5b8d 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:11 devstack sudo[100766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7e00235d-3861-403a-afd4-6db7e5f9e890,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7e00235d-3861-403a-afd4-6db7e5f9e890.adab9e12-302c-411a-afb0-d6dd373f5b8d 1G Aug 11 04:42:11 devstack sudo[100766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:11 devstack sudo[100766]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7b7d045a-113d-4611-b46e-3562b668c424 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7e00235d-3861-403a-afd4-6db7e5f9e890,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7e00235d-3861-403a-afd4-6db7e5f9e890.adab9e12-302c-411a-afb0-d6dd373f5b8d 1G" returned: 0 in 0.582s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7b7d045a-113d-4611-b46e-3562b668c424 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e00235d-3861-403a-afd4-6db7e5f9e890 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7e00235d-3861-403a-afd4-6db7e5f9e890.adab9e12-302c-411a-afb0-d6dd373f5b8d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:11 devstack sudo[100774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e00235d-3861-403a-afd4-6db7e5f9e890 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7e00235d-3861-403a-afd4-6db7e5f9e890.adab9e12-302c-411a-afb0-d6dd373f5b8d Aug 11 04:42:11 devstack sudo[100774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:12 devstack sudo[100774]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7b7d045a-113d-4611-b46e-3562b668c424 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e00235d-3861-403a-afd4-6db7e5f9e890 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7e00235d-3861-403a-afd4-6db7e5f9e890.adab9e12-302c-411a-afb0-d6dd373f5b8d" returned: 0 in 0.424s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:12 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-7b7d045a-113d-4611-b46e-3562b668c424 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7e00235d-3861-403a-afd4-6db7e5f9e890.adab9e12-302c-411a-afb0-d6dd373f5b8d is being set with open permissions: ugo+rw Aug 11 04:42:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7b7d045a-113d-4611-b46e-3562b668c424 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7e00235d-3861-403a-afd4-6db7e5f9e890.adab9e12-302c-411a-afb0-d6dd373f5b8d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:12 devstack sudo[100782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7e00235d-3861-403a-afd4-6db7e5f9e890.adab9e12-302c-411a-afb0-d6dd373f5b8d Aug 11 04:42:12 devstack sudo[100782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:12 devstack sudo[100782]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7b7d045a-113d-4611-b46e-3562b668c424 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7e00235d-3861-403a-afd4-6db7e5f9e890.adab9e12-302c-411a-afb0-d6dd373f5b8d" returned: 0 in 0.318s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7b7d045a-113d-4611-b46e-3562b668c424 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7e00235d-3861-403a-afd4-6db7e5f9e890.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:12 devstack sudo[100787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7e00235d-3861-403a-afd4-6db7e5f9e890.info Aug 11 04:42:12 devstack sudo[100787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-c2d7d5d2-95a1-4b9e-909d-bbd58b4edbce req-adbfb6b9-7509-42fb-961f-5fe49bca1aef tempest-ServerActionsTestOtherA-1583977559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:42:12 devstack sudo[100787]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7b7d045a-113d-4611-b46e-3562b668c424 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7e00235d-3861-403a-afd4-6db7e5f9e890.info" returned: 0 in 0.301s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:12 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-7b7d045a-113d-4611-b46e-3562b668c424 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7e00235d-3861-403a-afd4-6db7e5f9e890.info is being set with open permissions: ugo+rw Aug 11 04:42:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7b7d045a-113d-4611-b46e-3562b668c424 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7e00235d-3861-403a-afd4-6db7e5f9e890.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:12 devstack sudo[100798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7e00235d-3861-403a-afd4-6db7e5f9e890.info Aug 11 04:42:12 devstack sudo[100798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:13 devstack sudo[100798]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7b7d045a-113d-4611-b46e-3562b668c424 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7e00235d-3861-403a-afd4-6db7e5f9e890.info" returned: 0 in 0.273s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7b7d045a-113d-4611-b46e-3562b668c424 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.488s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:42:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-c2d7d5d2-95a1-4b9e-909d-bbd58b4edbce req-adbfb6b9-7509-42fb-961f-5fe49bca1aef tempest-ServerActionsTestOtherA-1583977559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.380s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:42:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-c2d7d5d2-95a1-4b9e-909d-bbd58b4edbce req-adbfb6b9-7509-42fb-961f-5fe49bca1aef tempest-ServerActionsTestOtherA-1583977559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:42:13 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-7b7d045a-113d-4611-b46e-3562b668c424 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Create snapshot completed successfully Aug 11 04:42:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-c2d7d5d2-95a1-4b9e-909d-bbd58b4edbce req-adbfb6b9-7509-42fb-961f-5fe49bca1aef tempest-ServerActionsTestOtherA-1583977559 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd', 'name': 'volume-499eda1c-589a-4063-9f23-453e0c821c80', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '77abf8fc-f0e9-4e2a-bf3b-1ec110754f60', 'enforce_multipath': True} {{(pid=94472) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 11 04:42:13 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-c2d7d5d2-95a1-4b9e-909d-bbd58b4edbce req-adbfb6b9-7509-42fb-961f-5fe49bca1aef tempest-ServerActionsTestOtherA-1583977559 None] attachment_update completed successfully. Aug 11 04:42:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-94c95c5e-2fc6-429f-a4da-814ce6045317 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Acquiring lock "cinder-adab9e12-302c-411a-afb0-d6dd373f5b8d-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:42:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-94c95c5e-2fc6-429f-a4da-814ce6045317 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Lock "cinder-adab9e12-302c-411a-afb0-d6dd373f5b8d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:42:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-94c95c5e-2fc6-429f-a4da-814ce6045317 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Acquiring lock "cinder-quobyte-7e00235d-3861-403a-afd4-6db7e5f9e890" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:42:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-94c95c5e-2fc6-429f-a4da-814ce6045317 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Lock "cinder-quobyte-7e00235d-3861-403a-afd4-6db7e5f9e890" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:42:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-94c95c5e-2fc6-429f-a4da-814ce6045317 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Acquiring lock "cinder-quobyte-adab9e12-302c-411a-afb0-d6dd373f5b8d" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:42:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-94c95c5e-2fc6-429f-a4da-814ce6045317 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Lock "cinder-quobyte-adab9e12-302c-411a-afb0-d6dd373f5b8d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:42:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-94c95c5e-2fc6-429f-a4da-814ce6045317 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Deleting offline snapshot adab9e12-302c-411a-afb0-d6dd373f5b8d of volume 7e00235d-3861-403a-afd4-6db7e5f9e890 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 04:42:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-94c95c5e-2fc6-429f-a4da-814ce6045317 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] snapshot_file for this snap is: volume-7e00235d-3861-403a-afd4-6db7e5f9e890.adab9e12-302c-411a-afb0-d6dd373f5b8d {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 04:42:14 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c065db1-1e54-498e-acfa-65a73d190c25]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:42:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-94c95c5e-2fc6-429f-a4da-814ce6045317 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7e00235d-3861-403a-afd4-6db7e5f9e890.adab9e12-302c-411a-afb0-d6dd373f5b8d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:14 devstack sudo[101186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7e00235d-3861-403a-afd4-6db7e5f9e890.adab9e12-302c-411a-afb0-d6dd373f5b8d Aug 11 04:42:14 devstack sudo[101186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:15 devstack sudo[101186]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-94c95c5e-2fc6-429f-a4da-814ce6045317 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7e00235d-3861-403a-afd4-6db7e5f9e890.adab9e12-302c-411a-afb0-d6dd373f5b8d" returned: 0 in 0.427s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-94c95c5e-2fc6-429f-a4da-814ce6045317 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e00235d-3861-403a-afd4-6db7e5f9e890(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:42:15 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6dc834-bf70-40c6-bcf4-b30859af7f4f]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:42:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-94c95c5e-2fc6-429f-a4da-814ce6045317 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7e00235d-3861-403a-afd4-6db7e5f9e890 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:15 devstack sudo[101191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7e00235d-3861-403a-afd4-6db7e5f9e890 Aug 11 04:42:15 devstack sudo[101191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:15 devstack sudo[101191]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-94c95c5e-2fc6-429f-a4da-814ce6045317 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7e00235d-3861-403a-afd4-6db7e5f9e890" returned: 0 in 0.432s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-94c95c5e-2fc6-429f-a4da-814ce6045317 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7e00235d-3861-403a-afd4-6db7e5f9e890.adab9e12-302c-411a-afb0-d6dd373f5b8d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:15 devstack sudo[101196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7e00235d-3861-403a-afd4-6db7e5f9e890.adab9e12-302c-411a-afb0-d6dd373f5b8d Aug 11 04:42:15 devstack sudo[101196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:16 devstack sudo[101196]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-94c95c5e-2fc6-429f-a4da-814ce6045317 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7e00235d-3861-403a-afd4-6db7e5f9e890.adab9e12-302c-411a-afb0-d6dd373f5b8d" returned: 0 in 0.593s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-94c95c5e-2fc6-429f-a4da-814ce6045317 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7e00235d-3861-403a-afd4-6db7e5f9e890.adab9e12-302c-411a-afb0-d6dd373f5b8d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:16 devstack sudo[101205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7e00235d-3861-403a-afd4-6db7e5f9e890.adab9e12-302c-411a-afb0-d6dd373f5b8d Aug 11 04:42:16 devstack sudo[101205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:16 devstack sudo[101205]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-94c95c5e-2fc6-429f-a4da-814ce6045317 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7e00235d-3861-403a-afd4-6db7e5f9e890.adab9e12-302c-411a-afb0-d6dd373f5b8d" returned: 0 in 0.297s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:16 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-94c95c5e-2fc6-429f-a4da-814ce6045317 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Lock "cinder-quobyte-adab9e12-302c-411a-afb0-d6dd373f5b8d" released by "_delete_snapshot" :: held 1.888s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:42:16 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-94c95c5e-2fc6-429f-a4da-814ce6045317 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Lock "cinder-quobyte-7e00235d-3861-403a-afd4-6db7e5f9e890" released by "delete_snapshot" :: held 1.920s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:42:16 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-94c95c5e-2fc6-429f-a4da-814ce6045317 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Created reservations ['d7ff2385-1437-4602-9357-d9d20f01bea1', '0e9fd281-5315-4106-9d58-7ad301253f81', 'd79d4e75-f554-4b82-8d37-9f9804eb7811', '400ded16-cf2b-4e89-b28b-3dbc62aa277f'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:42:16 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-94c95c5e-2fc6-429f-a4da-814ce6045317 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Delete snapshot completed successfully. Aug 11 04:42:16 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-94c95c5e-2fc6-429f-a4da-814ce6045317 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Lock "cinder-adab9e12-302c-411a-afb0-d6dd373f5b8d-delete_snapshot" released by "delete_snapshot" :: held 2.118s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:42:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e9109258-fb6f-437a-b623-5e51f86ad5c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Acquiring lock "cinder-7e00235d-3861-403a-afd4-6db7e5f9e890-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:42:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e9109258-fb6f-437a-b623-5e51f86ad5c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Lock "cinder-7e00235d-3861-403a-afd4-6db7e5f9e890-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:42:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e9109258-fb6f-437a-b623-5e51f86ad5c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Acquiring lock "cinder-quobyte-7e00235d-3861-403a-afd4-6db7e5f9e890" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:42:17 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-401c83ad-aabb-4f23-aa0e-292063913155 req-28f74a91-70f7-448c-860f-b04a92a0a813 tempest-ServerActionsTestOtherA-1583977559 None] Terminate volume connection completed successfully. Aug 11 04:42:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-401c83ad-aabb-4f23-aa0e-292063913155 req-28f74a91-70f7-448c-860f-b04a92a0a813 tempest-ServerActionsTestOtherA-1583977559 None] Deleting attachment 77abf8fc-f0e9-4e2a-bf3b-1ec110754f60. {{(pid=94472) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 11 04:42:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e9109258-fb6f-437a-b623-5e51f86ad5c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Lock "cinder-quobyte-7e00235d-3861-403a-afd4-6db7e5f9e890" acquired by "delete_volume" :: waited 0.029s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:42:17 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab2bb59-20c4-4c05-a707-88539ac23b85]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:42:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e9109258-fb6f-437a-b623-5e51f86ad5c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7e00235d-3861-403a-afd4-6db7e5f9e890 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:17 devstack sudo[101243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7e00235d-3861-403a-afd4-6db7e5f9e890 Aug 11 04:42:17 devstack sudo[101243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:18 devstack sudo[101243]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e9109258-fb6f-437a-b623-5e51f86ad5c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7e00235d-3861-403a-afd4-6db7e5f9e890" returned: 0 in 0.651s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e9109258-fb6f-437a-b623-5e51f86ad5c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7e00235d-3861-403a-afd4-6db7e5f9e890 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:18 devstack sudo[101265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7e00235d-3861-403a-afd4-6db7e5f9e890 Aug 11 04:42:18 devstack sudo[101265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:18 devstack sudo[101265]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e9109258-fb6f-437a-b623-5e51f86ad5c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7e00235d-3861-403a-afd4-6db7e5f9e890" returned: 0 in 0.372s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:18 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e9109258-fb6f-437a-b623-5e51f86ad5c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Lock "cinder-quobyte-7e00235d-3861-403a-afd4-6db7e5f9e890" released by "delete_volume" :: held 1.136s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:42:18 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-e9109258-fb6f-437a-b623-5e51f86ad5c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Created reservations ['11d2bc5d-c514-4481-9363-2f9c23120ee8', 'dc0e873a-f70e-439e-948f-e34b5bf1d14e', 'b3dd14d6-0725-4c0a-92d1-a97d2ad8b959', '79140790-780d-4bd3-9260-bf27206c9631'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:42:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e9109258-fb6f-437a-b623-5e51f86ad5c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:42:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e9109258-fb6f-437a-b623-5e51f86ad5c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:42:18 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e9109258-fb6f-437a-b623-5e51f86ad5c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:42:18 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e9109258-fb6f-437a-b623-5e51f86ad5c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:42:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e9109258-fb6f-437a-b623-5e51f86ad5c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:42:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e9109258-fb6f-437a-b623-5e51f86ad5c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:18 devstack sudo[101279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:42:18 devstack sudo[101279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-401c83ad-aabb-4f23-aa0e-292063913155 req-647ef172-ff19-4dba-8cd3-41df36b6578e tempest-ServerActionsTestOtherA-1583977559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:42:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-401c83ad-aabb-4f23-aa0e-292063913155 req-647ef172-ff19-4dba-8cd3-41df36b6578e tempest-ServerActionsTestOtherA-1583977559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:42:18 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-acc5147e-82b6-4633-aee5-4643924c69e0 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:42:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-acc5147e-82b6-4633-aee5-4643924c69e0 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Flow 'volume_create_manager' (2a0b48d2-ac98-4c43-8631-27882d211298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:42:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-acc5147e-82b6-4633-aee5-4643924c69e0 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (304aeebc-00e2-49f2-a957-4b19ef77c6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-acc5147e-82b6-4633-aee5-4643924c69e0 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (304aeebc-00e2-49f2-a957-4b19ef77c6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:42:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-208964475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96d1bddd-64c0-410e-bf8b-07677480442c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb4fb2fc5f4f473cae9405b174a9af10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:42:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:42:19Z,use_quota=True,user_id='cc3a345431df4c63a4c1a26f6e5ef775',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21bd5e12-392f-40a6-9433-42770a61cc46),volume_type_id=21bd5e12-392f-40a6-9433-42770a61cc46)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-acc5147e-82b6-4633-aee5-4643924c69e0 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99a22590-26b9-4af4-8938-220e21ca0d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-acc5147e-82b6-4633-aee5-4643924c69e0 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99a22590-26b9-4af4-8938-220e21ca0d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-acc5147e-82b6-4633-aee5-4643924c69e0 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fd9f701-811b-454b-b603-7928e9ef959d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-acc5147e-82b6-4633-aee5-4643924c69e0 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fd9f701-811b-454b-b603-7928e9ef959d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96d1bddd-64c0-410e-bf8b-07677480442c', 'volume_name': 'volume-96d1bddd-64c0-410e-bf8b-07677480442c', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-acc5147e-82b6-4633-aee5-4643924c69e0 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a9f357b-7a95-449a-b778-63254205af5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-acc5147e-82b6-4633-aee5-4643924c69e0 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a9f357b-7a95-449a-b778-63254205af5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-acc5147e-82b6-4633-aee5-4643924c69e0 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26b09080-ad43-4798-8c91-118f9f8e57ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:18 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-acc5147e-82b6-4633-aee5-4643924c69e0 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Volume 96d1bddd-64c0-410e-bf8b-07677480442c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96d1bddd-64c0-410e-bf8b-07677480442c', 'volume_size': 1} Aug 11 04:42:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-acc5147e-82b6-4633-aee5-4643924c69e0 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:42:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-401c83ad-aabb-4f23-aa0e-292063913155 req-647ef172-ff19-4dba-8cd3-41df36b6578e tempest-ServerActionsTestOtherA-1583977559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.120s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:42:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-acc5147e-82b6-4633-aee5-4643924c69e0 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:42:18 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-acc5147e-82b6-4633-aee5-4643924c69e0 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:42:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-208964475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96d1bddd-64c0-410e-bf8b-07677480442c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb4fb2fc5f4f473cae9405b174a9af10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:42:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:42:19Z,use_quota=True,user_id='cc3a345431df4c63a4c1a26f6e5ef775',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21bd5e12-392f-40a6-9433-42770a61cc46),volume_type_id=21bd5e12-392f-40a6-9433-42770a61cc46)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:42:18 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-acc5147e-82b6-4633-aee5-4643924c69e0 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Creating volume 96d1bddd-64c0-410e-bf8b-07677480442c {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:42:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-acc5147e-82b6-4633-aee5-4643924c69e0 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:42:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-acc5147e-82b6-4633-aee5-4643924c69e0 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:42:18 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-acc5147e-82b6-4633-aee5-4643924c69e0 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:42:18 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-acc5147e-82b6-4633-aee5-4643924c69e0 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:42:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-acc5147e-82b6-4633-aee5-4643924c69e0 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:42:18 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-acc5147e-82b6-4633-aee5-4643924c69e0 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:42:18 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-acc5147e-82b6-4633-aee5-4643924c69e0 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:42:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-acc5147e-82b6-4633-aee5-4643924c69e0 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-96d1bddd-64c0-410e-bf8b-07677480442c 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:18 devstack sudo[101282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-96d1bddd-64c0-410e-bf8b-07677480442c 1073741824 Aug 11 04:42:18 devstack sudo[101282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-401c83ad-aabb-4f23-aa0e-292063913155 req-647ef172-ff19-4dba-8cd3-41df36b6578e tempest-ServerActionsTestOtherA-1583977559 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd', 'name': 'volume-499eda1c-589a-4063-9f23-453e0c821c80', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '12f4c62d-b3d9-4198-b7a3-31c2d3e1e267', 'enforce_multipath': True} {{(pid=94472) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 11 04:42:19 devstack sudo[101279]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e9109258-fb6f-437a-b623-5e51f86ad5c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.316s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:19 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-e9109258-fb6f-437a-b623-5e51f86ad5c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:42:19 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-e9109258-fb6f-437a-b623-5e51f86ad5c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Deleted volume successfully. Aug 11 04:42:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e9109258-fb6f-437a-b623-5e51f86ad5c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-666438735 None] Lock "cinder-7e00235d-3861-403a-afd4-6db7e5f9e890-delete_volume" released by "delete_volume" :: held 1.867s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:42:19 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-401c83ad-aabb-4f23-aa0e-292063913155 req-647ef172-ff19-4dba-8cd3-41df36b6578e tempest-ServerActionsTestOtherA-1583977559 None] attachment_update completed successfully. Aug 11 04:42:19 devstack sudo[101282]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-acc5147e-82b6-4633-aee5-4643924c69e0 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-96d1bddd-64c0-410e-bf8b-07677480442c 1073741824" returned: 0 in 0.577s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-acc5147e-82b6-4633-aee5-4643924c69e0 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-96d1bddd-64c0-410e-bf8b-07677480442c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:19 devstack sudo[101291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-96d1bddd-64c0-410e-bf8b-07677480442c Aug 11 04:42:19 devstack sudo[101291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:19 devstack sudo[101291]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-acc5147e-82b6-4633-aee5-4643924c69e0 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-96d1bddd-64c0-410e-bf8b-07677480442c" returned: 0 in 0.332s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-acc5147e-82b6-4633-aee5-4643924c69e0 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:42:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-acc5147e-82b6-4633-aee5-4643924c69e0 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:42:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-acc5147e-82b6-4633-aee5-4643924c69e0 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26b09080-ad43-4798-8c91-118f9f8e57ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96d1bddd-64c0-410e-bf8b-07677480442c', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-acc5147e-82b6-4633-aee5-4643924c69e0 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3284b9ad-3a20-4c60-90cf-14e53165d9e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:19 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-acc5147e-82b6-4633-aee5-4643924c69e0 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Volume volume-96d1bddd-64c0-410e-bf8b-07677480442c (96d1bddd-64c0-410e-bf8b-07677480442c): created successfully Aug 11 04:42:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-acc5147e-82b6-4633-aee5-4643924c69e0 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3284b9ad-3a20-4c60-90cf-14e53165d9e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-acc5147e-82b6-4633-aee5-4643924c69e0 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Flow 'volume_create_manager' (2a0b48d2-ac98-4c43-8631-27882d211298) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:42:19 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-acc5147e-82b6-4633-aee5-4643924c69e0 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Created volume successfully. Aug 11 04:42:21 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:UPDATE=181,cinder:SELECT=151,cinder:INSERT=37,cinder:DELETE=11 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:42:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-796838cc-470d-43bf-8b98-e7ebca4d11c0 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:42:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-796838cc-470d-43bf-8b98-e7ebca4d11c0 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:42:21 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-796838cc-470d-43bf-8b98-e7ebca4d11c0 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:42:21 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-796838cc-470d-43bf-8b98-e7ebca4d11c0 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:42:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-796838cc-470d-43bf-8b98-e7ebca4d11c0 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:42:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-796838cc-470d-43bf-8b98-e7ebca4d11c0 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:21 devstack sudo[101713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:42:21 devstack sudo[101713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:22 devstack sudo[101713]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-796838cc-470d-43bf-8b98-e7ebca4d11c0 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.404s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:22 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-796838cc-470d-43bf-8b98-e7ebca4d11c0 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:42:22 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-796838cc-470d-43bf-8b98-e7ebca4d11c0 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Retype volume completed successfully. Aug 11 04:42:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-df776330-7a40-4c2a-a892-c5f6855061f5 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Acquiring lock "cinder-96d1bddd-64c0-410e-bf8b-07677480442c-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:42:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-df776330-7a40-4c2a-a892-c5f6855061f5 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Lock "cinder-96d1bddd-64c0-410e-bf8b-07677480442c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:42:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-df776330-7a40-4c2a-a892-c5f6855061f5 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Acquiring lock "cinder-quobyte-96d1bddd-64c0-410e-bf8b-07677480442c" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:42:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-df776330-7a40-4c2a-a892-c5f6855061f5 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Lock "cinder-quobyte-96d1bddd-64c0-410e-bf8b-07677480442c" acquired by "delete_volume" :: waited 0.015s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:42:23 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c5cf2e-fdbf-4f77-a51f-04cb0d3aae1c]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:42:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-df776330-7a40-4c2a-a892-c5f6855061f5 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-96d1bddd-64c0-410e-bf8b-07677480442c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:23 devstack sudo[101749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-96d1bddd-64c0-410e-bf8b-07677480442c Aug 11 04:42:23 devstack sudo[101749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:23 devstack sudo[101749]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-df776330-7a40-4c2a-a892-c5f6855061f5 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-96d1bddd-64c0-410e-bf8b-07677480442c" returned: 0 in 0.553s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-df776330-7a40-4c2a-a892-c5f6855061f5 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-96d1bddd-64c0-410e-bf8b-07677480442c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:23 devstack sudo[101760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-96d1bddd-64c0-410e-bf8b-07677480442c Aug 11 04:42:23 devstack sudo[101760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:23 devstack sudo[101760]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-df776330-7a40-4c2a-a892-c5f6855061f5 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-96d1bddd-64c0-410e-bf8b-07677480442c" returned: 0 in 0.290s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-df776330-7a40-4c2a-a892-c5f6855061f5 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Lock "cinder-quobyte-96d1bddd-64c0-410e-bf8b-07677480442c" released by "delete_volume" :: held 0.896s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:42:24 devstack cinder-volume[94472]: WARNING cinder.quota [None req-df776330-7a40-4c2a-a892-c5f6855061f5 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 11 04:42:24 devstack cinder-volume[94472]: WARNING cinder.quota [None req-df776330-7a40-4c2a-a892-c5f6855061f5 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 11 04:42:24 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-df776330-7a40-4c2a-a892-c5f6855061f5 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Created reservations ['cd75e675-4b27-4720-9642-baec040cb08e', '5341a1cf-1390-4503-8854-170746abc08f', '3e6ead0b-ae95-47dc-bcd5-d9871037b497', '8a8ce472-6722-4bd1-afeb-a2ac91172313'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:42:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-df776330-7a40-4c2a-a892-c5f6855061f5 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:42:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-df776330-7a40-4c2a-a892-c5f6855061f5 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:42:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-df776330-7a40-4c2a-a892-c5f6855061f5 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:42:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-df776330-7a40-4c2a-a892-c5f6855061f5 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:42:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-df776330-7a40-4c2a-a892-c5f6855061f5 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:42:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-df776330-7a40-4c2a-a892-c5f6855061f5 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:24 devstack sudo[101765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:42:24 devstack sudo[101765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:24 devstack sudo[101765]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-df776330-7a40-4c2a-a892-c5f6855061f5 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.695s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:24 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-df776330-7a40-4c2a-a892-c5f6855061f5 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:42:24 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-df776330-7a40-4c2a-a892-c5f6855061f5 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Deleted volume successfully. Aug 11 04:42:24 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-df776330-7a40-4c2a-a892-c5f6855061f5 tempest-VolumeRetypeWithoutMigrationTest-355793080 None] Lock "cinder-96d1bddd-64c0-410e-bf8b-07677480442c-delete_volume" released by "delete_volume" :: held 2.008s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:42:32 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:INSERT=39,cinder:UPDATE=136,cinder:SELECT=134,cinder:DELETE=11 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:42:32 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:42:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] Flow 'volume_create_manager' (9440a4d2-d3c0-47a6-b655-45bba38fca29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:42:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d814606-1e8d-4f1a-b4f9-957efafc3a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d814606-1e8d-4f1a-b4f9-957efafc3a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1195819826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a22fff4-71d9-4728-ba3e-97f40b64a02c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b0974fbeca94749a57e0148cc013828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:42:32Z,use_quota=True,user_id='57749f7045fb4aae9382672f7711bfdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61e7585f-e5bc-4f52-bba8-f584c931299d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61e7585f-e5bc-4f52-bba8-f584c931299d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db07287d-ee72-4c59-b232-f5775b3eca0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:32 devstack cinder-volume[94472]: DEBUG cinder.image.glance [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] Creating Keystone auth plugin from conf {{(pid=94472) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 11 04:42:32 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3582337-04fd-462a-bcfc-66330c2eb057 tempest-VolumesListAdminTestJSON-482044543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:42:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d3582337-04fd-462a-bcfc-66330c2eb057 tempest-VolumesListAdminTestJSON-482044543 None] Flow 'volume_create_manager' (8c9272eb-bcb0-4c77-b6b2-9dea2d05be3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:42:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d3582337-04fd-462a-bcfc-66330c2eb057 tempest-VolumesListAdminTestJSON-482044543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93451c6a-506b-4f20-8110-204e6cc8ac09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d3582337-04fd-462a-bcfc-66330c2eb057 tempest-VolumesListAdminTestJSON-482044543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93451c6a-506b-4f20-8110-204e6cc8ac09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-899565850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=817d8ee2-7f2b-47f3-8fb8-025f9fb6c443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a868c34f39fc4604962fd6d6a32c5920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:42:33Z,use_quota=True,user_id='54425045c5da42d9b1b61614af3dade0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d3582337-04fd-462a-bcfc-66330c2eb057 tempest-VolumesListAdminTestJSON-482044543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (220f9b25-0bb8-4083-ae8c-3e658e4d9387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d3582337-04fd-462a-bcfc-66330c2eb057 tempest-VolumesListAdminTestJSON-482044543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (220f9b25-0bb8-4083-ae8c-3e658e4d9387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d3582337-04fd-462a-bcfc-66330c2eb057 tempest-VolumesListAdminTestJSON-482044543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52dbe151-f285-46dd-a9b0-5bc729565c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d3582337-04fd-462a-bcfc-66330c2eb057 tempest-VolumesListAdminTestJSON-482044543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52dbe151-f285-46dd-a9b0-5bc729565c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '817d8ee2-7f2b-47f3-8fb8-025f9fb6c443', 'volume_name': 'volume-817d8ee2-7f2b-47f3-8fb8-025f9fb6c443', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d3582337-04fd-462a-bcfc-66330c2eb057 tempest-VolumesListAdminTestJSON-482044543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd2e7493-d79b-47ab-8014-5e3b167d6298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d3582337-04fd-462a-bcfc-66330c2eb057 tempest-VolumesListAdminTestJSON-482044543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd2e7493-d79b-47ab-8014-5e3b167d6298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d3582337-04fd-462a-bcfc-66330c2eb057 tempest-VolumesListAdminTestJSON-482044543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4f99550-b1b7-41ac-800a-6d215568ade9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:32 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-d3582337-04fd-462a-bcfc-66330c2eb057 tempest-VolumesListAdminTestJSON-482044543 None] Volume 817d8ee2-7f2b-47f3-8fb8-025f9fb6c443: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-817d8ee2-7f2b-47f3-8fb8-025f9fb6c443', 'volume_size': 1} Aug 11 04:42:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d3582337-04fd-462a-bcfc-66330c2eb057 tempest-VolumesListAdminTestJSON-482044543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:42:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d3582337-04fd-462a-bcfc-66330c2eb057 tempest-VolumesListAdminTestJSON-482044543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:42:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d3582337-04fd-462a-bcfc-66330c2eb057 tempest-VolumesListAdminTestJSON-482044543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-899565850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=817d8ee2-7f2b-47f3-8fb8-025f9fb6c443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a868c34f39fc4604962fd6d6a32c5920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:42:33Z,use_quota=True,user_id='54425045c5da42d9b1b61614af3dade0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:42:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-d3582337-04fd-462a-bcfc-66330c2eb057 tempest-VolumesListAdminTestJSON-482044543 None] Creating volume 817d8ee2-7f2b-47f3-8fb8-025f9fb6c443 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:42:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d3582337-04fd-462a-bcfc-66330c2eb057 tempest-VolumesListAdminTestJSON-482044543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:42:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d3582337-04fd-462a-bcfc-66330c2eb057 tempest-VolumesListAdminTestJSON-482044543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:42:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d3582337-04fd-462a-bcfc-66330c2eb057 tempest-VolumesListAdminTestJSON-482044543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:42:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d3582337-04fd-462a-bcfc-66330c2eb057 tempest-VolumesListAdminTestJSON-482044543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:42:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d3582337-04fd-462a-bcfc-66330c2eb057 tempest-VolumesListAdminTestJSON-482044543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:42:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d3582337-04fd-462a-bcfc-66330c2eb057 tempest-VolumesListAdminTestJSON-482044543 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:42:32 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-d3582337-04fd-462a-bcfc-66330c2eb057 tempest-VolumesListAdminTestJSON-482044543 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:42:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d3582337-04fd-462a-bcfc-66330c2eb057 tempest-VolumesListAdminTestJSON-482044543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-817d8ee2-7f2b-47f3-8fb8-025f9fb6c443 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:32 devstack sudo[101783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-817d8ee2-7f2b-47f3-8fb8-025f9fb6c443 1073741824 Aug 11 04:42:32 devstack sudo[101783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db07287d-ee72-4c59-b232-f5775b3eca0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3a22fff4-71d9-4728-ba3e-97f40b64a02c', 'volume_name': 'volume-3a22fff4-71d9-4728-ba3e-97f40b64a02c', 'volume_size': 1, 'image_id': '935df48c-f244-44af-83c6-4799aff908b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/935df48c-f244-44af-83c6-4799aff908b2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f74f87914afa4c849e1ab3e938cfb579', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '935df48c-f244-44af-83c6-4799aff908b2', 'created_at': datetime.datetime(2026, 8, 11, 2, 32, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 2, 32, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/935df48c-f244-44af-83c6-4799aff908b2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20b0abb5-8547-4da8-9b36-fbbab6c47e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20b0abb5-8547-4da8-9b36-fbbab6c47e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84e78614-7ac2-43b8-ad22-04dfae0562a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:33 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] Volume 3a22fff4-71d9-4728-ba3e-97f40b64a02c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3a22fff4-71d9-4728-ba3e-97f40b64a02c', 'volume_size': 1, 'image_id': '935df48c-f244-44af-83c6-4799aff908b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/935df48c-f244-44af-83c6-4799aff908b2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f74f87914afa4c849e1ab3e938cfb579', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '935df48c-f244-44af-83c6-4799aff908b2', 'created_at': datetime.datetime(2026, 8, 11, 2, 32, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 2, 32, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/935df48c-f244-44af-83c6-4799aff908b2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 11 04:42:33 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] Trying to clone 3a22fff4-71d9-4728-ba3e-97f40b64a02c from image 935df48c-f244-44af-83c6-4799aff908b2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/935df48c-f244-44af-83c6-4799aff908b2', 'metadata': {}}]). {{(pid=94472) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 11 04:42:33 devstack sudo[101783]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d3582337-04fd-462a-bcfc-66330c2eb057 tempest-VolumesListAdminTestJSON-482044543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-817d8ee2-7f2b-47f3-8fb8-025f9fb6c443 1073741824" returned: 0 in 0.648s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d3582337-04fd-462a-bcfc-66330c2eb057 tempest-VolumesListAdminTestJSON-482044543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-817d8ee2-7f2b-47f3-8fb8-025f9fb6c443 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:33 devstack sudo[101810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-817d8ee2-7f2b-47f3-8fb8-025f9fb6c443 Aug 11 04:42:33 devstack sudo[101810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:33 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_oc70ym25devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 11 04:42:33 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] Image download 20.69 MB at 20.69 MB/s Aug 11 04:42:33 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53ef574-0404-400d-99ee-4412704c363b]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:42:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_oc70ym25devstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:33 devstack sudo[101812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_oc70ym25devstack@QuobyteHD Aug 11 04:42:33 devstack sudo[101812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:33 devstack sudo[101810]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d3582337-04fd-462a-bcfc-66330c2eb057 tempest-VolumesListAdminTestJSON-482044543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-817d8ee2-7f2b-47f3-8fb8-025f9fb6c443" returned: 0 in 0.343s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:33 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d3582337-04fd-462a-bcfc-66330c2eb057 tempest-VolumesListAdminTestJSON-482044543 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:42:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d3582337-04fd-462a-bcfc-66330c2eb057 tempest-VolumesListAdminTestJSON-482044543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:42:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d3582337-04fd-462a-bcfc-66330c2eb057 tempest-VolumesListAdminTestJSON-482044543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4f99550-b1b7-41ac-800a-6d215568ade9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-817d8ee2-7f2b-47f3-8fb8-025f9fb6c443', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d3582337-04fd-462a-bcfc-66330c2eb057 tempest-VolumesListAdminTestJSON-482044543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11d6f645-7f1c-47af-a792-41fad4dc1bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:34 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-d3582337-04fd-462a-bcfc-66330c2eb057 tempest-VolumesListAdminTestJSON-482044543 None] Volume volume-817d8ee2-7f2b-47f3-8fb8-025f9fb6c443 (817d8ee2-7f2b-47f3-8fb8-025f9fb6c443): created successfully Aug 11 04:42:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d3582337-04fd-462a-bcfc-66330c2eb057 tempest-VolumesListAdminTestJSON-482044543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11d6f645-7f1c-47af-a792-41fad4dc1bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d3582337-04fd-462a-bcfc-66330c2eb057 tempest-VolumesListAdminTestJSON-482044543 None] Flow 'volume_create_manager' (8c9272eb-bcb0-4c77-b6b2-9dea2d05be3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:42:34 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-d3582337-04fd-462a-bcfc-66330c2eb057 tempest-VolumesListAdminTestJSON-482044543 None] Created volume successfully. Aug 11 04:42:34 devstack sudo[101812]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_oc70ym25devstack@QuobyteHD" returned: 0 in 0.434s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:34 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] Temporary image 935df48c-f244-44af-83c6-4799aff908b2 is fetched for user 57749f7045fb4aae9382672f7711bfdb. {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 11 04:42:34 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0536741-d3f5-4332-a31c-0c3f29e9eabf]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:42:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_oc70ym25devstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:34 devstack sudo[101818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_oc70ym25devstack@QuobyteHD Aug 11 04:42:34 devstack sudo[101818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:34 devstack sudo[101818]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_oc70ym25devstack@QuobyteHD" returned: 0 in 0.354s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:42:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:42:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1195819826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a22fff4-71d9-4728-ba3e-97f40b64a02c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b0974fbeca94749a57e0148cc013828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:42:32Z,use_quota=True,user_id='57749f7045fb4aae9382672f7711bfdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:42:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] Creating volume 3a22fff4-71d9-4728-ba3e-97f40b64a02c {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:42:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:42:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:42:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:42:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:42:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:42:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:42:34 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:42:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3a22fff4-71d9-4728-ba3e-97f40b64a02c 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:34 devstack sudo[101823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3a22fff4-71d9-4728-ba3e-97f40b64a02c 1073741824 Aug 11 04:42:34 devstack sudo[101823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:35 devstack sudo[101823]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3a22fff4-71d9-4728-ba3e-97f40b64a02c 1073741824" returned: 0 in 0.607s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3a22fff4-71d9-4728-ba3e-97f40b64a02c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:35 devstack sudo[101829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3a22fff4-71d9-4728-ba3e-97f40b64a02c Aug 11 04:42:35 devstack sudo[101829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:35 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-b74cca86-37d5-4a3a-a896-c4de95f42ac5 tempest-VolumesListAdminTestJSON-482044543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:42:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b74cca86-37d5-4a3a-a896-c4de95f42ac5 tempest-VolumesListAdminTestJSON-482044543 None] Flow 'volume_create_manager' (43d315fb-a86e-4d5b-a456-a8cede4e28ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:42:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b74cca86-37d5-4a3a-a896-c4de95f42ac5 tempest-VolumesListAdminTestJSON-482044543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (174468fa-dd6d-45a7-abf5-0f1a592ed391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b74cca86-37d5-4a3a-a896-c4de95f42ac5 tempest-VolumesListAdminTestJSON-482044543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (174468fa-dd6d-45a7-abf5-0f1a592ed391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:42:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1593591648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c67522a-07c7-4c54-8bc2-d2d1862a4df6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a868c34f39fc4604962fd6d6a32c5920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:42:35Z,use_quota=True,user_id='54425045c5da42d9b1b61614af3dade0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b74cca86-37d5-4a3a-a896-c4de95f42ac5 tempest-VolumesListAdminTestJSON-482044543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (898d5c69-87ce-4611-969b-19fd373af33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b74cca86-37d5-4a3a-a896-c4de95f42ac5 tempest-VolumesListAdminTestJSON-482044543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (898d5c69-87ce-4611-969b-19fd373af33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b74cca86-37d5-4a3a-a896-c4de95f42ac5 tempest-VolumesListAdminTestJSON-482044543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe30f0db-79f4-4f88-bcf0-0063e767c283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b74cca86-37d5-4a3a-a896-c4de95f42ac5 tempest-VolumesListAdminTestJSON-482044543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe30f0db-79f4-4f88-bcf0-0063e767c283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c67522a-07c7-4c54-8bc2-d2d1862a4df6', 'volume_name': 'volume-5c67522a-07c7-4c54-8bc2-d2d1862a4df6', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b74cca86-37d5-4a3a-a896-c4de95f42ac5 tempest-VolumesListAdminTestJSON-482044543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1203149e-a999-41ea-9e08-4ecf577cb1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b74cca86-37d5-4a3a-a896-c4de95f42ac5 tempest-VolumesListAdminTestJSON-482044543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1203149e-a999-41ea-9e08-4ecf577cb1e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b74cca86-37d5-4a3a-a896-c4de95f42ac5 tempest-VolumesListAdminTestJSON-482044543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38cede10-6e56-46ea-9136-6f463fa59ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:35 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-b74cca86-37d5-4a3a-a896-c4de95f42ac5 tempest-VolumesListAdminTestJSON-482044543 None] Volume 5c67522a-07c7-4c54-8bc2-d2d1862a4df6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c67522a-07c7-4c54-8bc2-d2d1862a4df6', 'volume_size': 1} Aug 11 04:42:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b74cca86-37d5-4a3a-a896-c4de95f42ac5 tempest-VolumesListAdminTestJSON-482044543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:42:35 devstack sudo[101829]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3a22fff4-71d9-4728-ba3e-97f40b64a02c" returned: 0 in 0.367s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:35 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:42:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:42:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b74cca86-37d5-4a3a-a896-c4de95f42ac5 tempest-VolumesListAdminTestJSON-482044543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.056s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:42:35 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b74cca86-37d5-4a3a-a896-c4de95f42ac5 tempest-VolumesListAdminTestJSON-482044543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:42:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1593591648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c67522a-07c7-4c54-8bc2-d2d1862a4df6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a868c34f39fc4604962fd6d6a32c5920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:42:35Z,use_quota=True,user_id='54425045c5da42d9b1b61614af3dade0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:42:35 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-b74cca86-37d5-4a3a-a896-c4de95f42ac5 tempest-VolumesListAdminTestJSON-482044543 None] Creating volume 5c67522a-07c7-4c54-8bc2-d2d1862a4df6 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:42:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b74cca86-37d5-4a3a-a896-c4de95f42ac5 tempest-VolumesListAdminTestJSON-482044543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:42:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b74cca86-37d5-4a3a-a896-c4de95f42ac5 tempest-VolumesListAdminTestJSON-482044543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:42:35 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b74cca86-37d5-4a3a-a896-c4de95f42ac5 tempest-VolumesListAdminTestJSON-482044543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:42:35 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b74cca86-37d5-4a3a-a896-c4de95f42ac5 tempest-VolumesListAdminTestJSON-482044543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:42:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b74cca86-37d5-4a3a-a896-c4de95f42ac5 tempest-VolumesListAdminTestJSON-482044543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:42:35 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b74cca86-37d5-4a3a-a896-c4de95f42ac5 tempest-VolumesListAdminTestJSON-482044543 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:42:35 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-b74cca86-37d5-4a3a-a896-c4de95f42ac5 tempest-VolumesListAdminTestJSON-482044543 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:42:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b74cca86-37d5-4a3a-a896-c4de95f42ac5 tempest-VolumesListAdminTestJSON-482044543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5c67522a-07c7-4c54-8bc2-d2d1862a4df6 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:35 devstack sudo[101832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5c67522a-07c7-4c54-8bc2-d2d1862a4df6 1073741824 Aug 11 04:42:35 devstack sudo[101832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:35 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] Attempting download of 935df48c-f244-44af-83c6-4799aff908b2 ((None, [{'url': 'file:///opt/stack/data/glance/images/935df48c-f244-44af-83c6-4799aff908b2', 'metadata': {}}])) to volume 3a22fff4-71d9-4728-ba3e-97f40b64a02c. {{(pid=94472) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 11 04:42:35 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2fced7-cf1e-4ecb-8111-c94217600580]: (4, 'raw') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:42:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_935df48c-f244-44af-83c6-4799aff908b2_t96zrxth {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:36 devstack sudo[101834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_935df48c-f244-44af-83c6-4799aff908b2_t96zrxth Aug 11 04:42:36 devstack sudo[101834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:36 devstack sudo[101832]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b74cca86-37d5-4a3a-a896-c4de95f42ac5 tempest-VolumesListAdminTestJSON-482044543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5c67522a-07c7-4c54-8bc2-d2d1862a4df6 1073741824" returned: 0 in 0.531s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b74cca86-37d5-4a3a-a896-c4de95f42ac5 tempest-VolumesListAdminTestJSON-482044543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5c67522a-07c7-4c54-8bc2-d2d1862a4df6 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:36 devstack sudo[101845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5c67522a-07c7-4c54-8bc2-d2d1862a4df6 Aug 11 04:42:36 devstack sudo[101845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:36 devstack sudo[101834]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_935df48c-f244-44af-83c6-4799aff908b2_t96zrxth" returned: 0 in 0.529s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_935df48c-f244-44af-83c6-4799aff908b2_t96zrxth {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:36 devstack sudo[101850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_935df48c-f244-44af-83c6-4799aff908b2_t96zrxth Aug 11 04:42:36 devstack sudo[101850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:36 devstack sudo[101845]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b74cca86-37d5-4a3a-a896-c4de95f42ac5 tempest-VolumesListAdminTestJSON-482044543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5c67522a-07c7-4c54-8bc2-d2d1862a4df6" returned: 0 in 0.467s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:36 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b74cca86-37d5-4a3a-a896-c4de95f42ac5 tempest-VolumesListAdminTestJSON-482044543 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:42:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b74cca86-37d5-4a3a-a896-c4de95f42ac5 tempest-VolumesListAdminTestJSON-482044543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:42:36 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b74cca86-37d5-4a3a-a896-c4de95f42ac5 tempest-VolumesListAdminTestJSON-482044543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38cede10-6e56-46ea-9136-6f463fa59ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c67522a-07c7-4c54-8bc2-d2d1862a4df6', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:36 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b74cca86-37d5-4a3a-a896-c4de95f42ac5 tempest-VolumesListAdminTestJSON-482044543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35ec3c27-c21d-477f-9c4a-214547535d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:36 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-b74cca86-37d5-4a3a-a896-c4de95f42ac5 tempest-VolumesListAdminTestJSON-482044543 None] Volume volume-5c67522a-07c7-4c54-8bc2-d2d1862a4df6 (5c67522a-07c7-4c54-8bc2-d2d1862a4df6): created successfully Aug 11 04:42:36 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b74cca86-37d5-4a3a-a896-c4de95f42ac5 tempest-VolumesListAdminTestJSON-482044543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35ec3c27-c21d-477f-9c4a-214547535d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:36 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b74cca86-37d5-4a3a-a896-c4de95f42ac5 tempest-VolumesListAdminTestJSON-482044543 None] Flow 'volume_create_manager' (43d315fb-a86e-4d5b-a456-a8cede4e28ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:42:36 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-b74cca86-37d5-4a3a-a896-c4de95f42ac5 tempest-VolumesListAdminTestJSON-482044543 None] Created volume successfully. Aug 11 04:42:36 devstack sudo[101850]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_935df48c-f244-44af-83c6-4799aff908b2_t96zrxth" returned: 1 in 0.514s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_935df48c-f244-44af-83c6-4799aff908b2_t96zrxth' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 11 04:42:36 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[53675c70-d9bd-42ac-8494-796eccd8d8f0]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:42:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_oc70ym25devstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:37 devstack sudo[101875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_oc70ym25devstack@QuobyteHD Aug 11 04:42:37 devstack sudo[101875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:37 devstack sudo[101875]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_oc70ym25devstack@QuobyteHD" returned: 0 in 0.461s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:37 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] 935df48c-f244-44af-83c6-4799aff908b2 was qcow2, converting to qcow2 {{(pid=94472) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 11 04:42:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_oc70ym25devstack@QuobyteHD /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3a22fff4-71d9-4728-ba3e-97f40b64a02c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:37 devstack sudo[101880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_oc70ym25devstack@QuobyteHD /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3a22fff4-71d9-4728-ba3e-97f40b64a02c Aug 11 04:42:37 devstack sudo[101880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:38 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-96b3e623-8179-4582-93c7-13a18704895a tempest-VolumesListAdminTestJSON-482044543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:42:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-96b3e623-8179-4582-93c7-13a18704895a tempest-VolumesListAdminTestJSON-482044543 None] Flow 'volume_create_manager' (3afbf0ad-35ec-426d-b6c2-0c6b2cbac20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:42:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-96b3e623-8179-4582-93c7-13a18704895a tempest-VolumesListAdminTestJSON-482044543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8937e616-2809-4a81-ae69-e237de34bc3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-96b3e623-8179-4582-93c7-13a18704895a tempest-VolumesListAdminTestJSON-482044543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8937e616-2809-4a81-ae69-e237de34bc3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1334450326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d25b5493-fb9c-4e24-87d9-42acbf9e1689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a868c34f39fc4604962fd6d6a32c5920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:42:38Z,use_quota=True,user_id='54425045c5da42d9b1b61614af3dade0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-96b3e623-8179-4582-93c7-13a18704895a tempest-VolumesListAdminTestJSON-482044543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb3da08b-5795-4415-b0b6-a4a8fdc77614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-96b3e623-8179-4582-93c7-13a18704895a tempest-VolumesListAdminTestJSON-482044543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb3da08b-5795-4415-b0b6-a4a8fdc77614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-96b3e623-8179-4582-93c7-13a18704895a tempest-VolumesListAdminTestJSON-482044543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ebcb409-81e5-40ce-a8cb-0f15d9ecc9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-96b3e623-8179-4582-93c7-13a18704895a tempest-VolumesListAdminTestJSON-482044543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ebcb409-81e5-40ce-a8cb-0f15d9ecc9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd25b5493-fb9c-4e24-87d9-42acbf9e1689', 'volume_name': 'volume-d25b5493-fb9c-4e24-87d9-42acbf9e1689', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-96b3e623-8179-4582-93c7-13a18704895a tempest-VolumesListAdminTestJSON-482044543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32bae6de-870b-46e3-b7c4-8cfa5c9eb0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-96b3e623-8179-4582-93c7-13a18704895a tempest-VolumesListAdminTestJSON-482044543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32bae6de-870b-46e3-b7c4-8cfa5c9eb0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-96b3e623-8179-4582-93c7-13a18704895a tempest-VolumesListAdminTestJSON-482044543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (947cac84-ba7d-440b-8cd2-a42ab9dcfd07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:38 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-96b3e623-8179-4582-93c7-13a18704895a tempest-VolumesListAdminTestJSON-482044543 None] Volume d25b5493-fb9c-4e24-87d9-42acbf9e1689: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d25b5493-fb9c-4e24-87d9-42acbf9e1689', 'volume_size': 1} Aug 11 04:42:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-96b3e623-8179-4582-93c7-13a18704895a tempest-VolumesListAdminTestJSON-482044543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:42:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-96b3e623-8179-4582-93c7-13a18704895a tempest-VolumesListAdminTestJSON-482044543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:42:38 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-96b3e623-8179-4582-93c7-13a18704895a tempest-VolumesListAdminTestJSON-482044543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1334450326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d25b5493-fb9c-4e24-87d9-42acbf9e1689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a868c34f39fc4604962fd6d6a32c5920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:42:38Z,use_quota=True,user_id='54425045c5da42d9b1b61614af3dade0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:42:38 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-96b3e623-8179-4582-93c7-13a18704895a tempest-VolumesListAdminTestJSON-482044543 None] Creating volume d25b5493-fb9c-4e24-87d9-42acbf9e1689 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:42:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-96b3e623-8179-4582-93c7-13a18704895a tempest-VolumesListAdminTestJSON-482044543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:42:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-96b3e623-8179-4582-93c7-13a18704895a tempest-VolumesListAdminTestJSON-482044543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:42:38 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-96b3e623-8179-4582-93c7-13a18704895a tempest-VolumesListAdminTestJSON-482044543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:42:38 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-96b3e623-8179-4582-93c7-13a18704895a tempest-VolumesListAdminTestJSON-482044543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:42:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-96b3e623-8179-4582-93c7-13a18704895a tempest-VolumesListAdminTestJSON-482044543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:42:38 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-96b3e623-8179-4582-93c7-13a18704895a tempest-VolumesListAdminTestJSON-482044543 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:42:38 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-96b3e623-8179-4582-93c7-13a18704895a tempest-VolumesListAdminTestJSON-482044543 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:42:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-96b3e623-8179-4582-93c7-13a18704895a tempest-VolumesListAdminTestJSON-482044543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d25b5493-fb9c-4e24-87d9-42acbf9e1689 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:38 devstack sudo[101888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d25b5493-fb9c-4e24-87d9-42acbf9e1689 1073741824 Aug 11 04:42:38 devstack sudo[101888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:38 devstack sudo[101888]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-96b3e623-8179-4582-93c7-13a18704895a tempest-VolumesListAdminTestJSON-482044543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d25b5493-fb9c-4e24-87d9-42acbf9e1689 1073741824" returned: 0 in 0.515s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-96b3e623-8179-4582-93c7-13a18704895a tempest-VolumesListAdminTestJSON-482044543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d25b5493-fb9c-4e24-87d9-42acbf9e1689 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:38 devstack sudo[101894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d25b5493-fb9c-4e24-87d9-42acbf9e1689 Aug 11 04:42:38 devstack sudo[101894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:39 devstack sudo[101894]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-96b3e623-8179-4582-93c7-13a18704895a tempest-VolumesListAdminTestJSON-482044543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d25b5493-fb9c-4e24-87d9-42acbf9e1689" returned: 0 in 0.295s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-96b3e623-8179-4582-93c7-13a18704895a tempest-VolumesListAdminTestJSON-482044543 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:42:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-96b3e623-8179-4582-93c7-13a18704895a tempest-VolumesListAdminTestJSON-482044543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:42:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-96b3e623-8179-4582-93c7-13a18704895a tempest-VolumesListAdminTestJSON-482044543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (947cac84-ba7d-440b-8cd2-a42ab9dcfd07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d25b5493-fb9c-4e24-87d9-42acbf9e1689', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-96b3e623-8179-4582-93c7-13a18704895a tempest-VolumesListAdminTestJSON-482044543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (192fc137-f74b-4698-91a9-cd8ae008df10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:39 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-96b3e623-8179-4582-93c7-13a18704895a tempest-VolumesListAdminTestJSON-482044543 None] Volume volume-d25b5493-fb9c-4e24-87d9-42acbf9e1689 (d25b5493-fb9c-4e24-87d9-42acbf9e1689): created successfully Aug 11 04:42:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-96b3e623-8179-4582-93c7-13a18704895a tempest-VolumesListAdminTestJSON-482044543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (192fc137-f74b-4698-91a9-cd8ae008df10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-96b3e623-8179-4582-93c7-13a18704895a tempest-VolumesListAdminTestJSON-482044543 None] Flow 'volume_create_manager' (3afbf0ad-35ec-426d-b6c2-0c6b2cbac20d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:42:39 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-96b3e623-8179-4582-93c7-13a18704895a tempest-VolumesListAdminTestJSON-482044543 None] Created volume successfully. Aug 11 04:42:39 devstack sudo[101880]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_oc70ym25devstack@QuobyteHD /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3a22fff4-71d9-4728-ba3e-97f40b64a02c" returned: 0 in 2.055s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:39 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_oc70ym25devstack@QuobyteHD, size 112.00 MB, duration 2.06 sec, destination /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3a22fff4-71d9-4728-ba3e-97f40b64a02c {{(pid=94472) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 11 04:42:39 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] Converted 112.00 MB image at 54.47 MB/s Aug 11 04:42:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3a22fff4-71d9-4728-ba3e-97f40b64a02c 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:39 devstack sudo[101897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3a22fff4-71d9-4728-ba3e-97f40b64a02c 1G Aug 11 04:42:39 devstack sudo[101897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:39 devstack sudo[101897]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3a22fff4-71d9-4728-ba3e-97f40b64a02c 1G" returned: 0 in 0.327s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:39 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] Downloaded image 935df48c-f244-44af-83c6-4799aff908b2 ((None, [{'url': 'file:///opt/stack/data/glance/images/935df48c-f244-44af-83c6-4799aff908b2', 'metadata': {}}])) to volume 3a22fff4-71d9-4728-ba3e-97f40b64a02c successfully. {{(pid=94472) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 11 04:42:39 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] Temporary image 935df48c-f244-44af-83c6-4799aff908b2 for user 57749f7045fb4aae9382672f7711bfdb is deleted. {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 11 04:42:39 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] Marking volume 3a22fff4-71d9-4728-ba3e-97f40b64a02c as bootable. {{(pid=94472) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 11 04:42:39 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] Copying metadata from image 935df48c-f244-44af-83c6-4799aff908b2 to 3a22fff4-71d9-4728-ba3e-97f40b64a02c. {{(pid=94472) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 11 04:42:39 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] Creating volume glance metadata for volume 3a22fff4-71d9-4728-ba3e-97f40b64a02c backed by image 935df48c-f244-44af-83c6-4799aff908b2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '935df48c-f244-44af-83c6-4799aff908b2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94472) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 11 04:42:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84e78614-7ac2-43b8-ad22-04dfae0562a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a22fff4-71d9-4728-ba3e-97f40b64a02c', 'volume_size': 1, 'image_id': '935df48c-f244-44af-83c6-4799aff908b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/935df48c-f244-44af-83c6-4799aff908b2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f74f87914afa4c849e1ab3e938cfb579', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '935df48c-f244-44af-83c6-4799aff908b2', 'created_at': datetime.datetime(2026, 8, 11, 2, 32, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 2, 32, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/935df48c-f244-44af-83c6-4799aff908b2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63a6ba7b-689e-4b22-ac83-fa065276e269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:39 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] Volume volume-3a22fff4-71d9-4728-ba3e-97f40b64a02c (3a22fff4-71d9-4728-ba3e-97f40b64a02c): created successfully Aug 11 04:42:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63a6ba7b-689e-4b22-ac83-fa065276e269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] Flow 'volume_create_manager' (9440a4d2-d3c0-47a6-b655-45bba38fca29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:42:39 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-1e87aeb3-2d63-4806-8837-31e4c81da681 tempest-VolumesImageMetadata-196648812 None] Created volume successfully. Aug 11 04:42:41 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-08b197f4-a1cd-4bbf-a753-9a90b7e8b964 tempest-VolumesListAdminTestJSON-1992498874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:42:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-08b197f4-a1cd-4bbf-a753-9a90b7e8b964 tempest-VolumesListAdminTestJSON-1992498874 None] Flow 'volume_create_manager' (0ee1818d-774f-4ac8-b273-b62bec2adbbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:42:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-08b197f4-a1cd-4bbf-a753-9a90b7e8b964 tempest-VolumesListAdminTestJSON-1992498874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64ad584d-4016-4d22-966f-2964e91a605c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-08b197f4-a1cd-4bbf-a753-9a90b7e8b964 tempest-VolumesListAdminTestJSON-1992498874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64ad584d-4016-4d22-966f-2964e91a605c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff235e88-2ee6-4855-a1a9-6c88f320e124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f567558b941e492180d4e5cc417b7d60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:42:41Z,use_quota=True,user_id='4fffdac6139842bf860ee2f5eb476fab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-08b197f4-a1cd-4bbf-a753-9a90b7e8b964 tempest-VolumesListAdminTestJSON-1992498874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aefb6d22-edd1-4aeb-9389-6d492c93d4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-08b197f4-a1cd-4bbf-a753-9a90b7e8b964 tempest-VolumesListAdminTestJSON-1992498874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aefb6d22-edd1-4aeb-9389-6d492c93d4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-08b197f4-a1cd-4bbf-a753-9a90b7e8b964 tempest-VolumesListAdminTestJSON-1992498874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48061576-5798-4fb7-9296-083fdcba9a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-08b197f4-a1cd-4bbf-a753-9a90b7e8b964 tempest-VolumesListAdminTestJSON-1992498874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48061576-5798-4fb7-9296-083fdcba9a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff235e88-2ee6-4855-a1a9-6c88f320e124', 'volume_name': 'volume-ff235e88-2ee6-4855-a1a9-6c88f320e124', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-08b197f4-a1cd-4bbf-a753-9a90b7e8b964 tempest-VolumesListAdminTestJSON-1992498874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2dfbd3a-9ea2-40c4-a5b8-db82f53a6ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-08b197f4-a1cd-4bbf-a753-9a90b7e8b964 tempest-VolumesListAdminTestJSON-1992498874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2dfbd3a-9ea2-40c4-a5b8-db82f53a6ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-08b197f4-a1cd-4bbf-a753-9a90b7e8b964 tempest-VolumesListAdminTestJSON-1992498874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6bc8422-3203-4fc7-a241-24999ada14b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:41 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-08b197f4-a1cd-4bbf-a753-9a90b7e8b964 tempest-VolumesListAdminTestJSON-1992498874 None] Volume ff235e88-2ee6-4855-a1a9-6c88f320e124: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff235e88-2ee6-4855-a1a9-6c88f320e124', 'volume_size': 1} Aug 11 04:42:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-08b197f4-a1cd-4bbf-a753-9a90b7e8b964 tempest-VolumesListAdminTestJSON-1992498874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:42:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-08b197f4-a1cd-4bbf-a753-9a90b7e8b964 tempest-VolumesListAdminTestJSON-1992498874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:42:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-08b197f4-a1cd-4bbf-a753-9a90b7e8b964 tempest-VolumesListAdminTestJSON-1992498874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff235e88-2ee6-4855-a1a9-6c88f320e124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f567558b941e492180d4e5cc417b7d60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:42:41Z,use_quota=True,user_id='4fffdac6139842bf860ee2f5eb476fab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:42:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-08b197f4-a1cd-4bbf-a753-9a90b7e8b964 tempest-VolumesListAdminTestJSON-1992498874 None] Creating volume ff235e88-2ee6-4855-a1a9-6c88f320e124 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:42:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-08b197f4-a1cd-4bbf-a753-9a90b7e8b964 tempest-VolumesListAdminTestJSON-1992498874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:42:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-08b197f4-a1cd-4bbf-a753-9a90b7e8b964 tempest-VolumesListAdminTestJSON-1992498874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:42:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-08b197f4-a1cd-4bbf-a753-9a90b7e8b964 tempest-VolumesListAdminTestJSON-1992498874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:42:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-08b197f4-a1cd-4bbf-a753-9a90b7e8b964 tempest-VolumesListAdminTestJSON-1992498874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:42:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-08b197f4-a1cd-4bbf-a753-9a90b7e8b964 tempest-VolumesListAdminTestJSON-1992498874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:42:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-08b197f4-a1cd-4bbf-a753-9a90b7e8b964 tempest-VolumesListAdminTestJSON-1992498874 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:42:41 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-08b197f4-a1cd-4bbf-a753-9a90b7e8b964 tempest-VolumesListAdminTestJSON-1992498874 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:42:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-08b197f4-a1cd-4bbf-a753-9a90b7e8b964 tempest-VolumesListAdminTestJSON-1992498874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ff235e88-2ee6-4855-a1a9-6c88f320e124 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:41 devstack sudo[101928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ff235e88-2ee6-4855-a1a9-6c88f320e124 1073741824 Aug 11 04:42:41 devstack sudo[101928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:41 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9a4944d3-1add-4ed7-a55d-88e16534cd37 tempest-VolumesImageMetadata-196648812 None] Acquiring lock "cinder-3a22fff4-71d9-4728-ba3e-97f40b64a02c-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:42:41 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9a4944d3-1add-4ed7-a55d-88e16534cd37 tempest-VolumesImageMetadata-196648812 None] Lock "cinder-3a22fff4-71d9-4728-ba3e-97f40b64a02c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:42:41 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9a4944d3-1add-4ed7-a55d-88e16534cd37 tempest-VolumesImageMetadata-196648812 None] Acquiring lock "cinder-quobyte-3a22fff4-71d9-4728-ba3e-97f40b64a02c" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:42:41 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9a4944d3-1add-4ed7-a55d-88e16534cd37 tempest-VolumesImageMetadata-196648812 None] Lock "cinder-quobyte-3a22fff4-71d9-4728-ba3e-97f40b64a02c" acquired by "delete_volume" :: waited 0.018s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:42:41 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[53579f50-9737-4e31-a41b-ea11af4fe8c9]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:42:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9a4944d3-1add-4ed7-a55d-88e16534cd37 tempest-VolumesImageMetadata-196648812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3a22fff4-71d9-4728-ba3e-97f40b64a02c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:41 devstack sudo[101933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3a22fff4-71d9-4728-ba3e-97f40b64a02c Aug 11 04:42:41 devstack sudo[101933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:41 devstack sudo[101928]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-08b197f4-a1cd-4bbf-a753-9a90b7e8b964 tempest-VolumesListAdminTestJSON-1992498874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ff235e88-2ee6-4855-a1a9-6c88f320e124 1073741824" returned: 0 in 0.531s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-08b197f4-a1cd-4bbf-a753-9a90b7e8b964 tempest-VolumesListAdminTestJSON-1992498874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ff235e88-2ee6-4855-a1a9-6c88f320e124 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:41 devstack sudo[101936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ff235e88-2ee6-4855-a1a9-6c88f320e124 Aug 11 04:42:41 devstack sudo[101936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:41 devstack sudo[101933]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9a4944d3-1add-4ed7-a55d-88e16534cd37 tempest-VolumesImageMetadata-196648812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3a22fff4-71d9-4728-ba3e-97f40b64a02c" returned: 0 in 0.441s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9a4944d3-1add-4ed7-a55d-88e16534cd37 tempest-VolumesImageMetadata-196648812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3a22fff4-71d9-4728-ba3e-97f40b64a02c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:41 devstack sudo[101942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3a22fff4-71d9-4728-ba3e-97f40b64a02c Aug 11 04:42:41 devstack sudo[101942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:41 devstack sudo[101936]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-08b197f4-a1cd-4bbf-a753-9a90b7e8b964 tempest-VolumesListAdminTestJSON-1992498874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ff235e88-2ee6-4855-a1a9-6c88f320e124" returned: 0 in 0.294s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-08b197f4-a1cd-4bbf-a753-9a90b7e8b964 tempest-VolumesListAdminTestJSON-1992498874 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:42:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-08b197f4-a1cd-4bbf-a753-9a90b7e8b964 tempest-VolumesListAdminTestJSON-1992498874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:42:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-08b197f4-a1cd-4bbf-a753-9a90b7e8b964 tempest-VolumesListAdminTestJSON-1992498874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6bc8422-3203-4fc7-a241-24999ada14b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff235e88-2ee6-4855-a1a9-6c88f320e124', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-08b197f4-a1cd-4bbf-a753-9a90b7e8b964 tempest-VolumesListAdminTestJSON-1992498874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaec3096-3121-42e1-92e1-d3bb3c721c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:42 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-08b197f4-a1cd-4bbf-a753-9a90b7e8b964 tempest-VolumesListAdminTestJSON-1992498874 None] Volume volume-ff235e88-2ee6-4855-a1a9-6c88f320e124 (ff235e88-2ee6-4855-a1a9-6c88f320e124): created successfully Aug 11 04:42:42 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-08b197f4-a1cd-4bbf-a753-9a90b7e8b964 tempest-VolumesListAdminTestJSON-1992498874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaec3096-3121-42e1-92e1-d3bb3c721c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:42 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-08b197f4-a1cd-4bbf-a753-9a90b7e8b964 tempest-VolumesListAdminTestJSON-1992498874 None] Flow 'volume_create_manager' (0ee1818d-774f-4ac8-b273-b62bec2adbbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:42:42 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-08b197f4-a1cd-4bbf-a753-9a90b7e8b964 tempest-VolumesListAdminTestJSON-1992498874 None] Created volume successfully. Aug 11 04:42:42 devstack sudo[101942]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9a4944d3-1add-4ed7-a55d-88e16534cd37 tempest-VolumesImageMetadata-196648812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3a22fff4-71d9-4728-ba3e-97f40b64a02c" returned: 0 in 0.335s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:42 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9a4944d3-1add-4ed7-a55d-88e16534cd37 tempest-VolumesImageMetadata-196648812 None] Lock "cinder-quobyte-3a22fff4-71d9-4728-ba3e-97f40b64a02c" released by "delete_volume" :: held 0.833s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:42:42 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-9a4944d3-1add-4ed7-a55d-88e16534cd37 tempest-VolumesImageMetadata-196648812 None] Created reservations ['593054a0-939c-4d75-baf6-1b7c60ff3406', 'a951183f-edb8-4d15-82eb-bf1f1541124f', 'dcc33635-cb65-4e35-a583-a70b907b4645', '1bab597c-3852-4e0a-aa74-6aa5e7c23708'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:42:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9a4944d3-1add-4ed7-a55d-88e16534cd37 tempest-VolumesImageMetadata-196648812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:42:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9a4944d3-1add-4ed7-a55d-88e16534cd37 tempest-VolumesImageMetadata-196648812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:42:42 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9a4944d3-1add-4ed7-a55d-88e16534cd37 tempest-VolumesImageMetadata-196648812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:42:42 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9a4944d3-1add-4ed7-a55d-88e16534cd37 tempest-VolumesImageMetadata-196648812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:42:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9a4944d3-1add-4ed7-a55d-88e16534cd37 tempest-VolumesImageMetadata-196648812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:42:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9a4944d3-1add-4ed7-a55d-88e16534cd37 tempest-VolumesImageMetadata-196648812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:42 devstack sudo[101947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:42:42 devstack sudo[101947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:42 devstack sudo[101947]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9a4944d3-1add-4ed7-a55d-88e16534cd37 tempest-VolumesImageMetadata-196648812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.302s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:42 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-9a4944d3-1add-4ed7-a55d-88e16534cd37 tempest-VolumesImageMetadata-196648812 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:42:42 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-9a4944d3-1add-4ed7-a55d-88e16534cd37 tempest-VolumesImageMetadata-196648812 None] Deleted volume successfully. Aug 11 04:42:42 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9a4944d3-1add-4ed7-a55d-88e16534cd37 tempest-VolumesImageMetadata-196648812 None] Lock "cinder-3a22fff4-71d9-4728-ba3e-97f40b64a02c-delete_volume" released by "delete_volume" :: held 1.363s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:42:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-33490177-90cb-42ab-bf01-d8bb007c82d3 tempest-VolumesListAdminTestJSON-1992498874 None] Acquiring lock "cinder-ff235e88-2ee6-4855-a1a9-6c88f320e124-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:42:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-33490177-90cb-42ab-bf01-d8bb007c82d3 tempest-VolumesListAdminTestJSON-1992498874 None] Lock "cinder-ff235e88-2ee6-4855-a1a9-6c88f320e124-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:42:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-33490177-90cb-42ab-bf01-d8bb007c82d3 tempest-VolumesListAdminTestJSON-1992498874 None] Acquiring lock "cinder-quobyte-ff235e88-2ee6-4855-a1a9-6c88f320e124" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:42:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-33490177-90cb-42ab-bf01-d8bb007c82d3 tempest-VolumesListAdminTestJSON-1992498874 None] Lock "cinder-quobyte-ff235e88-2ee6-4855-a1a9-6c88f320e124" acquired by "delete_volume" :: waited 0.016s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:42:43 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[573a7b12-f53d-4e85-aaa6-ce403409a7ef]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:42:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-33490177-90cb-42ab-bf01-d8bb007c82d3 tempest-VolumesListAdminTestJSON-1992498874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ff235e88-2ee6-4855-a1a9-6c88f320e124 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b39423eb-0f78-4416-b2c0-8d8c1abd24db tempest-VolumesListAdminTestJSON-482044543 None] Acquiring lock "cinder-d25b5493-fb9c-4e24-87d9-42acbf9e1689-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:42:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b39423eb-0f78-4416-b2c0-8d8c1abd24db tempest-VolumesListAdminTestJSON-482044543 None] Lock "cinder-d25b5493-fb9c-4e24-87d9-42acbf9e1689-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:42:43 devstack sudo[101951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ff235e88-2ee6-4855-a1a9-6c88f320e124 Aug 11 04:42:43 devstack sudo[101951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b39423eb-0f78-4416-b2c0-8d8c1abd24db tempest-VolumesListAdminTestJSON-482044543 None] Acquiring lock "cinder-quobyte-d25b5493-fb9c-4e24-87d9-42acbf9e1689" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:42:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b39423eb-0f78-4416-b2c0-8d8c1abd24db tempest-VolumesListAdminTestJSON-482044543 None] Lock "cinder-quobyte-d25b5493-fb9c-4e24-87d9-42acbf9e1689" acquired by "delete_volume" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:42:43 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41de118-a764-49f0-8b49-5853022812d5]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:42:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b39423eb-0f78-4416-b2c0-8d8c1abd24db tempest-VolumesListAdminTestJSON-482044543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d25b5493-fb9c-4e24-87d9-42acbf9e1689 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:43 devstack sudo[101953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d25b5493-fb9c-4e24-87d9-42acbf9e1689 Aug 11 04:42:43 devstack sudo[101953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:43 devstack sudo[101951]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-33490177-90cb-42ab-bf01-d8bb007c82d3 tempest-VolumesListAdminTestJSON-1992498874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ff235e88-2ee6-4855-a1a9-6c88f320e124" returned: 0 in 0.510s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-33490177-90cb-42ab-bf01-d8bb007c82d3 tempest-VolumesListAdminTestJSON-1992498874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ff235e88-2ee6-4855-a1a9-6c88f320e124 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:43 devstack sudo[101958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ff235e88-2ee6-4855-a1a9-6c88f320e124 Aug 11 04:42:43 devstack sudo[101958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:44 devstack sudo[101953]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b39423eb-0f78-4416-b2c0-8d8c1abd24db tempest-VolumesListAdminTestJSON-482044543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d25b5493-fb9c-4e24-87d9-42acbf9e1689" returned: 0 in 0.600s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b39423eb-0f78-4416-b2c0-8d8c1abd24db tempest-VolumesListAdminTestJSON-482044543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d25b5493-fb9c-4e24-87d9-42acbf9e1689 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:44 devstack sudo[101964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d25b5493-fb9c-4e24-87d9-42acbf9e1689 Aug 11 04:42:44 devstack sudo[101964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:44 devstack sudo[101958]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-33490177-90cb-42ab-bf01-d8bb007c82d3 tempest-VolumesListAdminTestJSON-1992498874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ff235e88-2ee6-4855-a1a9-6c88f320e124" returned: 0 in 0.383s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:44 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-33490177-90cb-42ab-bf01-d8bb007c82d3 tempest-VolumesListAdminTestJSON-1992498874 None] Lock "cinder-quobyte-ff235e88-2ee6-4855-a1a9-6c88f320e124" released by "delete_volume" :: held 0.964s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:42:44 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-33490177-90cb-42ab-bf01-d8bb007c82d3 tempest-VolumesListAdminTestJSON-1992498874 None] Created reservations ['59472b3f-7e13-448e-bb64-4d6b9a8594cb', 'ecd1203d-d726-4159-9bf0-26bcf54958ce', 'f1c6355c-61ef-4735-8109-5bf8fbaa4fa7', '5ecb2f55-c8bf-43b4-9f0c-5ed381428d1a'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:42:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-33490177-90cb-42ab-bf01-d8bb007c82d3 tempest-VolumesListAdminTestJSON-1992498874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:42:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-33490177-90cb-42ab-bf01-d8bb007c82d3 tempest-VolumesListAdminTestJSON-1992498874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:42:44 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-33490177-90cb-42ab-bf01-d8bb007c82d3 tempest-VolumesListAdminTestJSON-1992498874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:42:44 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-33490177-90cb-42ab-bf01-d8bb007c82d3 tempest-VolumesListAdminTestJSON-1992498874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:42:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-33490177-90cb-42ab-bf01-d8bb007c82d3 tempest-VolumesListAdminTestJSON-1992498874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:42:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-33490177-90cb-42ab-bf01-d8bb007c82d3 tempest-VolumesListAdminTestJSON-1992498874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:44 devstack sudo[101966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:42:44 devstack sudo[101966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:44 devstack sudo[101964]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b39423eb-0f78-4416-b2c0-8d8c1abd24db tempest-VolumesListAdminTestJSON-482044543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d25b5493-fb9c-4e24-87d9-42acbf9e1689" returned: 0 in 0.449s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:44 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b39423eb-0f78-4416-b2c0-8d8c1abd24db tempest-VolumesListAdminTestJSON-482044543 None] Lock "cinder-quobyte-d25b5493-fb9c-4e24-87d9-42acbf9e1689" released by "delete_volume" :: held 1.136s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:42:44 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-b39423eb-0f78-4416-b2c0-8d8c1abd24db tempest-VolumesListAdminTestJSON-482044543 None] Created reservations ['d0ae001f-4785-4f34-a95c-534894b96f2c', 'bc995547-44b3-49bd-a87c-5b402e25ff73', 'ae39e7c2-a7a8-49cf-a06e-aad1991594ba', '15fba7c6-83ae-4b6d-b65a-a5f64f820261'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:42:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b39423eb-0f78-4416-b2c0-8d8c1abd24db tempest-VolumesListAdminTestJSON-482044543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:42:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b39423eb-0f78-4416-b2c0-8d8c1abd24db tempest-VolumesListAdminTestJSON-482044543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:42:44 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b39423eb-0f78-4416-b2c0-8d8c1abd24db tempest-VolumesListAdminTestJSON-482044543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:42:44 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b39423eb-0f78-4416-b2c0-8d8c1abd24db tempest-VolumesListAdminTestJSON-482044543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:42:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b39423eb-0f78-4416-b2c0-8d8c1abd24db tempest-VolumesListAdminTestJSON-482044543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:42:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b39423eb-0f78-4416-b2c0-8d8c1abd24db tempest-VolumesListAdminTestJSON-482044543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:44 devstack sudo[101966]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-33490177-90cb-42ab-bf01-d8bb007c82d3 tempest-VolumesListAdminTestJSON-1992498874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.433s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:44 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-33490177-90cb-42ab-bf01-d8bb007c82d3 tempest-VolumesListAdminTestJSON-1992498874 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:42:44 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-33490177-90cb-42ab-bf01-d8bb007c82d3 tempest-VolumesListAdminTestJSON-1992498874 None] Deleted volume successfully. Aug 11 04:42:44 devstack sudo[101970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:42:44 devstack sudo[101970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:44 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-33490177-90cb-42ab-bf01-d8bb007c82d3 tempest-VolumesListAdminTestJSON-1992498874 None] Lock "cinder-ff235e88-2ee6-4855-a1a9-6c88f320e124-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:42:45 devstack sudo[101970]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b39423eb-0f78-4416-b2c0-8d8c1abd24db tempest-VolumesListAdminTestJSON-482044543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.387s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:45 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-b39423eb-0f78-4416-b2c0-8d8c1abd24db tempest-VolumesListAdminTestJSON-482044543 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:42:45 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-b39423eb-0f78-4416-b2c0-8d8c1abd24db tempest-VolumesListAdminTestJSON-482044543 None] Deleted volume successfully. Aug 11 04:42:45 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b39423eb-0f78-4416-b2c0-8d8c1abd24db tempest-VolumesListAdminTestJSON-482044543 None] Lock "cinder-d25b5493-fb9c-4e24-87d9-42acbf9e1689-delete_volume" released by "delete_volume" :: held 1.825s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:42:45 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6bedb332-f78c-4e47-a285-76258a81c1f8 tempest-VolumesListAdminTestJSON-482044543 None] Acquiring lock "cinder-5c67522a-07c7-4c54-8bc2-d2d1862a4df6-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:42:45 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6bedb332-f78c-4e47-a285-76258a81c1f8 tempest-VolumesListAdminTestJSON-482044543 None] Lock "cinder-5c67522a-07c7-4c54-8bc2-d2d1862a4df6-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:42:45 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6bedb332-f78c-4e47-a285-76258a81c1f8 tempest-VolumesListAdminTestJSON-482044543 None] Acquiring lock "cinder-quobyte-5c67522a-07c7-4c54-8bc2-d2d1862a4df6" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:42:45 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6bedb332-f78c-4e47-a285-76258a81c1f8 tempest-VolumesListAdminTestJSON-482044543 None] Lock "cinder-quobyte-5c67522a-07c7-4c54-8bc2-d2d1862a4df6" acquired by "delete_volume" :: waited 0.026s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:42:46 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[31290bfa-49f7-4668-aae5-cf395ed7d875]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:42:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6bedb332-f78c-4e47-a285-76258a81c1f8 tempest-VolumesListAdminTestJSON-482044543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5c67522a-07c7-4c54-8bc2-d2d1862a4df6 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:46 devstack sudo[101975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5c67522a-07c7-4c54-8bc2-d2d1862a4df6 Aug 11 04:42:46 devstack sudo[101975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:46 devstack sudo[101975]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6bedb332-f78c-4e47-a285-76258a81c1f8 tempest-VolumesListAdminTestJSON-482044543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5c67522a-07c7-4c54-8bc2-d2d1862a4df6" returned: 0 in 0.559s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6bedb332-f78c-4e47-a285-76258a81c1f8 tempest-VolumesListAdminTestJSON-482044543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5c67522a-07c7-4c54-8bc2-d2d1862a4df6 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:46 devstack sudo[101981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5c67522a-07c7-4c54-8bc2-d2d1862a4df6 Aug 11 04:42:46 devstack sudo[101981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:46 devstack sudo[101981]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6bedb332-f78c-4e47-a285-76258a81c1f8 tempest-VolumesListAdminTestJSON-482044543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5c67522a-07c7-4c54-8bc2-d2d1862a4df6" returned: 0 in 0.376s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:46 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6bedb332-f78c-4e47-a285-76258a81c1f8 tempest-VolumesListAdminTestJSON-482044543 None] Lock "cinder-quobyte-5c67522a-07c7-4c54-8bc2-d2d1862a4df6" released by "delete_volume" :: held 1.012s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:42:47 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-6bedb332-f78c-4e47-a285-76258a81c1f8 tempest-VolumesListAdminTestJSON-482044543 None] Created reservations ['f79c0fe2-2ef0-4072-8731-b5929b054f79', 'f70ea7d2-4a7a-465e-86d1-dafef1c14ae5', '1bc7de33-fd23-459a-abed-fe6055c822c4', 'a93772f7-8d8c-48ab-8eeb-4430ca293c65'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:42:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6bedb332-f78c-4e47-a285-76258a81c1f8 tempest-VolumesListAdminTestJSON-482044543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:42:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6bedb332-f78c-4e47-a285-76258a81c1f8 tempest-VolumesListAdminTestJSON-482044543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:42:47 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6bedb332-f78c-4e47-a285-76258a81c1f8 tempest-VolumesListAdminTestJSON-482044543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:42:47 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6bedb332-f78c-4e47-a285-76258a81c1f8 tempest-VolumesListAdminTestJSON-482044543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:42:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6bedb332-f78c-4e47-a285-76258a81c1f8 tempest-VolumesListAdminTestJSON-482044543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:42:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6bedb332-f78c-4e47-a285-76258a81c1f8 tempest-VolumesListAdminTestJSON-482044543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:47 devstack sudo[101991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:42:47 devstack sudo[101991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:47 devstack sudo[101991]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6bedb332-f78c-4e47-a285-76258a81c1f8 tempest-VolumesListAdminTestJSON-482044543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.411s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:47 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-6bedb332-f78c-4e47-a285-76258a81c1f8 tempest-VolumesListAdminTestJSON-482044543 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:42:47 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-6bedb332-f78c-4e47-a285-76258a81c1f8 tempest-VolumesListAdminTestJSON-482044543 None] Deleted volume successfully. Aug 11 04:42:47 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6bedb332-f78c-4e47-a285-76258a81c1f8 tempest-VolumesListAdminTestJSON-482044543 None] Lock "cinder-5c67522a-07c7-4c54-8bc2-d2d1862a4df6-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:42:48 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd3518bc-23e8-4543-9bd1-f82716d17ccd tempest-AbsoluteLimitsTests-463023636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:42:48 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bd3518bc-23e8-4543-9bd1-f82716d17ccd tempest-AbsoluteLimitsTests-463023636 None] Flow 'volume_create_manager' (045990a8-5cb6-4371-976e-b43b45a8a9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:42:48 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bd3518bc-23e8-4543-9bd1-f82716d17ccd tempest-AbsoluteLimitsTests-463023636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5501ac81-1bad-4391-8812-5f5c7fc7151f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:48 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bd3518bc-23e8-4543-9bd1-f82716d17ccd tempest-AbsoluteLimitsTests-463023636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5501ac81-1bad-4391-8812-5f5c7fc7151f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:42:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1534513296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a64a0040-aaaf-4fda-9181-dc537b0ea968,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3b58d5d6fa74dcbb89b5da32b2d2258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:42:48Z,use_quota=True,user_id='74ae5130ec534a2e9bd047e13e9af84d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:48 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bd3518bc-23e8-4543-9bd1-f82716d17ccd tempest-AbsoluteLimitsTests-463023636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa589f2d-4631-452e-ac19-d7aee8d09a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:48 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bd3518bc-23e8-4543-9bd1-f82716d17ccd tempest-AbsoluteLimitsTests-463023636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa589f2d-4631-452e-ac19-d7aee8d09a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:48 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bd3518bc-23e8-4543-9bd1-f82716d17ccd tempest-AbsoluteLimitsTests-463023636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1751acec-4347-490c-9158-45220420b02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:48 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bd3518bc-23e8-4543-9bd1-f82716d17ccd tempest-AbsoluteLimitsTests-463023636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1751acec-4347-490c-9158-45220420b02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a64a0040-aaaf-4fda-9181-dc537b0ea968', 'volume_name': 'volume-a64a0040-aaaf-4fda-9181-dc537b0ea968', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:48 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bd3518bc-23e8-4543-9bd1-f82716d17ccd tempest-AbsoluteLimitsTests-463023636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0719eb9e-8850-4f09-90e9-f187e2fcb657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:48 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bd3518bc-23e8-4543-9bd1-f82716d17ccd tempest-AbsoluteLimitsTests-463023636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0719eb9e-8850-4f09-90e9-f187e2fcb657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:48 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bd3518bc-23e8-4543-9bd1-f82716d17ccd tempest-AbsoluteLimitsTests-463023636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a41e36d0-1bfa-4fc5-b28c-7d5fde45d903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:48 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-bd3518bc-23e8-4543-9bd1-f82716d17ccd tempest-AbsoluteLimitsTests-463023636 None] Volume a64a0040-aaaf-4fda-9181-dc537b0ea968: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a64a0040-aaaf-4fda-9181-dc537b0ea968', 'volume_size': 1} Aug 11 04:42:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bd3518bc-23e8-4543-9bd1-f82716d17ccd tempest-AbsoluteLimitsTests-463023636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:42:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bd3518bc-23e8-4543-9bd1-f82716d17ccd tempest-AbsoluteLimitsTests-463023636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:42:48 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-bd3518bc-23e8-4543-9bd1-f82716d17ccd tempest-AbsoluteLimitsTests-463023636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:42:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1534513296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a64a0040-aaaf-4fda-9181-dc537b0ea968,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3b58d5d6fa74dcbb89b5da32b2d2258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:42:48Z,use_quota=True,user_id='74ae5130ec534a2e9bd047e13e9af84d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:42:48 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-bd3518bc-23e8-4543-9bd1-f82716d17ccd tempest-AbsoluteLimitsTests-463023636 None] Creating volume a64a0040-aaaf-4fda-9181-dc537b0ea968 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:42:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bd3518bc-23e8-4543-9bd1-f82716d17ccd tempest-AbsoluteLimitsTests-463023636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:42:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bd3518bc-23e8-4543-9bd1-f82716d17ccd tempest-AbsoluteLimitsTests-463023636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:42:48 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-bd3518bc-23e8-4543-9bd1-f82716d17ccd tempest-AbsoluteLimitsTests-463023636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:42:48 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-bd3518bc-23e8-4543-9bd1-f82716d17ccd tempest-AbsoluteLimitsTests-463023636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:42:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bd3518bc-23e8-4543-9bd1-f82716d17ccd tempest-AbsoluteLimitsTests-463023636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:42:48 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-bd3518bc-23e8-4543-9bd1-f82716d17ccd tempest-AbsoluteLimitsTests-463023636 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:42:48 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-bd3518bc-23e8-4543-9bd1-f82716d17ccd tempest-AbsoluteLimitsTests-463023636 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:42:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bd3518bc-23e8-4543-9bd1-f82716d17ccd tempest-AbsoluteLimitsTests-463023636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a64a0040-aaaf-4fda-9181-dc537b0ea968 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:48 devstack sudo[102010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a64a0040-aaaf-4fda-9181-dc537b0ea968 1073741824 Aug 11 04:42:48 devstack sudo[102010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:48 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-d3d34b1c-e3a8-48a6-a93b-ec243779a8c7 req-285fde0f-6c25-4ecd-b165-a026d8daef3d tempest-ServerActionsTestOtherA-1583977559 None] Terminate volume connection completed successfully. Aug 11 04:42:48 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-d3d34b1c-e3a8-48a6-a93b-ec243779a8c7 req-285fde0f-6c25-4ecd-b165-a026d8daef3d tempest-ServerActionsTestOtherA-1583977559 None] Deleting attachment 12f4c62d-b3d9-4198-b7a3-31c2d3e1e267. {{(pid=94472) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 11 04:42:48 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1bf242a8-b78b-49d7-9ab6-a854b6abfa8e tempest-VolumesListAdminTestJSON-482044543 None] Acquiring lock "cinder-817d8ee2-7f2b-47f3-8fb8-025f9fb6c443-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:42:48 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1bf242a8-b78b-49d7-9ab6-a854b6abfa8e tempest-VolumesListAdminTestJSON-482044543 None] Lock "cinder-817d8ee2-7f2b-47f3-8fb8-025f9fb6c443-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:42:48 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1bf242a8-b78b-49d7-9ab6-a854b6abfa8e tempest-VolumesListAdminTestJSON-482044543 None] Acquiring lock "cinder-quobyte-817d8ee2-7f2b-47f3-8fb8-025f9fb6c443" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:42:48 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1bf242a8-b78b-49d7-9ab6-a854b6abfa8e tempest-VolumesListAdminTestJSON-482044543 None] Lock "cinder-quobyte-817d8ee2-7f2b-47f3-8fb8-025f9fb6c443" acquired by "delete_volume" :: waited 0.021s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:42:48 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56f57f4-5287-495b-ae86-dd0c3f15b322]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:42:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1bf242a8-b78b-49d7-9ab6-a854b6abfa8e tempest-VolumesListAdminTestJSON-482044543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-817d8ee2-7f2b-47f3-8fb8-025f9fb6c443 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:48 devstack sudo[102012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-817d8ee2-7f2b-47f3-8fb8-025f9fb6c443 Aug 11 04:42:48 devstack sudo[102012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:48 devstack sudo[102010]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bd3518bc-23e8-4543-9bd1-f82716d17ccd tempest-AbsoluteLimitsTests-463023636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a64a0040-aaaf-4fda-9181-dc537b0ea968 1073741824" returned: 0 in 0.637s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bd3518bc-23e8-4543-9bd1-f82716d17ccd tempest-AbsoluteLimitsTests-463023636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a64a0040-aaaf-4fda-9181-dc537b0ea968 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:48 devstack sudo[102018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a64a0040-aaaf-4fda-9181-dc537b0ea968 Aug 11 04:42:48 devstack sudo[102018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:49 devstack sudo[102012]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1bf242a8-b78b-49d7-9ab6-a854b6abfa8e tempest-VolumesListAdminTestJSON-482044543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-817d8ee2-7f2b-47f3-8fb8-025f9fb6c443" returned: 0 in 0.492s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1bf242a8-b78b-49d7-9ab6-a854b6abfa8e tempest-VolumesListAdminTestJSON-482044543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-817d8ee2-7f2b-47f3-8fb8-025f9fb6c443 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:49 devstack sudo[102023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-817d8ee2-7f2b-47f3-8fb8-025f9fb6c443 Aug 11 04:42:49 devstack sudo[102023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:49 devstack sudo[102018]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bd3518bc-23e8-4543-9bd1-f82716d17ccd tempest-AbsoluteLimitsTests-463023636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a64a0040-aaaf-4fda-9181-dc537b0ea968" returned: 0 in 0.300s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:49 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-bd3518bc-23e8-4543-9bd1-f82716d17ccd tempest-AbsoluteLimitsTests-463023636 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:42:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bd3518bc-23e8-4543-9bd1-f82716d17ccd tempest-AbsoluteLimitsTests-463023636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:42:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bd3518bc-23e8-4543-9bd1-f82716d17ccd tempest-AbsoluteLimitsTests-463023636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a41e36d0-1bfa-4fc5-b28c-7d5fde45d903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a64a0040-aaaf-4fda-9181-dc537b0ea968', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bd3518bc-23e8-4543-9bd1-f82716d17ccd tempest-AbsoluteLimitsTests-463023636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c744b223-52d1-4dca-a522-1ff1f6f857cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:49 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-bd3518bc-23e8-4543-9bd1-f82716d17ccd tempest-AbsoluteLimitsTests-463023636 None] Volume volume-a64a0040-aaaf-4fda-9181-dc537b0ea968 (a64a0040-aaaf-4fda-9181-dc537b0ea968): created successfully Aug 11 04:42:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bd3518bc-23e8-4543-9bd1-f82716d17ccd tempest-AbsoluteLimitsTests-463023636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c744b223-52d1-4dca-a522-1ff1f6f857cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bd3518bc-23e8-4543-9bd1-f82716d17ccd tempest-AbsoluteLimitsTests-463023636 None] Flow 'volume_create_manager' (045990a8-5cb6-4371-976e-b43b45a8a9f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:42:49 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-bd3518bc-23e8-4543-9bd1-f82716d17ccd tempest-AbsoluteLimitsTests-463023636 None] Created volume successfully. Aug 11 04:42:49 devstack sudo[102023]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1bf242a8-b78b-49d7-9ab6-a854b6abfa8e tempest-VolumesListAdminTestJSON-482044543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-817d8ee2-7f2b-47f3-8fb8-025f9fb6c443" returned: 0 in 0.309s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:49 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1bf242a8-b78b-49d7-9ab6-a854b6abfa8e tempest-VolumesListAdminTestJSON-482044543 None] Lock "cinder-quobyte-817d8ee2-7f2b-47f3-8fb8-025f9fb6c443" released by "delete_volume" :: held 0.859s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:42:49 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-1bf242a8-b78b-49d7-9ab6-a854b6abfa8e tempest-VolumesListAdminTestJSON-482044543 None] Created reservations ['1fcb1492-b66a-4ca4-b8f3-459801d456a7', 'fad6d112-bde9-4b8d-a20f-9cf12379cd99', '52282efc-ded2-4c84-8909-9ad6f71d3d45', 'cde58ab4-4e11-4e71-beba-d9c11038fbf9'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:42:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1bf242a8-b78b-49d7-9ab6-a854b6abfa8e tempest-VolumesListAdminTestJSON-482044543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:42:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1bf242a8-b78b-49d7-9ab6-a854b6abfa8e tempest-VolumesListAdminTestJSON-482044543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:42:49 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1bf242a8-b78b-49d7-9ab6-a854b6abfa8e tempest-VolumesListAdminTestJSON-482044543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:42:49 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1bf242a8-b78b-49d7-9ab6-a854b6abfa8e tempest-VolumesListAdminTestJSON-482044543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:42:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1bf242a8-b78b-49d7-9ab6-a854b6abfa8e tempest-VolumesListAdminTestJSON-482044543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:42:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1bf242a8-b78b-49d7-9ab6-a854b6abfa8e tempest-VolumesListAdminTestJSON-482044543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:49 devstack sudo[102027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:42:49 devstack sudo[102027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:49 devstack sudo[102027]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1bf242a8-b78b-49d7-9ab6-a854b6abfa8e tempest-VolumesListAdminTestJSON-482044543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.279s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:49 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-1bf242a8-b78b-49d7-9ab6-a854b6abfa8e tempest-VolumesListAdminTestJSON-482044543 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:42:49 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-1bf242a8-b78b-49d7-9ab6-a854b6abfa8e tempest-VolumesListAdminTestJSON-482044543 None] Deleted volume successfully. Aug 11 04:42:49 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1bf242a8-b78b-49d7-9ab6-a854b6abfa8e tempest-VolumesListAdminTestJSON-482044543 None] Lock "cinder-817d8ee2-7f2b-47f3-8fb8-025f9fb6c443-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:42:50 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-99e71677-e12c-4e04-b338-5f2ff317d405 tempest-AbsoluteLimitsTests-463023636 None] Acquiring lock "cinder-a64a0040-aaaf-4fda-9181-dc537b0ea968-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:42:50 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-99e71677-e12c-4e04-b338-5f2ff317d405 tempest-AbsoluteLimitsTests-463023636 None] Lock "cinder-a64a0040-aaaf-4fda-9181-dc537b0ea968-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:42:50 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-99e71677-e12c-4e04-b338-5f2ff317d405 tempest-AbsoluteLimitsTests-463023636 None] Acquiring lock "cinder-quobyte-a64a0040-aaaf-4fda-9181-dc537b0ea968" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:42:50 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-99e71677-e12c-4e04-b338-5f2ff317d405 tempest-AbsoluteLimitsTests-463023636 None] Lock "cinder-quobyte-a64a0040-aaaf-4fda-9181-dc537b0ea968" acquired by "delete_volume" :: waited 0.030s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:42:50 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a682e6-12d7-40d8-80fe-b157918544d4]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:42:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-99e71677-e12c-4e04-b338-5f2ff317d405 tempest-AbsoluteLimitsTests-463023636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a64a0040-aaaf-4fda-9181-dc537b0ea968 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:50 devstack sudo[102044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a64a0040-aaaf-4fda-9181-dc537b0ea968 Aug 11 04:42:50 devstack sudo[102044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:51 devstack sudo[102044]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-99e71677-e12c-4e04-b338-5f2ff317d405 tempest-AbsoluteLimitsTests-463023636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a64a0040-aaaf-4fda-9181-dc537b0ea968" returned: 0 in 0.606s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-99e71677-e12c-4e04-b338-5f2ff317d405 tempest-AbsoluteLimitsTests-463023636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a64a0040-aaaf-4fda-9181-dc537b0ea968 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:51 devstack sudo[102062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a64a0040-aaaf-4fda-9181-dc537b0ea968 Aug 11 04:42:51 devstack sudo[102062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:51 devstack sudo[102062]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-99e71677-e12c-4e04-b338-5f2ff317d405 tempest-AbsoluteLimitsTests-463023636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a64a0040-aaaf-4fda-9181-dc537b0ea968" returned: 0 in 0.492s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:51 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-99e71677-e12c-4e04-b338-5f2ff317d405 tempest-AbsoluteLimitsTests-463023636 None] Lock "cinder-quobyte-a64a0040-aaaf-4fda-9181-dc537b0ea968" released by "delete_volume" :: held 1.214s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:42:51 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-99e71677-e12c-4e04-b338-5f2ff317d405 tempest-AbsoluteLimitsTests-463023636 None] Created reservations ['e533a7fe-cbe9-4193-8341-e634a95d8dfd', '63ba45ca-575c-40de-86fb-1edaec450b8c', 'fe70c111-d273-4f82-a811-54f9a923fc38', '0221e8b6-b361-49f1-bc0a-c7666e66dd02'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:42:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-99e71677-e12c-4e04-b338-5f2ff317d405 tempest-AbsoluteLimitsTests-463023636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:42:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-99e71677-e12c-4e04-b338-5f2ff317d405 tempest-AbsoluteLimitsTests-463023636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:42:51 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-99e71677-e12c-4e04-b338-5f2ff317d405 tempest-AbsoluteLimitsTests-463023636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:42:51 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-99e71677-e12c-4e04-b338-5f2ff317d405 tempest-AbsoluteLimitsTests-463023636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:42:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-99e71677-e12c-4e04-b338-5f2ff317d405 tempest-AbsoluteLimitsTests-463023636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:42:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-99e71677-e12c-4e04-b338-5f2ff317d405 tempest-AbsoluteLimitsTests-463023636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:51 devstack sudo[102065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:42:51 devstack sudo[102065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:52 devstack sudo[102065]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-99e71677-e12c-4e04-b338-5f2ff317d405 tempest-AbsoluteLimitsTests-463023636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.452s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:52 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-99e71677-e12c-4e04-b338-5f2ff317d405 tempest-AbsoluteLimitsTests-463023636 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:42:52 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-99e71677-e12c-4e04-b338-5f2ff317d405 tempest-AbsoluteLimitsTests-463023636 None] Deleted volume successfully. Aug 11 04:42:52 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-99e71677-e12c-4e04-b338-5f2ff317d405 tempest-AbsoluteLimitsTests-463023636 None] Lock "cinder-a64a0040-aaaf-4fda-9181-dc537b0ea968-delete_volume" released by "delete_volume" :: held 2.000s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:42:56 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-b82009d9-a600-415b-bd41-887d20df715b tempest-VolumesDeleteCascade-645296602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:42:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b82009d9-a600-415b-bd41-887d20df715b tempest-VolumesDeleteCascade-645296602 None] Flow 'volume_create_manager' (2fb8031e-7951-4837-963f-6cfe4f0eb3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:42:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b82009d9-a600-415b-bd41-887d20df715b tempest-VolumesDeleteCascade-645296602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6af3f97e-9099-4d3c-88d9-1ba9440bf522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b82009d9-a600-415b-bd41-887d20df715b tempest-VolumesDeleteCascade-645296602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6af3f97e-9099-4d3c-88d9-1ba9440bf522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1821450434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee3622b6-91f1-4fe6-8aae-dfebc02e78d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbe93bb5603848eba45539e8146020cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:42:57Z,use_quota=True,user_id='7fa33174b58b4d279b065a80d28891ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b82009d9-a600-415b-bd41-887d20df715b tempest-VolumesDeleteCascade-645296602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a25e9c83-0fc3-4564-a38d-934555f90cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b82009d9-a600-415b-bd41-887d20df715b tempest-VolumesDeleteCascade-645296602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a25e9c83-0fc3-4564-a38d-934555f90cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b82009d9-a600-415b-bd41-887d20df715b tempest-VolumesDeleteCascade-645296602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a178c8ca-e6bf-4e15-a885-59239cb0a9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b82009d9-a600-415b-bd41-887d20df715b tempest-VolumesDeleteCascade-645296602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a178c8ca-e6bf-4e15-a885-59239cb0a9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee3622b6-91f1-4fe6-8aae-dfebc02e78d4', 'volume_name': 'volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b82009d9-a600-415b-bd41-887d20df715b tempest-VolumesDeleteCascade-645296602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fe19010-09fb-4a42-b387-39c16e880a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b82009d9-a600-415b-bd41-887d20df715b tempest-VolumesDeleteCascade-645296602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fe19010-09fb-4a42-b387-39c16e880a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b82009d9-a600-415b-bd41-887d20df715b tempest-VolumesDeleteCascade-645296602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8217f1c6-9e7b-4149-b1d7-fe565e7cdba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:56 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-b82009d9-a600-415b-bd41-887d20df715b tempest-VolumesDeleteCascade-645296602 None] Volume ee3622b6-91f1-4fe6-8aae-dfebc02e78d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4', 'volume_size': 1} Aug 11 04:42:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b82009d9-a600-415b-bd41-887d20df715b tempest-VolumesDeleteCascade-645296602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:42:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b82009d9-a600-415b-bd41-887d20df715b tempest-VolumesDeleteCascade-645296602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:42:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b82009d9-a600-415b-bd41-887d20df715b tempest-VolumesDeleteCascade-645296602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1821450434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee3622b6-91f1-4fe6-8aae-dfebc02e78d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbe93bb5603848eba45539e8146020cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:42:57Z,use_quota=True,user_id='7fa33174b58b4d279b065a80d28891ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:42:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-b82009d9-a600-415b-bd41-887d20df715b tempest-VolumesDeleteCascade-645296602 None] Creating volume ee3622b6-91f1-4fe6-8aae-dfebc02e78d4 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:42:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b82009d9-a600-415b-bd41-887d20df715b tempest-VolumesDeleteCascade-645296602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:42:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b82009d9-a600-415b-bd41-887d20df715b tempest-VolumesDeleteCascade-645296602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:42:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b82009d9-a600-415b-bd41-887d20df715b tempest-VolumesDeleteCascade-645296602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:42:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b82009d9-a600-415b-bd41-887d20df715b tempest-VolumesDeleteCascade-645296602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:42:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b82009d9-a600-415b-bd41-887d20df715b tempest-VolumesDeleteCascade-645296602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:42:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b82009d9-a600-415b-bd41-887d20df715b tempest-VolumesDeleteCascade-645296602 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:42:56 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-b82009d9-a600-415b-bd41-887d20df715b tempest-VolumesDeleteCascade-645296602 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:42:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b82009d9-a600-415b-bd41-887d20df715b tempest-VolumesDeleteCascade-645296602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:56 devstack sudo[102072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4 1073741824 Aug 11 04:42:56 devstack sudo[102072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:57 devstack sudo[102072]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b82009d9-a600-415b-bd41-887d20df715b tempest-VolumesDeleteCascade-645296602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4 1073741824" returned: 0 in 0.730s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b82009d9-a600-415b-bd41-887d20df715b tempest-VolumesDeleteCascade-645296602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:57 devstack sudo[102078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4 Aug 11 04:42:57 devstack sudo[102078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:57 devstack sudo[102078]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b82009d9-a600-415b-bd41-887d20df715b tempest-VolumesDeleteCascade-645296602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4" returned: 0 in 0.313s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b82009d9-a600-415b-bd41-887d20df715b tempest-VolumesDeleteCascade-645296602 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:42:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b82009d9-a600-415b-bd41-887d20df715b tempest-VolumesDeleteCascade-645296602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:42:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b82009d9-a600-415b-bd41-887d20df715b tempest-VolumesDeleteCascade-645296602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8217f1c6-9e7b-4149-b1d7-fe565e7cdba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b82009d9-a600-415b-bd41-887d20df715b tempest-VolumesDeleteCascade-645296602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ef84ffd-3254-489b-bd5f-5b1a731a087e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:57 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-b82009d9-a600-415b-bd41-887d20df715b tempest-VolumesDeleteCascade-645296602 None] Volume volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4 (ee3622b6-91f1-4fe6-8aae-dfebc02e78d4): created successfully Aug 11 04:42:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b82009d9-a600-415b-bd41-887d20df715b tempest-VolumesDeleteCascade-645296602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ef84ffd-3254-489b-bd5f-5b1a731a087e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b82009d9-a600-415b-bd41-887d20df715b tempest-VolumesDeleteCascade-645296602 None] Flow 'volume_create_manager' (2fb8031e-7951-4837-963f-6cfe4f0eb3c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:42:57 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-b82009d9-a600-415b-bd41-887d20df715b tempest-VolumesDeleteCascade-645296602 None] Created volume successfully. Aug 11 04:42:58 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:42:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] Flow 'volume_create_manager' (75dc8da8-3cd6-42c9-a26f-e1f4164cbd1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:42:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b781a376-9621-4a3d-bfa0-23a10ccab673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b781a376-9621-4a3d-bfa0-23a10ccab673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-899582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94c58ff1-a7f5-4c32-9664-ce0425ceb324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55dd6075a81141dcab2ad4ffbcd544ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:42:58Z,use_quota=True,user_id='418876d7fa8c46edb8fd9fac7b14ce95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b1116b7-97b9-4ad6-9a26-ff2451b836ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b1116b7-97b9-4ad6-9a26-ff2451b836ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7f21d8c-ca87-4fb8-9724-80ab26857d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:58 devstack cinder-volume[94472]: DEBUG cinder.image.glance [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] Creating Keystone auth plugin from conf {{(pid=94472) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 11 04:42:58 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-5340c7c3-e279-45aa-9c04-4be45aa59deb tempest-VolumesMetadataTest-99897881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:42:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5340c7c3-e279-45aa-9c04-4be45aa59deb tempest-VolumesMetadataTest-99897881 None] Flow 'volume_create_manager' (71c08552-8633-4bc9-bfdd-b783e55df833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:42:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5340c7c3-e279-45aa-9c04-4be45aa59deb tempest-VolumesMetadataTest-99897881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa5a54cb-9e42-4cf9-800f-48eb0f32d46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5340c7c3-e279-45aa-9c04-4be45aa59deb tempest-VolumesMetadataTest-99897881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa5a54cb-9e42-4cf9-800f-48eb0f32d46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-605954001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5dc09f1-ffe2-4064-a7b5-e5218bb304a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='769e7142b4154ab683268068f3db2a52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:42:58Z,use_quota=True,user_id='47052562d7a64c02a2adef8d627f2d51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5340c7c3-e279-45aa-9c04-4be45aa59deb tempest-VolumesMetadataTest-99897881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8902842f-30dd-4a5a-ac63-e3e3b3e040b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5340c7c3-e279-45aa-9c04-4be45aa59deb tempest-VolumesMetadataTest-99897881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8902842f-30dd-4a5a-ac63-e3e3b3e040b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5340c7c3-e279-45aa-9c04-4be45aa59deb tempest-VolumesMetadataTest-99897881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e96afce-ef92-4442-8653-4f6196da4e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5340c7c3-e279-45aa-9c04-4be45aa59deb tempest-VolumesMetadataTest-99897881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e96afce-ef92-4442-8653-4f6196da4e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5dc09f1-ffe2-4064-a7b5-e5218bb304a3', 'volume_name': 'volume-f5dc09f1-ffe2-4064-a7b5-e5218bb304a3', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5340c7c3-e279-45aa-9c04-4be45aa59deb tempest-VolumesMetadataTest-99897881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (936b3426-b011-4f3d-808c-6e7786a60c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5340c7c3-e279-45aa-9c04-4be45aa59deb tempest-VolumesMetadataTest-99897881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (936b3426-b011-4f3d-808c-6e7786a60c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5340c7c3-e279-45aa-9c04-4be45aa59deb tempest-VolumesMetadataTest-99897881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8420013-738e-4bb2-ba8d-86f8b67ca3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:58 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-5340c7c3-e279-45aa-9c04-4be45aa59deb tempest-VolumesMetadataTest-99897881 None] Volume f5dc09f1-ffe2-4064-a7b5-e5218bb304a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5dc09f1-ffe2-4064-a7b5-e5218bb304a3', 'volume_size': 1} Aug 11 04:42:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5340c7c3-e279-45aa-9c04-4be45aa59deb tempest-VolumesMetadataTest-99897881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:42:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5340c7c3-e279-45aa-9c04-4be45aa59deb tempest-VolumesMetadataTest-99897881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:42:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-5340c7c3-e279-45aa-9c04-4be45aa59deb tempest-VolumesMetadataTest-99897881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-605954001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5dc09f1-ffe2-4064-a7b5-e5218bb304a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='769e7142b4154ab683268068f3db2a52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:42:58Z,use_quota=True,user_id='47052562d7a64c02a2adef8d627f2d51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:42:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-5340c7c3-e279-45aa-9c04-4be45aa59deb tempest-VolumesMetadataTest-99897881 None] Creating volume f5dc09f1-ffe2-4064-a7b5-e5218bb304a3 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:42:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5340c7c3-e279-45aa-9c04-4be45aa59deb tempest-VolumesMetadataTest-99897881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:42:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5340c7c3-e279-45aa-9c04-4be45aa59deb tempest-VolumesMetadataTest-99897881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:42:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-5340c7c3-e279-45aa-9c04-4be45aa59deb tempest-VolumesMetadataTest-99897881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:42:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-5340c7c3-e279-45aa-9c04-4be45aa59deb tempest-VolumesMetadataTest-99897881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:42:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5340c7c3-e279-45aa-9c04-4be45aa59deb tempest-VolumesMetadataTest-99897881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:42:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-5340c7c3-e279-45aa-9c04-4be45aa59deb tempest-VolumesMetadataTest-99897881 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:42:58 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-5340c7c3-e279-45aa-9c04-4be45aa59deb tempest-VolumesMetadataTest-99897881 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:42:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5340c7c3-e279-45aa-9c04-4be45aa59deb tempest-VolumesMetadataTest-99897881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f5dc09f1-ffe2-4064-a7b5-e5218bb304a3 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:58 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 04:42:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:42:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:42:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:42:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:42:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:42:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:58 devstack sudo[102081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f5dc09f1-ffe2-4064-a7b5-e5218bb304a3 1073741824 Aug 11 04:42:58 devstack sudo[102081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:58 devstack sudo[102083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:42:58 devstack sudo[102083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7f21d8c-ca87-4fb8-9724-80ab26857d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '94c58ff1-a7f5-4c32-9664-ce0425ceb324', 'volume_name': 'volume-94c58ff1-a7f5-4c32-9664-ce0425ceb324', 'volume_size': 1, 'image_id': '935df48c-f244-44af-83c6-4799aff908b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/935df48c-f244-44af-83c6-4799aff908b2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f74f87914afa4c849e1ab3e938cfb579', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '935df48c-f244-44af-83c6-4799aff908b2', 'created_at': datetime.datetime(2026, 8, 11, 2, 32, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 2, 32, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/935df48c-f244-44af-83c6-4799aff908b2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (793c5759-dce6-4d02-9a71-8a2f411a81e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (793c5759-dce6-4d02-9a71-8a2f411a81e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e513a86-eef2-4b65-93e7-a5077a050d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:58 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] Volume 94c58ff1-a7f5-4c32-9664-ce0425ceb324: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-94c58ff1-a7f5-4c32-9664-ce0425ceb324', 'volume_size': 1, 'image_id': '935df48c-f244-44af-83c6-4799aff908b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/935df48c-f244-44af-83c6-4799aff908b2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f74f87914afa4c849e1ab3e938cfb579', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '935df48c-f244-44af-83c6-4799aff908b2', 'created_at': datetime.datetime(2026, 8, 11, 2, 32, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 2, 32, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/935df48c-f244-44af-83c6-4799aff908b2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 11 04:42:58 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] Trying to clone 94c58ff1-a7f5-4c32-9664-ce0425ceb324 from image 935df48c-f244-44af-83c6-4799aff908b2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/935df48c-f244-44af-83c6-4799aff908b2', 'metadata': {}}]). {{(pid=94472) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 11 04:42:58 devstack sudo[102083]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.454s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:58 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:42:58 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running periodic task VolumeManager._thread_info {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 04:42:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] thread count: 28 {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 11 04:42:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] thread info: [<_MainThread(MainThread, started 133315846115456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 11 04:42:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c9fd25b7-9b5a-4581-a025-a6924f30d4ea tempest-VolumesDeleteCascade-645296602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:42:59 devstack sudo[102081]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5340c7c3-e279-45aa-9c04-4be45aa59deb tempest-VolumesMetadataTest-99897881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f5dc09f1-ffe2-4064-a7b5-e5218bb304a3 1073741824" returned: 0 in 0.724s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5340c7c3-e279-45aa-9c04-4be45aa59deb tempest-VolumesMetadataTest-99897881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f5dc09f1-ffe2-4064-a7b5-e5218bb304a3 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:59 devstack sudo[102090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f5dc09f1-ffe2-4064-a7b5-e5218bb304a3 Aug 11 04:42:59 devstack sudo[102090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:59 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_gzkyf79zdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 11 04:42:59 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] Image download 20.69 MB at 20.69 MB/s Aug 11 04:42:59 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[4210480b-47d4-4479-aa04-4a42b257849c]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:42:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_gzkyf79zdevstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:59 devstack sudo[102093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_gzkyf79zdevstack@QuobyteHD Aug 11 04:42:59 devstack sudo[102093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:59 devstack sudo[102090]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5340c7c3-e279-45aa-9c04-4be45aa59deb tempest-VolumesMetadataTest-99897881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f5dc09f1-ffe2-4064-a7b5-e5218bb304a3" returned: 0 in 0.329s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:59 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-5340c7c3-e279-45aa-9c04-4be45aa59deb tempest-VolumesMetadataTest-99897881 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:42:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5340c7c3-e279-45aa-9c04-4be45aa59deb tempest-VolumesMetadataTest-99897881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:42:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c9fd25b7-9b5a-4581-a025-a6924f30d4ea tempest-VolumesDeleteCascade-645296602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.620s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:42:59 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-c9fd25b7-9b5a-4581-a025-a6924f30d4ea tempest-VolumesDeleteCascade-645296602 None] Creating offline snapshot d0d3e93f-6ca5-4173-8d31-314687d3104f of volume ee3622b6-91f1-4fe6-8aae-dfebc02e78d4 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 04:42:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5340c7c3-e279-45aa-9c04-4be45aa59deb tempest-VolumesMetadataTest-99897881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8420013-738e-4bb2-ba8d-86f8b67ca3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5dc09f1-ffe2-4064-a7b5-e5218bb304a3', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5340c7c3-e279-45aa-9c04-4be45aa59deb tempest-VolumesMetadataTest-99897881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdb62ccf-9ff1-44ea-8420-86c5076c413e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:42:59 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[9887cad0-1ebc-4734-a913-68352d2489b2]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:42:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c9fd25b7-9b5a-4581-a025-a6924f30d4ea tempest-VolumesDeleteCascade-645296602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:59 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-5340c7c3-e279-45aa-9c04-4be45aa59deb tempest-VolumesMetadataTest-99897881 None] Volume volume-f5dc09f1-ffe2-4064-a7b5-e5218bb304a3 (f5dc09f1-ffe2-4064-a7b5-e5218bb304a3): created successfully Aug 11 04:42:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5340c7c3-e279-45aa-9c04-4be45aa59deb tempest-VolumesMetadataTest-99897881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdb62ccf-9ff1-44ea-8420-86c5076c413e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:42:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5340c7c3-e279-45aa-9c04-4be45aa59deb tempest-VolumesMetadataTest-99897881 None] Flow 'volume_create_manager' (71c08552-8633-4bc9-bfdd-b783e55df833) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:42:59 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-5340c7c3-e279-45aa-9c04-4be45aa59deb tempest-VolumesMetadataTest-99897881 None] Created volume successfully. Aug 11 04:42:59 devstack sudo[102093]: pam_unix(sudo:session): session closed for user root Aug 11 04:42:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_gzkyf79zdevstack@QuobyteHD" returned: 0 in 0.353s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:42:59 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] Temporary image 935df48c-f244-44af-83c6-4799aff908b2 is fetched for user 418876d7fa8c46edb8fd9fac7b14ce95. {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 11 04:42:59 devstack sudo[102096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4 Aug 11 04:42:59 devstack sudo[102096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:42:59 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[34559879-a68c-4120-ae7a-5668e1d29753]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:42:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_gzkyf79zdevstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:42:59 devstack sudo[102101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_gzkyf79zdevstack@QuobyteHD Aug 11 04:42:59 devstack sudo[102101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:00 devstack sudo[102096]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c9fd25b7-9b5a-4581-a025-a6924f30d4ea tempest-VolumesDeleteCascade-645296602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4" returned: 0 in 0.422s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c9fd25b7-9b5a-4581-a025-a6924f30d4ea tempest-VolumesDeleteCascade-645296602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.d0d3e93f-6ca5-4173-8d31-314687d3104f 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:00 devstack sudo[102106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.d0d3e93f-6ca5-4173-8d31-314687d3104f 1G Aug 11 04:43:00 devstack sudo[102106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:00 devstack sudo[102101]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_gzkyf79zdevstack@QuobyteHD" returned: 0 in 0.364s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:43:00 devstack sudo[102106]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c9fd25b7-9b5a-4581-a025-a6924f30d4ea tempest-VolumesDeleteCascade-645296602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.d0d3e93f-6ca5-4173-8d31-314687d3104f 1G" returned: 0 in 0.459s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c9fd25b7-9b5a-4581-a025-a6924f30d4ea tempest-VolumesDeleteCascade-645296602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.d0d3e93f-6ca5-4173-8d31-314687d3104f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:00 devstack sudo[102114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.d0d3e93f-6ca5-4173-8d31-314687d3104f Aug 11 04:43:00 devstack sudo[102114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:00 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-f73503b6-3436-43a1-baed-afce83f3ca01 tempest-SnapshotMetadataTestJSON-839266492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:43:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f73503b6-3436-43a1-baed-afce83f3ca01 tempest-SnapshotMetadataTestJSON-839266492 None] Flow 'volume_create_manager' (e2347c6a-2b59-4f23-8858-1dfef2853170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:43:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f73503b6-3436-43a1-baed-afce83f3ca01 tempest-SnapshotMetadataTestJSON-839266492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (855742a1-33cc-4c78-9a20-bf910815472d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f73503b6-3436-43a1-baed-afce83f3ca01 tempest-SnapshotMetadataTestJSON-839266492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (855742a1-33cc-4c78-9a20-bf910815472d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:43:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1806842511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2c499a3-db85-49c9-8e59-5d71ce4b4bab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='417d6a5702834b76956e89aea9d57339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:43:01Z,use_quota=True,user_id='7a205e09e3c942ec9f5b495ee8aa1913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f73503b6-3436-43a1-baed-afce83f3ca01 tempest-SnapshotMetadataTestJSON-839266492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15577298-7c68-45a6-b721-0d1036b2b50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:00 devstack sudo[102114]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f73503b6-3436-43a1-baed-afce83f3ca01 tempest-SnapshotMetadataTestJSON-839266492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15577298-7c68-45a6-b721-0d1036b2b50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f73503b6-3436-43a1-baed-afce83f3ca01 tempest-SnapshotMetadataTestJSON-839266492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (635c03ee-fbb1-41e5-992e-59170302730a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f73503b6-3436-43a1-baed-afce83f3ca01 tempest-SnapshotMetadataTestJSON-839266492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (635c03ee-fbb1-41e5-992e-59170302730a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2c499a3-db85-49c9-8e59-5d71ce4b4bab', 'volume_name': 'volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f73503b6-3436-43a1-baed-afce83f3ca01 tempest-SnapshotMetadataTestJSON-839266492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13986361-4a03-40f6-8a6a-11e88153f88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f73503b6-3436-43a1-baed-afce83f3ca01 tempest-SnapshotMetadataTestJSON-839266492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13986361-4a03-40f6-8a6a-11e88153f88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f73503b6-3436-43a1-baed-afce83f3ca01 tempest-SnapshotMetadataTestJSON-839266492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0eabb68-769f-4f75-a2e5-0fc0c21800ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:00 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-f73503b6-3436-43a1-baed-afce83f3ca01 tempest-SnapshotMetadataTestJSON-839266492 None] Volume e2c499a3-db85-49c9-8e59-5d71ce4b4bab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab', 'volume_size': 1} Aug 11 04:43:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f73503b6-3436-43a1-baed-afce83f3ca01 tempest-SnapshotMetadataTestJSON-839266492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:43:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c9fd25b7-9b5a-4581-a025-a6924f30d4ea tempest-VolumesDeleteCascade-645296602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.d0d3e93f-6ca5-4173-8d31-314687d3104f" returned: 0 in 0.379s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:00 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-c9fd25b7-9b5a-4581-a025-a6924f30d4ea tempest-VolumesDeleteCascade-645296602 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.d0d3e93f-6ca5-4173-8d31-314687d3104f is being set with open permissions: ugo+rw Aug 11 04:43:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c9fd25b7-9b5a-4581-a025-a6924f30d4ea tempest-VolumesDeleteCascade-645296602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.d0d3e93f-6ca5-4173-8d31-314687d3104f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:00 devstack sudo[102119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.d0d3e93f-6ca5-4173-8d31-314687d3104f Aug 11 04:43:00 devstack sudo[102119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:01 devstack sudo[102119]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c9fd25b7-9b5a-4581-a025-a6924f30d4ea tempest-VolumesDeleteCascade-645296602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.d0d3e93f-6ca5-4173-8d31-314687d3104f" returned: 0 in 0.271s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:01 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2a450912-9fbb-4ffa-b90f-2b71a53235fe tempest-VolumesMetadataTest-99897881 None] Acquiring lock "cinder-f5dc09f1-ffe2-4064-a7b5-e5218bb304a3-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:43:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c9fd25b7-9b5a-4581-a025-a6924f30d4ea tempest-VolumesDeleteCascade-645296602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:01 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2a450912-9fbb-4ffa-b90f-2b71a53235fe tempest-VolumesMetadataTest-99897881 None] Lock "cinder-f5dc09f1-ffe2-4064-a7b5-e5218bb304a3-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:43:01 devstack sudo[102122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.info Aug 11 04:43:01 devstack sudo[102122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:01 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2a450912-9fbb-4ffa-b90f-2b71a53235fe tempest-VolumesMetadataTest-99897881 None] Acquiring lock "cinder-quobyte-f5dc09f1-ffe2-4064-a7b5-e5218bb304a3" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:43:01 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2a450912-9fbb-4ffa-b90f-2b71a53235fe tempest-VolumesMetadataTest-99897881 None] Lock "cinder-quobyte-f5dc09f1-ffe2-4064-a7b5-e5218bb304a3" acquired by "delete_volume" :: waited 0.014s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:43:01 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[d229b036-2183-4e6b-936f-177042725e09]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:43:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2a450912-9fbb-4ffa-b90f-2b71a53235fe tempest-VolumesMetadataTest-99897881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f5dc09f1-ffe2-4064-a7b5-e5218bb304a3 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:01 devstack sudo[102124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f5dc09f1-ffe2-4064-a7b5-e5218bb304a3 Aug 11 04:43:01 devstack sudo[102124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:01 devstack sudo[102122]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c9fd25b7-9b5a-4581-a025-a6924f30d4ea tempest-VolumesDeleteCascade-645296602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.info" returned: 0 in 0.260s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:01 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-c9fd25b7-9b5a-4581-a025-a6924f30d4ea tempest-VolumesDeleteCascade-645296602 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.info is being set with open permissions: ugo+rw Aug 11 04:43:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c9fd25b7-9b5a-4581-a025-a6924f30d4ea tempest-VolumesDeleteCascade-645296602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:01 devstack sudo[102127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.info Aug 11 04:43:01 devstack sudo[102127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:01 devstack sudo[102124]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2a450912-9fbb-4ffa-b90f-2b71a53235fe tempest-VolumesMetadataTest-99897881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f5dc09f1-ffe2-4064-a7b5-e5218bb304a3" returned: 0 in 0.371s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2a450912-9fbb-4ffa-b90f-2b71a53235fe tempest-VolumesMetadataTest-99897881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f5dc09f1-ffe2-4064-a7b5-e5218bb304a3 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:01 devstack sudo[102132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f5dc09f1-ffe2-4064-a7b5-e5218bb304a3 Aug 11 04:43:01 devstack sudo[102132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:01 devstack sudo[102127]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c9fd25b7-9b5a-4581-a025-a6924f30d4ea tempest-VolumesDeleteCascade-645296602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.info" returned: 0 in 0.266s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c9fd25b7-9b5a-4581-a025-a6924f30d4ea tempest-VolumesDeleteCascade-645296602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.180s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:43:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.567s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:43:01 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-899582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94c58ff1-a7f5-4c32-9664-ce0425ceb324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55dd6075a81141dcab2ad4ffbcd544ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:42:58Z,use_quota=True,user_id='418876d7fa8c46edb8fd9fac7b14ce95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:43:01 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] Creating volume 94c58ff1-a7f5-4c32-9664-ce0425ceb324 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:43:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:43:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:43:01 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:43:01 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:43:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:43:01 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:43:01 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:43:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-94c58ff1-a7f5-4c32-9664-ce0425ceb324 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:01 devstack sudo[102135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-94c58ff1-a7f5-4c32-9664-ce0425ceb324 1073741824 Aug 11 04:43:01 devstack sudo[102135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:01 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-c9fd25b7-9b5a-4581-a025-a6924f30d4ea tempest-VolumesDeleteCascade-645296602 None] Create snapshot completed successfully Aug 11 04:43:01 devstack sudo[102132]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2a450912-9fbb-4ffa-b90f-2b71a53235fe tempest-VolumesMetadataTest-99897881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f5dc09f1-ffe2-4064-a7b5-e5218bb304a3" returned: 0 in 0.249s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:01 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2a450912-9fbb-4ffa-b90f-2b71a53235fe tempest-VolumesMetadataTest-99897881 None] Lock "cinder-quobyte-f5dc09f1-ffe2-4064-a7b5-e5218bb304a3" released by "delete_volume" :: held 0.661s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:43:02 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-2a450912-9fbb-4ffa-b90f-2b71a53235fe tempest-VolumesMetadataTest-99897881 None] Created reservations ['43ccfb88-490d-4b82-8b55-83db14916432', '8d5fb0e7-625e-4adb-9807-a825695778a2', 'cb8c1317-7b6d-427f-8225-815b5cc1257a', 'c4fa32ff-294e-4628-a26b-41c56a8fcd64'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:43:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2a450912-9fbb-4ffa-b90f-2b71a53235fe tempest-VolumesMetadataTest-99897881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:43:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2a450912-9fbb-4ffa-b90f-2b71a53235fe tempest-VolumesMetadataTest-99897881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:43:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2a450912-9fbb-4ffa-b90f-2b71a53235fe tempest-VolumesMetadataTest-99897881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:43:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2a450912-9fbb-4ffa-b90f-2b71a53235fe tempest-VolumesMetadataTest-99897881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:43:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2a450912-9fbb-4ffa-b90f-2b71a53235fe tempest-VolumesMetadataTest-99897881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:43:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2a450912-9fbb-4ffa-b90f-2b71a53235fe tempest-VolumesMetadataTest-99897881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:02 devstack sudo[102141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:43:02 devstack sudo[102141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ad6f9a02-06af-4fd0-b863-3a96f547be03 tempest-VolumesDeleteCascade-645296602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:43:02 devstack sudo[102135]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-94c58ff1-a7f5-4c32-9664-ce0425ceb324 1073741824" returned: 0 in 0.564s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-94c58ff1-a7f5-4c32-9664-ce0425ceb324 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:02 devstack sudo[102144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-94c58ff1-a7f5-4c32-9664-ce0425ceb324 Aug 11 04:43:02 devstack sudo[102144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:02 devstack sudo[102141]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2a450912-9fbb-4ffa-b90f-2b71a53235fe tempest-VolumesMetadataTest-99897881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.295s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:02 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-2a450912-9fbb-4ffa-b90f-2b71a53235fe tempest-VolumesMetadataTest-99897881 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:43:02 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-2a450912-9fbb-4ffa-b90f-2b71a53235fe tempest-VolumesMetadataTest-99897881 None] Deleted volume successfully. Aug 11 04:43:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2a450912-9fbb-4ffa-b90f-2b71a53235fe tempest-VolumesMetadataTest-99897881 None] Lock "cinder-f5dc09f1-ffe2-4064-a7b5-e5218bb304a3-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:43:02 devstack sudo[102144]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-94c58ff1-a7f5-4c32-9664-ce0425ceb324" returned: 0 in 0.261s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:43:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:43:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f73503b6-3436-43a1-baed-afce83f3ca01 tempest-SnapshotMetadataTestJSON-839266492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.746s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:43:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f73503b6-3436-43a1-baed-afce83f3ca01 tempest-SnapshotMetadataTestJSON-839266492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:43:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1806842511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2c499a3-db85-49c9-8e59-5d71ce4b4bab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='417d6a5702834b76956e89aea9d57339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:43:01Z,use_quota=True,user_id='7a205e09e3c942ec9f5b495ee8aa1913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:43:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-f73503b6-3436-43a1-baed-afce83f3ca01 tempest-SnapshotMetadataTestJSON-839266492 None] Creating volume e2c499a3-db85-49c9-8e59-5d71ce4b4bab {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:43:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f73503b6-3436-43a1-baed-afce83f3ca01 tempest-SnapshotMetadataTestJSON-839266492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:43:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f73503b6-3436-43a1-baed-afce83f3ca01 tempest-SnapshotMetadataTestJSON-839266492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:43:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f73503b6-3436-43a1-baed-afce83f3ca01 tempest-SnapshotMetadataTestJSON-839266492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:43:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f73503b6-3436-43a1-baed-afce83f3ca01 tempest-SnapshotMetadataTestJSON-839266492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:43:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f73503b6-3436-43a1-baed-afce83f3ca01 tempest-SnapshotMetadataTestJSON-839266492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:43:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f73503b6-3436-43a1-baed-afce83f3ca01 tempest-SnapshotMetadataTestJSON-839266492 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:43:02 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-f73503b6-3436-43a1-baed-afce83f3ca01 tempest-SnapshotMetadataTestJSON-839266492 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:43:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f73503b6-3436-43a1-baed-afce83f3ca01 tempest-SnapshotMetadataTestJSON-839266492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:02 devstack sudo[102149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab 1073741824 Aug 11 04:43:02 devstack sudo[102149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:02 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] Attempting download of 935df48c-f244-44af-83c6-4799aff908b2 ((None, [{'url': 'file:///opt/stack/data/glance/images/935df48c-f244-44af-83c6-4799aff908b2', 'metadata': {}}])) to volume 94c58ff1-a7f5-4c32-9664-ce0425ceb324. {{(pid=94472) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 11 04:43:02 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedd7e0a-29e1-4bad-9621-cf1944df2f28]: (4, 'raw') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:43:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_935df48c-f244-44af-83c6-4799aff908b2_vnmrds8x {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:02 devstack sudo[102151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_935df48c-f244-44af-83c6-4799aff908b2_vnmrds8x Aug 11 04:43:02 devstack sudo[102151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:03 devstack sudo[102149]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:03 devstack sudo[102151]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f73503b6-3436-43a1-baed-afce83f3ca01 tempest-SnapshotMetadataTestJSON-839266492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab 1073741824" returned: 0 in 0.508s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_935df48c-f244-44af-83c6-4799aff908b2_vnmrds8x" returned: 0 in 0.414s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_935df48c-f244-44af-83c6-4799aff908b2_vnmrds8x {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f73503b6-3436-43a1-baed-afce83f3ca01 tempest-SnapshotMetadataTestJSON-839266492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:03 devstack sudo[102160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab Aug 11 04:43:03 devstack sudo[102160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:03 devstack sudo[102159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_935df48c-f244-44af-83c6-4799aff908b2_vnmrds8x Aug 11 04:43:03 devstack sudo[102159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:03 devstack sudo[102160]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f73503b6-3436-43a1-baed-afce83f3ca01 tempest-SnapshotMetadataTestJSON-839266492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab" returned: 0 in 0.307s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:03 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f73503b6-3436-43a1-baed-afce83f3ca01 tempest-SnapshotMetadataTestJSON-839266492 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:43:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f73503b6-3436-43a1-baed-afce83f3ca01 tempest-SnapshotMetadataTestJSON-839266492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:43:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ad6f9a02-06af-4fd0-b863-3a96f547be03 tempest-VolumesDeleteCascade-645296602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.197s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:43:03 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-ad6f9a02-06af-4fd0-b863-3a96f547be03 tempest-VolumesDeleteCascade-645296602 None] Creating offline snapshot ed332ed4-2b70-47f1-8d4c-5a5e4280480b of volume ee3622b6-91f1-4fe6-8aae-dfebc02e78d4 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 04:43:03 devstack sudo[102159]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_935df48c-f244-44af-83c6-4799aff908b2_vnmrds8x" returned: 1 in 0.427s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_935df48c-f244-44af-83c6-4799aff908b2_vnmrds8x' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 11 04:43:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f73503b6-3436-43a1-baed-afce83f3ca01 tempest-SnapshotMetadataTestJSON-839266492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0eabb68-769f-4f75-a2e5-0fc0c21800ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f73503b6-3436-43a1-baed-afce83f3ca01 tempest-SnapshotMetadataTestJSON-839266492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ef155e7-15eb-4d22-9bc9-f1984d53c16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:03 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c67f92-0bcd-4f75-a56a-20cb4920ca9c]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:43:03 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[864c976b-d9bc-4843-a935-589fc27a21c6]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:43:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_gzkyf79zdevstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ad6f9a02-06af-4fd0-b863-3a96f547be03 tempest-VolumesDeleteCascade-645296602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.d0d3e93f-6ca5-4173-8d31-314687d3104f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:03 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-f73503b6-3436-43a1-baed-afce83f3ca01 tempest-SnapshotMetadataTestJSON-839266492 None] Volume volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab (e2c499a3-db85-49c9-8e59-5d71ce4b4bab): created successfully Aug 11 04:43:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f73503b6-3436-43a1-baed-afce83f3ca01 tempest-SnapshotMetadataTestJSON-839266492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ef155e7-15eb-4d22-9bc9-f1984d53c16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f73503b6-3436-43a1-baed-afce83f3ca01 tempest-SnapshotMetadataTestJSON-839266492 None] Flow 'volume_create_manager' (e2347c6a-2b59-4f23-8858-1dfef2853170) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:43:03 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-f73503b6-3436-43a1-baed-afce83f3ca01 tempest-SnapshotMetadataTestJSON-839266492 None] Created volume successfully. Aug 11 04:43:03 devstack sudo[102168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_gzkyf79zdevstack@QuobyteHD Aug 11 04:43:03 devstack sudo[102168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:03 devstack sudo[102169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.d0d3e93f-6ca5-4173-8d31-314687d3104f Aug 11 04:43:03 devstack sudo[102169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:04 devstack sudo[102168]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_gzkyf79zdevstack@QuobyteHD" returned: 0 in 0.422s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:04 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] 935df48c-f244-44af-83c6-4799aff908b2 was qcow2, converting to qcow2 {{(pid=94472) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 11 04:43:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_gzkyf79zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-94c58ff1-a7f5-4c32-9664-ce0425ceb324 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:04 devstack sudo[102178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_gzkyf79zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-94c58ff1-a7f5-4c32-9664-ce0425ceb324 Aug 11 04:43:04 devstack sudo[102178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b3e78139-dd09-4176-94c1-47730dc15cdd tempest-SnapshotMetadataTestJSON-839266492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:43:04 devstack sudo[102169]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ad6f9a02-06af-4fd0-b863-3a96f547be03 tempest-VolumesDeleteCascade-645296602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.d0d3e93f-6ca5-4173-8d31-314687d3104f" returned: 0 in 0.550s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:04 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-ad6f9a02-06af-4fd0-b863-3a96f547be03 tempest-VolumesDeleteCascade-645296602 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:43:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ad6f9a02-06af-4fd0-b863-3a96f547be03 tempest-VolumesDeleteCascade-645296602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.d0d3e93f-6ca5-4173-8d31-314687d3104f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.ed332ed4-2b70-47f1-8d4c-5a5e4280480b 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:04 devstack sudo[102182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.d0d3e93f-6ca5-4173-8d31-314687d3104f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.ed332ed4-2b70-47f1-8d4c-5a5e4280480b 1G Aug 11 04:43:04 devstack sudo[102182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:04 devstack sudo[102182]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ad6f9a02-06af-4fd0-b863-3a96f547be03 tempest-VolumesDeleteCascade-645296602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.d0d3e93f-6ca5-4173-8d31-314687d3104f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.ed332ed4-2b70-47f1-8d4c-5a5e4280480b 1G" returned: 0 in 0.513s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ad6f9a02-06af-4fd0-b863-3a96f547be03 tempest-VolumesDeleteCascade-645296602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.d0d3e93f-6ca5-4173-8d31-314687d3104f -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.ed332ed4-2b70-47f1-8d4c-5a5e4280480b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:04 devstack sudo[102195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.d0d3e93f-6ca5-4173-8d31-314687d3104f -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.ed332ed4-2b70-47f1-8d4c-5a5e4280480b Aug 11 04:43:04 devstack sudo[102195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:05 devstack sudo[102195]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ad6f9a02-06af-4fd0-b863-3a96f547be03 tempest-VolumesDeleteCascade-645296602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.d0d3e93f-6ca5-4173-8d31-314687d3104f -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.ed332ed4-2b70-47f1-8d4c-5a5e4280480b" returned: 0 in 0.398s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:05 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-ad6f9a02-06af-4fd0-b863-3a96f547be03 tempest-VolumesDeleteCascade-645296602 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.ed332ed4-2b70-47f1-8d4c-5a5e4280480b is being set with open permissions: ugo+rw Aug 11 04:43:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ad6f9a02-06af-4fd0-b863-3a96f547be03 tempest-VolumesDeleteCascade-645296602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.ed332ed4-2b70-47f1-8d4c-5a5e4280480b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:05 devstack sudo[102201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.ed332ed4-2b70-47f1-8d4c-5a5e4280480b Aug 11 04:43:05 devstack sudo[102201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:05 devstack sudo[102201]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ad6f9a02-06af-4fd0-b863-3a96f547be03 tempest-VolumesDeleteCascade-645296602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.ed332ed4-2b70-47f1-8d4c-5a5e4280480b" returned: 0 in 0.322s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ad6f9a02-06af-4fd0-b863-3a96f547be03 tempest-VolumesDeleteCascade-645296602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.957s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:43:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b3e78139-dd09-4176-94c1-47730dc15cdd tempest-SnapshotMetadataTestJSON-839266492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.329s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:43:05 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-b3e78139-dd09-4176-94c1-47730dc15cdd tempest-SnapshotMetadataTestJSON-839266492 None] Creating offline snapshot d3aef0fa-68c2-4044-a839-a2cd4adc9026 of volume e2c499a3-db85-49c9-8e59-5d71ce4b4bab {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 04:43:05 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-ad6f9a02-06af-4fd0-b863-3a96f547be03 tempest-VolumesDeleteCascade-645296602 None] Create snapshot completed successfully Aug 11 04:43:05 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[005fcdf0-11d6-4993-9022-8499b2173e6d]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:43:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b3e78139-dd09-4176-94c1-47730dc15cdd tempest-SnapshotMetadataTestJSON-839266492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:05 devstack sudo[102204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab Aug 11 04:43:05 devstack sudo[102204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:05 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-28d84f05-52b3-45e5-bcca-ec22bbbba748 tempest-VolumesCloneNegativeTest-51511206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:43:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-28d84f05-52b3-45e5-bcca-ec22bbbba748 tempest-VolumesCloneNegativeTest-51511206 None] Flow 'volume_create_manager' (97b4fe4a-c52d-48ac-94b0-885aa5026f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:43:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-28d84f05-52b3-45e5-bcca-ec22bbbba748 tempest-VolumesCloneNegativeTest-51511206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71ecd942-368a-4e9b-8afb-c11e076b25b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-28d84f05-52b3-45e5-bcca-ec22bbbba748 tempest-VolumesCloneNegativeTest-51511206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71ecd942-368a-4e9b-8afb-c11e076b25b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:43:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2026893640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f1a2a53-1ed8-4652-a7e9-76dbb2959cba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='918e8d61e033418d8ad933de75a144c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:43:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:43:06Z,use_quota=True,user_id='61766f4c148049a8a36e169de17232e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-28d84f05-52b3-45e5-bcca-ec22bbbba748 tempest-VolumesCloneNegativeTest-51511206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88d86f38-61a7-4b99-97eb-2ea05a578f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-28d84f05-52b3-45e5-bcca-ec22bbbba748 tempest-VolumesCloneNegativeTest-51511206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88d86f38-61a7-4b99-97eb-2ea05a578f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-28d84f05-52b3-45e5-bcca-ec22bbbba748 tempest-VolumesCloneNegativeTest-51511206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bad023f-b7db-401c-9c87-cbc60bf0c7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-28d84f05-52b3-45e5-bcca-ec22bbbba748 tempest-VolumesCloneNegativeTest-51511206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bad023f-b7db-401c-9c87-cbc60bf0c7c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f1a2a53-1ed8-4652-a7e9-76dbb2959cba', 'volume_name': 'volume-9f1a2a53-1ed8-4652-a7e9-76dbb2959cba', 'volume_size': 2}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-28d84f05-52b3-45e5-bcca-ec22bbbba748 tempest-VolumesCloneNegativeTest-51511206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (522c2eaa-1500-4ffd-a4c2-e99a755891ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-28d84f05-52b3-45e5-bcca-ec22bbbba748 tempest-VolumesCloneNegativeTest-51511206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (522c2eaa-1500-4ffd-a4c2-e99a755891ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-28d84f05-52b3-45e5-bcca-ec22bbbba748 tempest-VolumesCloneNegativeTest-51511206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b618f91-a615-4123-9ff7-8ebea6cbd8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:05 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-28d84f05-52b3-45e5-bcca-ec22bbbba748 tempest-VolumesCloneNegativeTest-51511206 None] Volume 9f1a2a53-1ed8-4652-a7e9-76dbb2959cba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f1a2a53-1ed8-4652-a7e9-76dbb2959cba', 'volume_size': 2} Aug 11 04:43:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-28d84f05-52b3-45e5-bcca-ec22bbbba748 tempest-VolumesCloneNegativeTest-51511206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:43:05 devstack sudo[102204]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b3e78139-dd09-4176-94c1-47730dc15cdd tempest-SnapshotMetadataTestJSON-839266492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab" returned: 0 in 0.400s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b3e78139-dd09-4176-94c1-47730dc15cdd tempest-SnapshotMetadataTestJSON-839266492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab.d3aef0fa-68c2-4044-a839-a2cd4adc9026 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:05 devstack sudo[102209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab.d3aef0fa-68c2-4044-a839-a2cd4adc9026 1G Aug 11 04:43:05 devstack sudo[102209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:06 devstack sudo[102178]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_gzkyf79zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-94c58ff1-a7f5-4c32-9664-ce0425ceb324" returned: 0 in 2.049s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:06 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_gzkyf79zdevstack@QuobyteHD, size 112.00 MB, duration 2.05 sec, destination /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-94c58ff1-a7f5-4c32-9664-ce0425ceb324 {{(pid=94472) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 11 04:43:06 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] Converted 112.00 MB image at 54.62 MB/s Aug 11 04:43:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-94c58ff1-a7f5-4c32-9664-ce0425ceb324 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:06 devstack sudo[102211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-94c58ff1-a7f5-4c32-9664-ce0425ceb324 1G Aug 11 04:43:06 devstack sudo[102211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:06 devstack sudo[102209]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b3e78139-dd09-4176-94c1-47730dc15cdd tempest-SnapshotMetadataTestJSON-839266492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab.d3aef0fa-68c2-4044-a839-a2cd4adc9026 1G" returned: 0 in 0.430s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b3e78139-dd09-4176-94c1-47730dc15cdd tempest-SnapshotMetadataTestJSON-839266492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab.d3aef0fa-68c2-4044-a839-a2cd4adc9026 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:06 devstack sudo[102219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab.d3aef0fa-68c2-4044-a839-a2cd4adc9026 Aug 11 04:43:06 devstack sudo[102219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:06 devstack sudo[102211]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-94c58ff1-a7f5-4c32-9664-ce0425ceb324 1G" returned: 0 in 0.345s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:06 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] Downloaded image 935df48c-f244-44af-83c6-4799aff908b2 ((None, [{'url': 'file:///opt/stack/data/glance/images/935df48c-f244-44af-83c6-4799aff908b2', 'metadata': {}}])) to volume 94c58ff1-a7f5-4c32-9664-ce0425ceb324 successfully. {{(pid=94472) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 11 04:43:06 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] Temporary image 935df48c-f244-44af-83c6-4799aff908b2 for user 418876d7fa8c46edb8fd9fac7b14ce95 is deleted. {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 11 04:43:06 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] Marking volume 94c58ff1-a7f5-4c32-9664-ce0425ceb324 as bootable. {{(pid=94472) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 11 04:43:06 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] Copying metadata from image 935df48c-f244-44af-83c6-4799aff908b2 to 94c58ff1-a7f5-4c32-9664-ce0425ceb324. {{(pid=94472) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 11 04:43:06 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] Creating volume glance metadata for volume 94c58ff1-a7f5-4c32-9664-ce0425ceb324 backed by image 935df48c-f244-44af-83c6-4799aff908b2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '935df48c-f244-44af-83c6-4799aff908b2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94472) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 11 04:43:06 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e513a86-eef2-4b65-93e7-a5077a050d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94c58ff1-a7f5-4c32-9664-ce0425ceb324', 'volume_size': 1, 'image_id': '935df48c-f244-44af-83c6-4799aff908b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/935df48c-f244-44af-83c6-4799aff908b2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f74f87914afa4c849e1ab3e938cfb579', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '935df48c-f244-44af-83c6-4799aff908b2', 'created_at': datetime.datetime(2026, 8, 11, 2, 32, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 2, 32, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/935df48c-f244-44af-83c6-4799aff908b2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:06 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cf1b86a-71e5-40f2-b35a-bdc826eca39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:06 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] Volume volume-94c58ff1-a7f5-4c32-9664-ce0425ceb324 (94c58ff1-a7f5-4c32-9664-ce0425ceb324): created successfully Aug 11 04:43:06 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cf1b86a-71e5-40f2-b35a-bdc826eca39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:06 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] Flow 'volume_create_manager' (75dc8da8-3cd6-42c9-a26f-e1f4164cbd1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:43:06 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Acquiring lock "cinder-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:43:06 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-70e45744-6d4d-499e-b9d2-086326eed545 tempest-ServerActionsTestOtherA-1583977559 None] Created volume successfully. Aug 11 04:43:06 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Lock "cinder-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:43:06 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Performing cascade delete. {{(pid=94472) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 11 04:43:06 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Acquiring lock "cinder-d0d3e93f-6ca5-4173-8d31-314687d3104f-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:43:06 devstack sudo[102219]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b3e78139-dd09-4176-94c1-47730dc15cdd tempest-SnapshotMetadataTestJSON-839266492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab.d3aef0fa-68c2-4044-a839-a2cd4adc9026" returned: 0 in 0.355s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:06 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-b3e78139-dd09-4176-94c1-47730dc15cdd tempest-SnapshotMetadataTestJSON-839266492 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab.d3aef0fa-68c2-4044-a839-a2cd4adc9026 is being set with open permissions: ugo+rw Aug 11 04:43:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b3e78139-dd09-4176-94c1-47730dc15cdd tempest-SnapshotMetadataTestJSON-839266492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab.d3aef0fa-68c2-4044-a839-a2cd4adc9026 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:06 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Lock "cinder-d0d3e93f-6ca5-4173-8d31-314687d3104f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:43:06 devstack sudo[102225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab.d3aef0fa-68c2-4044-a839-a2cd4adc9026 Aug 11 04:43:06 devstack sudo[102225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:06 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Acquiring lock "cinder-quobyte-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:43:06 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Lock "cinder-quobyte-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:43:06 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Acquiring lock "cinder-quobyte-d0d3e93f-6ca5-4173-8d31-314687d3104f" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:43:06 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Lock "cinder-quobyte-d0d3e93f-6ca5-4173-8d31-314687d3104f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:43:06 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Deleting offline snapshot d0d3e93f-6ca5-4173-8d31-314687d3104f of volume ee3622b6-91f1-4fe6-8aae-dfebc02e78d4 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 04:43:06 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] snapshot_file for this snap is: volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.d0d3e93f-6ca5-4173-8d31-314687d3104f {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 04:43:06 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[4373ec3e-58ac-4e20-a919-939f286d3df3]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:43:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.d0d3e93f-6ca5-4173-8d31-314687d3104f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:06 devstack sudo[102227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.d0d3e93f-6ca5-4173-8d31-314687d3104f Aug 11 04:43:06 devstack sudo[102227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:07 devstack sudo[102225]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b3e78139-dd09-4176-94c1-47730dc15cdd tempest-SnapshotMetadataTestJSON-839266492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab.d3aef0fa-68c2-4044-a839-a2cd4adc9026" returned: 0 in 0.264s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b3e78139-dd09-4176-94c1-47730dc15cdd tempest-SnapshotMetadataTestJSON-839266492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:07 devstack sudo[102230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab.info Aug 11 04:43:07 devstack sudo[102230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:07 devstack sudo[102227]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.d0d3e93f-6ca5-4173-8d31-314687d3104f" returned: 0 in 0.372s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:07 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:43:07 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[3137cb03-a7de-48a6-b96a-09fa8f742283]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:43:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:07 devstack sudo[102230]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b3e78139-dd09-4176-94c1-47730dc15cdd tempest-SnapshotMetadataTestJSON-839266492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab.info" returned: 0 in 0.254s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:07 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-b3e78139-dd09-4176-94c1-47730dc15cdd tempest-SnapshotMetadataTestJSON-839266492 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab.info is being set with open permissions: ugo+rw Aug 11 04:43:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b3e78139-dd09-4176-94c1-47730dc15cdd tempest-SnapshotMetadataTestJSON-839266492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:07 devstack sudo[102237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab.info Aug 11 04:43:07 devstack sudo[102237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:07 devstack sudo[102236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4 Aug 11 04:43:07 devstack sudo[102236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:07 devstack sudo[102237]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b3e78139-dd09-4176-94c1-47730dc15cdd tempest-SnapshotMetadataTestJSON-839266492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab.info" returned: 0 in 0.260s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b3e78139-dd09-4176-94c1-47730dc15cdd tempest-SnapshotMetadataTestJSON-839266492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.069s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:43:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-28d84f05-52b3-45e5-bcca-ec22bbbba748 tempest-VolumesCloneNegativeTest-51511206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.700s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:43:07 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-28d84f05-52b3-45e5-bcca-ec22bbbba748 tempest-VolumesCloneNegativeTest-51511206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:43:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2026893640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f1a2a53-1ed8-4652-a7e9-76dbb2959cba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='918e8d61e033418d8ad933de75a144c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:43:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:43:06Z,use_quota=True,user_id='61766f4c148049a8a36e169de17232e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:43:07 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-28d84f05-52b3-45e5-bcca-ec22bbbba748 tempest-VolumesCloneNegativeTest-51511206 None] Creating volume 9f1a2a53-1ed8-4652-a7e9-76dbb2959cba {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:43:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-28d84f05-52b3-45e5-bcca-ec22bbbba748 tempest-VolumesCloneNegativeTest-51511206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:43:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-28d84f05-52b3-45e5-bcca-ec22bbbba748 tempest-VolumesCloneNegativeTest-51511206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:43:07 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-28d84f05-52b3-45e5-bcca-ec22bbbba748 tempest-VolumesCloneNegativeTest-51511206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:43:07 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-28d84f05-52b3-45e5-bcca-ec22bbbba748 tempest-VolumesCloneNegativeTest-51511206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:43:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-28d84f05-52b3-45e5-bcca-ec22bbbba748 tempest-VolumesCloneNegativeTest-51511206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:43:07 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-28d84f05-52b3-45e5-bcca-ec22bbbba748 tempest-VolumesCloneNegativeTest-51511206 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:43:07 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-28d84f05-52b3-45e5-bcca-ec22bbbba748 tempest-VolumesCloneNegativeTest-51511206 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:43:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-28d84f05-52b3-45e5-bcca-ec22bbbba748 tempest-VolumesCloneNegativeTest-51511206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9f1a2a53-1ed8-4652-a7e9-76dbb2959cba 2147483648 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:07 devstack sudo[102244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9f1a2a53-1ed8-4652-a7e9-76dbb2959cba 2147483648 Aug 11 04:43:07 devstack sudo[102244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:07 devstack sudo[102236]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4" returned: 0 in 0.360s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:07 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-b3e78139-dd09-4176-94c1-47730dc15cdd tempest-SnapshotMetadataTestJSON-839266492 None] Create snapshot completed successfully Aug 11 04:43:07 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc8280d-8e81-4646-9d3b-06b08e32e07f]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:43:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.ed332ed4-2b70-47f1-8d4c-5a5e4280480b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:07 devstack sudo[102246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.ed332ed4-2b70-47f1-8d4c-5a5e4280480b Aug 11 04:43:07 devstack sudo[102246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:08 devstack sudo[102246]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.ed332ed4-2b70-47f1-8d4c-5a5e4280480b" returned: 0 in 0.391s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:08 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:43:08 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a2baa0-c156-45ab-a5f3-84b56cc17ffe]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:43:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.d0d3e93f-6ca5-4173-8d31-314687d3104f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:08 devstack sudo[102244]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-28d84f05-52b3-45e5-bcca-ec22bbbba748 tempest-VolumesCloneNegativeTest-51511206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9f1a2a53-1ed8-4652-a7e9-76dbb2959cba 2147483648" returned: 0 in 0.556s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-28d84f05-52b3-45e5-bcca-ec22bbbba748 tempest-VolumesCloneNegativeTest-51511206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9f1a2a53-1ed8-4652-a7e9-76dbb2959cba {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:08 devstack sudo[102255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.d0d3e93f-6ca5-4173-8d31-314687d3104f Aug 11 04:43:08 devstack sudo[102255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:08 devstack sudo[102256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9f1a2a53-1ed8-4652-a7e9-76dbb2959cba Aug 11 04:43:08 devstack sudo[102256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:08 devstack sudo[102256]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-28d84f05-52b3-45e5-bcca-ec22bbbba748 tempest-VolumesCloneNegativeTest-51511206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9f1a2a53-1ed8-4652-a7e9-76dbb2959cba" returned: 0 in 0.284s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:08 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-28d84f05-52b3-45e5-bcca-ec22bbbba748 tempest-VolumesCloneNegativeTest-51511206 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:43:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-28d84f05-52b3-45e5-bcca-ec22bbbba748 tempest-VolumesCloneNegativeTest-51511206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:43:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-28d84f05-52b3-45e5-bcca-ec22bbbba748 tempest-VolumesCloneNegativeTest-51511206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b618f91-a615-4123-9ff7-8ebea6cbd8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f1a2a53-1ed8-4652-a7e9-76dbb2959cba', 'volume_size': 2}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-28d84f05-52b3-45e5-bcca-ec22bbbba748 tempest-VolumesCloneNegativeTest-51511206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c3d0191-efa5-4dd7-a771-ad0033277937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:08 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-28d84f05-52b3-45e5-bcca-ec22bbbba748 tempest-VolumesCloneNegativeTest-51511206 None] Volume volume-9f1a2a53-1ed8-4652-a7e9-76dbb2959cba (9f1a2a53-1ed8-4652-a7e9-76dbb2959cba): created successfully Aug 11 04:43:08 devstack sudo[102255]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-28d84f05-52b3-45e5-bcca-ec22bbbba748 tempest-VolumesCloneNegativeTest-51511206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c3d0191-efa5-4dd7-a771-ad0033277937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-28d84f05-52b3-45e5-bcca-ec22bbbba748 tempest-VolumesCloneNegativeTest-51511206 None] Flow 'volume_create_manager' (97b4fe4a-c52d-48ac-94b0-885aa5026f45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:43:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.d0d3e93f-6ca5-4173-8d31-314687d3104f" returned: 0 in 0.431s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:08 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:43:08 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-28d84f05-52b3-45e5-bcca-ec22bbbba748 tempest-VolumesCloneNegativeTest-51511206 None] Created volume successfully. Aug 11 04:43:08 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ce7d0e-46f4-4594-bf3f-085487b6545a]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:43:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:08 devstack sudo[102263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4 Aug 11 04:43:08 devstack sudo[102263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:08 devstack sudo[102263]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4" returned: 0 in 0.405s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.d0d3e93f-6ca5-4173-8d31-314687d3104f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:08 devstack sudo[102268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.d0d3e93f-6ca5-4173-8d31-314687d3104f Aug 11 04:43:09 devstack sudo[102268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:09 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-669b2dca-0286-4b40-997b-d27d0429735a tempest-VolumesCloneNegativeTest-51511206 None] Acquiring lock "cinder-9f1a2a53-1ed8-4652-a7e9-76dbb2959cba-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:43:09 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-669b2dca-0286-4b40-997b-d27d0429735a tempest-VolumesCloneNegativeTest-51511206 None] Lock "cinder-9f1a2a53-1ed8-4652-a7e9-76dbb2959cba-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:43:09 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-35b43e9c-c557-4976-8152-1ccd46523daa tempest-SnapshotMetadataTestJSON-839266492 None] Acquiring lock "cinder-d3aef0fa-68c2-4044-a839-a2cd4adc9026-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:43:09 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-669b2dca-0286-4b40-997b-d27d0429735a tempest-VolumesCloneNegativeTest-51511206 None] Acquiring lock "cinder-quobyte-9f1a2a53-1ed8-4652-a7e9-76dbb2959cba" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:43:09 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-35b43e9c-c557-4976-8152-1ccd46523daa tempest-SnapshotMetadataTestJSON-839266492 None] Lock "cinder-d3aef0fa-68c2-4044-a839-a2cd4adc9026-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:43:09 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-35b43e9c-c557-4976-8152-1ccd46523daa tempest-SnapshotMetadataTestJSON-839266492 None] Acquiring lock "cinder-quobyte-e2c499a3-db85-49c9-8e59-5d71ce4b4bab" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:43:09 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-669b2dca-0286-4b40-997b-d27d0429735a tempest-VolumesCloneNegativeTest-51511206 None] Lock "cinder-quobyte-9f1a2a53-1ed8-4652-a7e9-76dbb2959cba" acquired by "delete_volume" :: waited 0.021s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:43:09 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-35b43e9c-c557-4976-8152-1ccd46523daa tempest-SnapshotMetadataTestJSON-839266492 None] Lock "cinder-quobyte-e2c499a3-db85-49c9-8e59-5d71ce4b4bab" acquired by "delete_snapshot" :: waited 0.033s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:43:09 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-35b43e9c-c557-4976-8152-1ccd46523daa tempest-SnapshotMetadataTestJSON-839266492 None] Acquiring lock "cinder-quobyte-d3aef0fa-68c2-4044-a839-a2cd4adc9026" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:43:09 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f41829-fd04-4f3d-a542-c8041b15508c]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:43:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-669b2dca-0286-4b40-997b-d27d0429735a tempest-VolumesCloneNegativeTest-51511206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9f1a2a53-1ed8-4652-a7e9-76dbb2959cba {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:09 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-35b43e9c-c557-4976-8152-1ccd46523daa tempest-SnapshotMetadataTestJSON-839266492 None] Lock "cinder-quobyte-d3aef0fa-68c2-4044-a839-a2cd4adc9026" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:43:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-35b43e9c-c557-4976-8152-1ccd46523daa tempest-SnapshotMetadataTestJSON-839266492 None] Deleting offline snapshot d3aef0fa-68c2-4044-a839-a2cd4adc9026 of volume e2c499a3-db85-49c9-8e59-5d71ce4b4bab {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 04:43:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-35b43e9c-c557-4976-8152-1ccd46523daa tempest-SnapshotMetadataTestJSON-839266492 None] snapshot_file for this snap is: volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab.d3aef0fa-68c2-4044-a839-a2cd4adc9026 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 04:43:09 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae838cb5-9316-4400-a428-a15704a04d6f]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:43:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-35b43e9c-c557-4976-8152-1ccd46523daa tempest-SnapshotMetadataTestJSON-839266492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab.d3aef0fa-68c2-4044-a839-a2cd4adc9026 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:09 devstack sudo[102268]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.d0d3e93f-6ca5-4173-8d31-314687d3104f" returned: 0 in 0.558s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.d0d3e93f-6ca5-4173-8d31-314687d3104f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:09 devstack sudo[102276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9f1a2a53-1ed8-4652-a7e9-76dbb2959cba Aug 11 04:43:09 devstack sudo[102276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:09 devstack sudo[102278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.d0d3e93f-6ca5-4173-8d31-314687d3104f Aug 11 04:43:09 devstack sudo[102278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:09 devstack sudo[102277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab.d3aef0fa-68c2-4044-a839-a2cd4adc9026 Aug 11 04:43:09 devstack sudo[102277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:09 devstack sudo[102278]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.d0d3e93f-6ca5-4173-8d31-314687d3104f" returned: 0 in 0.365s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.ed332ed4-2b70-47f1-8d4c-5a5e4280480b -F qcow2 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:09 devstack sudo[102276]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-669b2dca-0286-4b40-997b-d27d0429735a tempest-VolumesCloneNegativeTest-51511206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9f1a2a53-1ed8-4652-a7e9-76dbb2959cba" returned: 0 in 0.492s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-669b2dca-0286-4b40-997b-d27d0429735a tempest-VolumesCloneNegativeTest-51511206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9f1a2a53-1ed8-4652-a7e9-76dbb2959cba {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:09 devstack sudo[102323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.ed332ed4-2b70-47f1-8d4c-5a5e4280480b -F qcow2 Aug 11 04:43:09 devstack sudo[102323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:09 devstack sudo[102324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9f1a2a53-1ed8-4652-a7e9-76dbb2959cba Aug 11 04:43:09 devstack sudo[102324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:09 devstack sudo[102277]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-35b43e9c-c557-4976-8152-1ccd46523daa tempest-SnapshotMetadataTestJSON-839266492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab.d3aef0fa-68c2-4044-a839-a2cd4adc9026" returned: 0 in 0.482s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-35b43e9c-c557-4976-8152-1ccd46523daa tempest-SnapshotMetadataTestJSON-839266492 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:43:10 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[283b92c3-e85c-4c1b-98bd-2420283fe6f9]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:43:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-35b43e9c-c557-4976-8152-1ccd46523daa tempest-SnapshotMetadataTestJSON-839266492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:10 devstack sudo[102327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab Aug 11 04:43:10 devstack sudo[102327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:10 devstack sudo[102324]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-669b2dca-0286-4b40-997b-d27d0429735a tempest-VolumesCloneNegativeTest-51511206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9f1a2a53-1ed8-4652-a7e9-76dbb2959cba" returned: 0 in 0.370s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-669b2dca-0286-4b40-997b-d27d0429735a tempest-VolumesCloneNegativeTest-51511206 None] Lock "cinder-quobyte-9f1a2a53-1ed8-4652-a7e9-76dbb2959cba" released by "delete_volume" :: held 0.929s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:43:10 devstack sudo[102323]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.ed332ed4-2b70-47f1-8d4c-5a5e4280480b -F qcow2" returned: 0 in 0.507s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Lock "cinder-quobyte-d0d3e93f-6ca5-4173-8d31-314687d3104f" released by "_delete_snapshot" :: held 3.656s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:43:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Lock "cinder-quobyte-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4" released by "delete_snapshot" :: held 3.682s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:43:10 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-669b2dca-0286-4b40-997b-d27d0429735a tempest-VolumesCloneNegativeTest-51511206 None] Created reservations ['0e69abeb-205a-4284-8ae4-022500b35c4e', '4d21a2f5-262e-44b4-8630-6409e04b41d5', '03566207-617a-4601-ad29-39365ce54e4a', 'bb4f2001-fb18-4287-b11e-b62c3b850e39'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:43:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-669b2dca-0286-4b40-997b-d27d0429735a tempest-VolumesCloneNegativeTest-51511206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:43:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-669b2dca-0286-4b40-997b-d27d0429735a tempest-VolumesCloneNegativeTest-51511206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:43:10 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-669b2dca-0286-4b40-997b-d27d0429735a tempest-VolumesCloneNegativeTest-51511206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:43:10 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-669b2dca-0286-4b40-997b-d27d0429735a tempest-VolumesCloneNegativeTest-51511206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:43:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-669b2dca-0286-4b40-997b-d27d0429735a tempest-VolumesCloneNegativeTest-51511206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:43:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-669b2dca-0286-4b40-997b-d27d0429735a tempest-VolumesCloneNegativeTest-51511206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:10 devstack sudo[102327]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:10 devstack sudo[102341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:43:10 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Created reservations ['73e7d615-0df3-40be-9214-1f8c5b8c18c2', 'c81babcd-a8d6-4cd9-9525-16bb417c784a', 'b7a4416d-c8be-4a89-8753-be1c10cb6922', '9f049a78-7ed0-4471-b4de-c93b3e3bff31'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:43:10 devstack sudo[102341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-35b43e9c-c557-4976-8152-1ccd46523daa tempest-SnapshotMetadataTestJSON-839266492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab" returned: 0 in 0.629s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-35b43e9c-c557-4976-8152-1ccd46523daa tempest-SnapshotMetadataTestJSON-839266492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab.d3aef0fa-68c2-4044-a839-a2cd4adc9026 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:10 devstack sudo[102343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab.d3aef0fa-68c2-4044-a839-a2cd4adc9026 Aug 11 04:43:10 devstack sudo[102343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:10 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Delete snapshot completed successfully. Aug 11 04:43:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Lock "cinder-d0d3e93f-6ca5-4173-8d31-314687d3104f-delete_snapshot" released by "delete_snapshot" :: held 3.968s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:43:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Acquiring lock "cinder-ed332ed4-2b70-47f1-8d4c-5a5e4280480b-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:43:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Lock "cinder-ed332ed4-2b70-47f1-8d4c-5a5e4280480b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:43:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Acquiring lock "cinder-quobyte-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:43:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Lock "cinder-quobyte-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:43:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Acquiring lock "cinder-quobyte-ed332ed4-2b70-47f1-8d4c-5a5e4280480b" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:43:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Lock "cinder-quobyte-ed332ed4-2b70-47f1-8d4c-5a5e4280480b" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:43:10 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Deleting offline snapshot ed332ed4-2b70-47f1-8d4c-5a5e4280480b of volume ee3622b6-91f1-4fe6-8aae-dfebc02e78d4 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 04:43:10 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] snapshot_file for this snap is: volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.ed332ed4-2b70-47f1-8d4c-5a5e4280480b {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 04:43:10 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63cf9c0-0990-4173-b581-21b14a61c9a1]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:43:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.ed332ed4-2b70-47f1-8d4c-5a5e4280480b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:10 devstack sudo[102341]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-669b2dca-0286-4b40-997b-d27d0429735a tempest-VolumesCloneNegativeTest-51511206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.367s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:10 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-669b2dca-0286-4b40-997b-d27d0429735a tempest-VolumesCloneNegativeTest-51511206 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:43:10 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-669b2dca-0286-4b40-997b-d27d0429735a tempest-VolumesCloneNegativeTest-51511206 None] Deleted volume successfully. Aug 11 04:43:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-669b2dca-0286-4b40-997b-d27d0429735a tempest-VolumesCloneNegativeTest-51511206 None] Lock "cinder-9f1a2a53-1ed8-4652-a7e9-76dbb2959cba-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:43:11 devstack sudo[102347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.ed332ed4-2b70-47f1-8d4c-5a5e4280480b Aug 11 04:43:11 devstack sudo[102347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:11 devstack sudo[102343]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-35b43e9c-c557-4976-8152-1ccd46523daa tempest-SnapshotMetadataTestJSON-839266492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab.d3aef0fa-68c2-4044-a839-a2cd4adc9026" returned: 0 in 0.488s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-35b43e9c-c557-4976-8152-1ccd46523daa tempest-SnapshotMetadataTestJSON-839266492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab.d3aef0fa-68c2-4044-a839-a2cd4adc9026 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:11 devstack sudo[102352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab.d3aef0fa-68c2-4044-a839-a2cd4adc9026 Aug 11 04:43:11 devstack sudo[102352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-ac650ceb-43de-4c45-a03c-d423ef128898 req-d0b90d98-2e5c-4b23-af93-e4b1b313d016 tempest-ServerActionsTestOtherA-1583977559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:43:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-ac650ceb-43de-4c45-a03c-d423ef128898 req-d0b90d98-2e5c-4b23-af93-e4b1b313d016 tempest-ServerActionsTestOtherA-1583977559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:43:11 devstack sudo[102347]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.ed332ed4-2b70-47f1-8d4c-5a5e4280480b" returned: 0 in 0.583s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:43:11 devstack sudo[102352]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-ac650ceb-43de-4c45-a03c-d423ef128898 req-d0b90d98-2e5c-4b23-af93-e4b1b313d016 tempest-ServerActionsTestOtherA-1583977559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.046s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:43:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-35b43e9c-c557-4976-8152-1ccd46523daa tempest-SnapshotMetadataTestJSON-839266492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab.d3aef0fa-68c2-4044-a839-a2cd4adc9026" returned: 0 in 0.370s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:11 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[53211a7e-c611-4e17-b001-787556fe2fd1]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:43:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-35b43e9c-c557-4976-8152-1ccd46523daa tempest-SnapshotMetadataTestJSON-839266492 None] Lock "cinder-quobyte-d3aef0fa-68c2-4044-a839-a2cd4adc9026" released by "_delete_snapshot" :: held 2.179s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:43:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-35b43e9c-c557-4976-8152-1ccd46523daa tempest-SnapshotMetadataTestJSON-839266492 None] Lock "cinder-quobyte-e2c499a3-db85-49c9-8e59-5d71ce4b4bab" released by "delete_snapshot" :: held 2.225s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:43:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-ac650ceb-43de-4c45-a03c-d423ef128898 req-d0b90d98-2e5c-4b23-af93-e4b1b313d016 tempest-ServerActionsTestOtherA-1583977559 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd', 'name': 'volume-94c58ff1-a7f5-4c32-9664-ce0425ceb324', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e9563909-99ce-488b-b1ce-751ab29b8010', 'enforce_multipath': True} {{(pid=94472) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 11 04:43:11 devstack sudo[102366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4 Aug 11 04:43:11 devstack sudo[102366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:11 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-ac650ceb-43de-4c45-a03c-d423ef128898 req-d0b90d98-2e5c-4b23-af93-e4b1b313d016 tempest-ServerActionsTestOtherA-1583977559 None] attachment_update completed successfully. Aug 11 04:43:11 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-35b43e9c-c557-4976-8152-1ccd46523daa tempest-SnapshotMetadataTestJSON-839266492 None] Created reservations ['eeecf589-d5fe-4ac1-ac54-22cedca1a010', '68c5dc5a-884e-4282-a604-72d6bfd0c276', '9159cb2a-448e-4720-9236-d79f6f47e1d4', '8466d7ef-ab5f-4c14-868c-f1d04600794f'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:43:11 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-35b43e9c-c557-4976-8152-1ccd46523daa tempest-SnapshotMetadataTestJSON-839266492 None] Delete snapshot completed successfully. Aug 11 04:43:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-35b43e9c-c557-4976-8152-1ccd46523daa tempest-SnapshotMetadataTestJSON-839266492 None] Lock "cinder-d3aef0fa-68c2-4044-a839-a2cd4adc9026-delete_snapshot" released by "delete_snapshot" :: held 2.484s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:43:12 devstack sudo[102366]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4" returned: 0 in 0.570s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.ed332ed4-2b70-47f1-8d4c-5a5e4280480b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:12 devstack sudo[102371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.ed332ed4-2b70-47f1-8d4c-5a5e4280480b Aug 11 04:43:12 devstack sudo[102371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:12 devstack sudo[102371]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.ed332ed4-2b70-47f1-8d4c-5a5e4280480b" returned: 0 in 0.496s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.ed332ed4-2b70-47f1-8d4c-5a5e4280480b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:12 devstack sudo[102378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.ed332ed4-2b70-47f1-8d4c-5a5e4280480b Aug 11 04:43:12 devstack sudo[102378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:12 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1bee26a8-4f64-44ef-af1a-06ae24582781 tempest-SnapshotMetadataTestJSON-839266492 None] Acquiring lock "cinder-e2c499a3-db85-49c9-8e59-5d71ce4b4bab-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:43:12 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1bee26a8-4f64-44ef-af1a-06ae24582781 tempest-SnapshotMetadataTestJSON-839266492 None] Lock "cinder-e2c499a3-db85-49c9-8e59-5d71ce4b4bab-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:43:12 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1bee26a8-4f64-44ef-af1a-06ae24582781 tempest-SnapshotMetadataTestJSON-839266492 None] Acquiring lock "cinder-quobyte-e2c499a3-db85-49c9-8e59-5d71ce4b4bab" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:43:12 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1bee26a8-4f64-44ef-af1a-06ae24582781 tempest-SnapshotMetadataTestJSON-839266492 None] Lock "cinder-quobyte-e2c499a3-db85-49c9-8e59-5d71ce4b4bab" acquired by "delete_volume" :: waited 0.017s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:43:12 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[58bc1a68-5e12-44a2-becd-38e8f312cd12]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:43:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1bee26a8-4f64-44ef-af1a-06ae24582781 tempest-SnapshotMetadataTestJSON-839266492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:12 devstack sudo[102378]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4.ed332ed4-2b70-47f1-8d4c-5a5e4280480b" returned: 0 in 0.382s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:13 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Lock "cinder-quobyte-ed332ed4-2b70-47f1-8d4c-5a5e4280480b" released by "_delete_snapshot" :: held 2.197s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:43:13 devstack sudo[102381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab Aug 11 04:43:13 devstack sudo[102381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:13 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Lock "cinder-quobyte-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4" released by "delete_snapshot" :: held 2.234s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:43:13 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Created reservations ['ba7d6a52-9408-43bb-9351-93a7d7075ea0', '2f78c7ef-5ca8-4b67-bcfb-72e9b17bb6a4', '4df26efa-bca9-459b-af6e-deb0039603ca', '94b74fa2-aeb5-42e4-85f6-3ef3c3645323'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:43:13 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Delete snapshot completed successfully. Aug 11 04:43:13 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Lock "cinder-ed332ed4-2b70-47f1-8d4c-5a5e4280480b-delete_snapshot" released by "delete_snapshot" :: held 2.457s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:43:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Snapshots deleted, issuing volume delete {{(pid=94472) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 11 04:43:13 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Acquiring lock "cinder-quobyte-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:43:13 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Lock "cinder-quobyte-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4" acquired by "delete_volume" :: waited 0.034s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:43:13 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[483d1609-6c76-444a-98c7-19fcc4733388]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:43:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:13 devstack sudo[102381]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1bee26a8-4f64-44ef-af1a-06ae24582781 tempest-SnapshotMetadataTestJSON-839266492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab" returned: 0 in 0.553s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1bee26a8-4f64-44ef-af1a-06ae24582781 tempest-SnapshotMetadataTestJSON-839266492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:13 devstack sudo[102387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4 Aug 11 04:43:13 devstack sudo[102387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:13 devstack sudo[102388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab Aug 11 04:43:13 devstack sudo[102388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:13 devstack sudo[102388]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1bee26a8-4f64-44ef-af1a-06ae24582781 tempest-SnapshotMetadataTestJSON-839266492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2c499a3-db85-49c9-8e59-5d71ce4b4bab" returned: 0 in 0.362s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:13 devstack sudo[102387]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4" returned: 0 in 0.489s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:13 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1bee26a8-4f64-44ef-af1a-06ae24582781 tempest-SnapshotMetadataTestJSON-839266492 None] Lock "cinder-quobyte-e2c499a3-db85-49c9-8e59-5d71ce4b4bab" released by "delete_volume" :: held 1.012s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:43:13 devstack sudo[102395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4 Aug 11 04:43:13 devstack sudo[102395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:13 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-1bee26a8-4f64-44ef-af1a-06ae24582781 tempest-SnapshotMetadataTestJSON-839266492 None] Created reservations ['468c01fe-d2df-4bf2-ac93-cbd7999a5619', 'fbb3b357-0508-4d18-a3f6-e30f14200018', '70d06cc8-40f0-4993-9c2b-a76b99a6a78f', 'b1b87be4-d7d2-4064-a653-baba1e4a5b99'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:43:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1bee26a8-4f64-44ef-af1a-06ae24582781 tempest-SnapshotMetadataTestJSON-839266492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:43:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1bee26a8-4f64-44ef-af1a-06ae24582781 tempest-SnapshotMetadataTestJSON-839266492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:43:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1bee26a8-4f64-44ef-af1a-06ae24582781 tempest-SnapshotMetadataTestJSON-839266492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:43:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1bee26a8-4f64-44ef-af1a-06ae24582781 tempest-SnapshotMetadataTestJSON-839266492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:43:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1bee26a8-4f64-44ef-af1a-06ae24582781 tempest-SnapshotMetadataTestJSON-839266492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:43:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1bee26a8-4f64-44ef-af1a-06ae24582781 tempest-SnapshotMetadataTestJSON-839266492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:14 devstack sudo[102398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:43:14 devstack sudo[102398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:14 devstack sudo[102398]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:14 devstack sudo[102395]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1bee26a8-4f64-44ef-af1a-06ae24582781 tempest-SnapshotMetadataTestJSON-839266492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.305s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:14 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-1bee26a8-4f64-44ef-af1a-06ae24582781 tempest-SnapshotMetadataTestJSON-839266492 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:43:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4" returned: 0 in 0.581s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:14 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-1bee26a8-4f64-44ef-af1a-06ae24582781 tempest-SnapshotMetadataTestJSON-839266492 None] Deleted volume successfully. Aug 11 04:43:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Lock "cinder-quobyte-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4" released by "delete_volume" :: held 1.193s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:43:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1bee26a8-4f64-44ef-af1a-06ae24582781 tempest-SnapshotMetadataTestJSON-839266492 None] Lock "cinder-e2c499a3-db85-49c9-8e59-5d71ce4b4bab-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:43:14 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Created reservations ['dd9b5286-b35c-42ab-9fa0-4a8e942bfca1', '2de2260c-148b-459f-a8b9-0d9e0c34fc91', '89c76267-d37c-48f7-b367-74ddf105024b', '59ac010c-98d9-4298-b61c-484ccd20c1fc'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:43:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:43:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:43:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:43:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:43:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:43:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:14 devstack sudo[102402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:43:14 devstack sudo[102402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:14 devstack sudo[102402]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.358s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:15 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:43:15 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Deleted volume successfully. Aug 11 04:43:15 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-705b3387-b720-47bc-9ddc-9a481c290293 tempest-VolumesDeleteCascade-645296602 None] Lock "cinder-ee3622b6-91f1-4fe6-8aae-dfebc02e78d4-delete_volume" released by "delete_volume" :: held 8.361s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:43:16 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-52cd16b0-1bcf-4409-a6ea-7452c3c7ab23 tempest-VolumesGetTest-667192801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:43:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-52cd16b0-1bcf-4409-a6ea-7452c3c7ab23 tempest-VolumesGetTest-667192801 None] Flow 'volume_create_manager' (64d90755-7119-4ff3-9393-02884d52a151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:43:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-52cd16b0-1bcf-4409-a6ea-7452c3c7ab23 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae4bbf40-452c-4423-b340-a54276f7b6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-52cd16b0-1bcf-4409-a6ea-7452c3c7ab23 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae4bbf40-452c-4423-b340-a54276f7b6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:43:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-512761670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1badf4b3-7b55-4074-9ee4-59bda24b6688,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4be18a68d5524857b2b7b1bf2e849c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:43:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:43:16Z,use_quota=True,user_id='885fd20bf9004603a4c318af0014813d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-52cd16b0-1bcf-4409-a6ea-7452c3c7ab23 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (989ac80a-d69d-43b1-9125-2e5c819d846c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-52cd16b0-1bcf-4409-a6ea-7452c3c7ab23 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (989ac80a-d69d-43b1-9125-2e5c819d846c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-52cd16b0-1bcf-4409-a6ea-7452c3c7ab23 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7c06b6b-2328-4954-a5b7-2cf83543f4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-52cd16b0-1bcf-4409-a6ea-7452c3c7ab23 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7c06b6b-2328-4954-a5b7-2cf83543f4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1badf4b3-7b55-4074-9ee4-59bda24b6688', 'volume_name': 'volume-1badf4b3-7b55-4074-9ee4-59bda24b6688', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-52cd16b0-1bcf-4409-a6ea-7452c3c7ab23 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a789a285-6b2b-4899-bf89-6e05622c0e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-52cd16b0-1bcf-4409-a6ea-7452c3c7ab23 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a789a285-6b2b-4899-bf89-6e05622c0e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-52cd16b0-1bcf-4409-a6ea-7452c3c7ab23 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52a29d1a-e89c-4392-ab8a-8043900edb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:16 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-52cd16b0-1bcf-4409-a6ea-7452c3c7ab23 tempest-VolumesGetTest-667192801 None] Volume 1badf4b3-7b55-4074-9ee4-59bda24b6688: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1badf4b3-7b55-4074-9ee4-59bda24b6688', 'volume_size': 1} Aug 11 04:43:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-52cd16b0-1bcf-4409-a6ea-7452c3c7ab23 tempest-VolumesGetTest-667192801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:43:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-52cd16b0-1bcf-4409-a6ea-7452c3c7ab23 tempest-VolumesGetTest-667192801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:43:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-52cd16b0-1bcf-4409-a6ea-7452c3c7ab23 tempest-VolumesGetTest-667192801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:43:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-512761670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1badf4b3-7b55-4074-9ee4-59bda24b6688,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4be18a68d5524857b2b7b1bf2e849c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:43:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:43:16Z,use_quota=True,user_id='885fd20bf9004603a4c318af0014813d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:43:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-52cd16b0-1bcf-4409-a6ea-7452c3c7ab23 tempest-VolumesGetTest-667192801 None] Creating volume 1badf4b3-7b55-4074-9ee4-59bda24b6688 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:43:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-52cd16b0-1bcf-4409-a6ea-7452c3c7ab23 tempest-VolumesGetTest-667192801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:43:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-52cd16b0-1bcf-4409-a6ea-7452c3c7ab23 tempest-VolumesGetTest-667192801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:43:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-52cd16b0-1bcf-4409-a6ea-7452c3c7ab23 tempest-VolumesGetTest-667192801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:43:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-52cd16b0-1bcf-4409-a6ea-7452c3c7ab23 tempest-VolumesGetTest-667192801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:43:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-52cd16b0-1bcf-4409-a6ea-7452c3c7ab23 tempest-VolumesGetTest-667192801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:43:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-52cd16b0-1bcf-4409-a6ea-7452c3c7ab23 tempest-VolumesGetTest-667192801 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:43:16 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-52cd16b0-1bcf-4409-a6ea-7452c3c7ab23 tempest-VolumesGetTest-667192801 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:43:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-52cd16b0-1bcf-4409-a6ea-7452c3c7ab23 tempest-VolumesGetTest-667192801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1badf4b3-7b55-4074-9ee4-59bda24b6688 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:16 devstack sudo[102815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1badf4b3-7b55-4074-9ee4-59bda24b6688 1073741824 Aug 11 04:43:16 devstack sudo[102815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:16 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6b94099-eb79-4049-aed1-a35b29c3f413 tempest-VolumesDeleteCascade-645296602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:43:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f6b94099-eb79-4049-aed1-a35b29c3f413 tempest-VolumesDeleteCascade-645296602 None] Flow 'volume_create_manager' (1d49a7ef-0f0c-4c9b-8aca-c8ed7053cfab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:43:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f6b94099-eb79-4049-aed1-a35b29c3f413 tempest-VolumesDeleteCascade-645296602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a17f936-510a-4ad6-8b8f-a30066a3be5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f6b94099-eb79-4049-aed1-a35b29c3f413 tempest-VolumesDeleteCascade-645296602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a17f936-510a-4ad6-8b8f-a30066a3be5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:43:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-75322595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf50e816-c2e1-4fc8-8f9e-0e815765c2d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbe93bb5603848eba45539e8146020cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:43:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:43:17Z,use_quota=True,user_id='7fa33174b58b4d279b065a80d28891ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f6b94099-eb79-4049-aed1-a35b29c3f413 tempest-VolumesDeleteCascade-645296602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e1f98ac-47fe-43b2-8a17-0f5f57d40093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f6b94099-eb79-4049-aed1-a35b29c3f413 tempest-VolumesDeleteCascade-645296602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e1f98ac-47fe-43b2-8a17-0f5f57d40093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f6b94099-eb79-4049-aed1-a35b29c3f413 tempest-VolumesDeleteCascade-645296602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (744585de-6a57-40ae-a1a1-4b5263e27e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f6b94099-eb79-4049-aed1-a35b29c3f413 tempest-VolumesDeleteCascade-645296602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (744585de-6a57-40ae-a1a1-4b5263e27e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf50e816-c2e1-4fc8-8f9e-0e815765c2d6', 'volume_name': 'volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f6b94099-eb79-4049-aed1-a35b29c3f413 tempest-VolumesDeleteCascade-645296602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e496fb2b-4a1f-4baf-911a-990419b39896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f6b94099-eb79-4049-aed1-a35b29c3f413 tempest-VolumesDeleteCascade-645296602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e496fb2b-4a1f-4baf-911a-990419b39896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f6b94099-eb79-4049-aed1-a35b29c3f413 tempest-VolumesDeleteCascade-645296602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7f10fde-ac4d-47f4-8262-92e8827a57be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:16 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-f6b94099-eb79-4049-aed1-a35b29c3f413 tempest-VolumesDeleteCascade-645296602 None] Volume cf50e816-c2e1-4fc8-8f9e-0e815765c2d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6', 'volume_size': 1} Aug 11 04:43:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f6b94099-eb79-4049-aed1-a35b29c3f413 tempest-VolumesDeleteCascade-645296602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:43:16 devstack sudo[102815]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-52cd16b0-1bcf-4409-a6ea-7452c3c7ab23 tempest-VolumesGetTest-667192801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1badf4b3-7b55-4074-9ee4-59bda24b6688 1073741824" returned: 0 in 0.620s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-52cd16b0-1bcf-4409-a6ea-7452c3c7ab23 tempest-VolumesGetTest-667192801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1badf4b3-7b55-4074-9ee4-59bda24b6688 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:16 devstack sudo[102833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1badf4b3-7b55-4074-9ee4-59bda24b6688 Aug 11 04:43:16 devstack sudo[102833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:17 devstack sudo[102833]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-52cd16b0-1bcf-4409-a6ea-7452c3c7ab23 tempest-VolumesGetTest-667192801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1badf4b3-7b55-4074-9ee4-59bda24b6688" returned: 0 in 0.276s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-52cd16b0-1bcf-4409-a6ea-7452c3c7ab23 tempest-VolumesGetTest-667192801 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:43:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-52cd16b0-1bcf-4409-a6ea-7452c3c7ab23 tempest-VolumesGetTest-667192801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:43:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f6b94099-eb79-4049-aed1-a35b29c3f413 tempest-VolumesDeleteCascade-645296602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.452s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:43:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f6b94099-eb79-4049-aed1-a35b29c3f413 tempest-VolumesDeleteCascade-645296602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:43:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-75322595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf50e816-c2e1-4fc8-8f9e-0e815765c2d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbe93bb5603848eba45539e8146020cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:43:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:43:17Z,use_quota=True,user_id='7fa33174b58b4d279b065a80d28891ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:43:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-f6b94099-eb79-4049-aed1-a35b29c3f413 tempest-VolumesDeleteCascade-645296602 None] Creating volume cf50e816-c2e1-4fc8-8f9e-0e815765c2d6 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:43:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f6b94099-eb79-4049-aed1-a35b29c3f413 tempest-VolumesDeleteCascade-645296602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:43:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f6b94099-eb79-4049-aed1-a35b29c3f413 tempest-VolumesDeleteCascade-645296602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:43:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f6b94099-eb79-4049-aed1-a35b29c3f413 tempest-VolumesDeleteCascade-645296602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:43:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f6b94099-eb79-4049-aed1-a35b29c3f413 tempest-VolumesDeleteCascade-645296602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:43:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f6b94099-eb79-4049-aed1-a35b29c3f413 tempest-VolumesDeleteCascade-645296602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:43:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f6b94099-eb79-4049-aed1-a35b29c3f413 tempest-VolumesDeleteCascade-645296602 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:43:17 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-f6b94099-eb79-4049-aed1-a35b29c3f413 tempest-VolumesDeleteCascade-645296602 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:43:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f6b94099-eb79-4049-aed1-a35b29c3f413 tempest-VolumesDeleteCascade-645296602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-52cd16b0-1bcf-4409-a6ea-7452c3c7ab23 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52a29d1a-e89c-4392-ab8a-8043900edb87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1badf4b3-7b55-4074-9ee4-59bda24b6688', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:17 devstack sudo[102848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6 1073741824 Aug 11 04:43:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-52cd16b0-1bcf-4409-a6ea-7452c3c7ab23 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b089678f-7221-4e73-b153-6dec6aa37b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:17 devstack sudo[102848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:17 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-52cd16b0-1bcf-4409-a6ea-7452c3c7ab23 tempest-VolumesGetTest-667192801 None] Volume volume-1badf4b3-7b55-4074-9ee4-59bda24b6688 (1badf4b3-7b55-4074-9ee4-59bda24b6688): created successfully Aug 11 04:43:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-52cd16b0-1bcf-4409-a6ea-7452c3c7ab23 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b089678f-7221-4e73-b153-6dec6aa37b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-52cd16b0-1bcf-4409-a6ea-7452c3c7ab23 tempest-VolumesGetTest-667192801 None] Flow 'volume_create_manager' (64d90755-7119-4ff3-9393-02884d52a151) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:43:17 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-52cd16b0-1bcf-4409-a6ea-7452c3c7ab23 tempest-VolumesGetTest-667192801 None] Created volume successfully. Aug 11 04:43:17 devstack sudo[102848]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f6b94099-eb79-4049-aed1-a35b29c3f413 tempest-VolumesDeleteCascade-645296602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6 1073741824" returned: 0 in 0.637s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f6b94099-eb79-4049-aed1-a35b29c3f413 tempest-VolumesDeleteCascade-645296602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:17 devstack sudo[102855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6 Aug 11 04:43:17 devstack sudo[102855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:18 devstack sudo[102855]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f6b94099-eb79-4049-aed1-a35b29c3f413 tempest-VolumesDeleteCascade-645296602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6" returned: 0 in 0.294s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:18 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f6b94099-eb79-4049-aed1-a35b29c3f413 tempest-VolumesDeleteCascade-645296602 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:43:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f6b94099-eb79-4049-aed1-a35b29c3f413 tempest-VolumesDeleteCascade-645296602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:43:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f6b94099-eb79-4049-aed1-a35b29c3f413 tempest-VolumesDeleteCascade-645296602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7f10fde-ac4d-47f4-8262-92e8827a57be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f6b94099-eb79-4049-aed1-a35b29c3f413 tempest-VolumesDeleteCascade-645296602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0312f08-33f8-412e-a68e-8754b2ce7123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:18 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-f6b94099-eb79-4049-aed1-a35b29c3f413 tempest-VolumesDeleteCascade-645296602 None] Volume volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6 (cf50e816-c2e1-4fc8-8f9e-0e815765c2d6): created successfully Aug 11 04:43:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f6b94099-eb79-4049-aed1-a35b29c3f413 tempest-VolumesDeleteCascade-645296602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0312f08-33f8-412e-a68e-8754b2ce7123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f6b94099-eb79-4049-aed1-a35b29c3f413 tempest-VolumesDeleteCascade-645296602 None] Flow 'volume_create_manager' (1d49a7ef-0f0c-4c9b-8aca-c8ed7053cfab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:43:18 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-f6b94099-eb79-4049-aed1-a35b29c3f413 tempest-VolumesDeleteCascade-645296602 None] Created volume successfully. Aug 11 04:43:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-97d2abef-b875-4d84-849c-c5ab5acddb60 tempest-VolumesDeleteCascade-645296602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:43:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-97d2abef-b875-4d84-849c-c5ab5acddb60 tempest-VolumesDeleteCascade-645296602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:43:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-97d2abef-b875-4d84-849c-c5ab5acddb60 tempest-VolumesDeleteCascade-645296602 None] Creating offline snapshot 7f3ad172-bf2a-433c-8955-5390974effb9 of volume cf50e816-c2e1-4fc8-8f9e-0e815765c2d6 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 04:43:19 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[704df80e-2d77-4ac2-be61-fd2b499ad61a]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:43:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-97d2abef-b875-4d84-849c-c5ab5acddb60 tempest-VolumesDeleteCascade-645296602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:19 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-96dbc788-7ecc-4a23-93f0-6eee9d66a6c7 tempest-VolumesGetTest-667192801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:43:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-96dbc788-7ecc-4a23-93f0-6eee9d66a6c7 tempest-VolumesGetTest-667192801 None] Flow 'volume_create_manager' (7006152a-7b10-4341-9bfd-ffb5a6463a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:43:19 devstack sudo[102861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6 Aug 11 04:43:19 devstack sudo[102861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-96dbc788-7ecc-4a23-93f0-6eee9d66a6c7 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffce35f7-d20e-4fef-97f0-0edaf71abd24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-96dbc788-7ecc-4a23-93f0-6eee9d66a6c7 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffce35f7-d20e-4fef-97f0-0edaf71abd24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:43:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-377851528',display_name='tempest-VolumesGetTest-Volume-1753488184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05da807c-d523-4a09-a381-b557f1038d40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4be18a68d5524857b2b7b1bf2e849c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:43:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:43:19Z,use_quota=True,user_id='885fd20bf9004603a4c318af0014813d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-96dbc788-7ecc-4a23-93f0-6eee9d66a6c7 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c56bf55c-9a7f-4ab0-94cc-c32269014cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-96dbc788-7ecc-4a23-93f0-6eee9d66a6c7 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c56bf55c-9a7f-4ab0-94cc-c32269014cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-96dbc788-7ecc-4a23-93f0-6eee9d66a6c7 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (392d9583-c81c-4ce0-8551-7434bceb114d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-96dbc788-7ecc-4a23-93f0-6eee9d66a6c7 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (392d9583-c81c-4ce0-8551-7434bceb114d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05da807c-d523-4a09-a381-b557f1038d40', 'volume_name': 'volume-05da807c-d523-4a09-a381-b557f1038d40', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-96dbc788-7ecc-4a23-93f0-6eee9d66a6c7 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (273b5e78-e823-4593-8c71-cce2a7dc6c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-96dbc788-7ecc-4a23-93f0-6eee9d66a6c7 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (273b5e78-e823-4593-8c71-cce2a7dc6c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-96dbc788-7ecc-4a23-93f0-6eee9d66a6c7 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66e3cc6d-7cc8-4b8d-a17f-35656fc9c5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:19 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-96dbc788-7ecc-4a23-93f0-6eee9d66a6c7 tempest-VolumesGetTest-667192801 None] Volume 05da807c-d523-4a09-a381-b557f1038d40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05da807c-d523-4a09-a381-b557f1038d40', 'volume_size': 1} Aug 11 04:43:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-96dbc788-7ecc-4a23-93f0-6eee9d66a6c7 tempest-VolumesGetTest-667192801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:43:20 devstack sudo[102861]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-97d2abef-b875-4d84-849c-c5ab5acddb60 tempest-VolumesDeleteCascade-645296602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6" returned: 0 in 0.663s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-97d2abef-b875-4d84-849c-c5ab5acddb60 tempest-VolumesDeleteCascade-645296602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6.7f3ad172-bf2a-433c-8955-5390974effb9 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:20 devstack sudo[102866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6.7f3ad172-bf2a-433c-8955-5390974effb9 1G Aug 11 04:43:20 devstack sudo[102866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:20 devstack sudo[102866]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-97d2abef-b875-4d84-849c-c5ab5acddb60 tempest-VolumesDeleteCascade-645296602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6.7f3ad172-bf2a-433c-8955-5390974effb9 1G" returned: 0 in 0.684s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-97d2abef-b875-4d84-849c-c5ab5acddb60 tempest-VolumesDeleteCascade-645296602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6.7f3ad172-bf2a-433c-8955-5390974effb9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:20 devstack sudo[102873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6.7f3ad172-bf2a-433c-8955-5390974effb9 Aug 11 04:43:20 devstack sudo[102873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:21 devstack sudo[102873]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-97d2abef-b875-4d84-849c-c5ab5acddb60 tempest-VolumesDeleteCascade-645296602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6.7f3ad172-bf2a-433c-8955-5390974effb9" returned: 0 in 0.527s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:21 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-97d2abef-b875-4d84-849c-c5ab5acddb60 tempest-VolumesDeleteCascade-645296602 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6.7f3ad172-bf2a-433c-8955-5390974effb9 is being set with open permissions: ugo+rw Aug 11 04:43:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-97d2abef-b875-4d84-849c-c5ab5acddb60 tempest-VolumesDeleteCascade-645296602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6.7f3ad172-bf2a-433c-8955-5390974effb9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:21 devstack sudo[102880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6.7f3ad172-bf2a-433c-8955-5390974effb9 Aug 11 04:43:21 devstack sudo[102880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:21 devstack sudo[102880]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-97d2abef-b875-4d84-849c-c5ab5acddb60 tempest-VolumesDeleteCascade-645296602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6.7f3ad172-bf2a-433c-8955-5390974effb9" returned: 0 in 0.656s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:21 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=134,cinder:UPDATE=156,cinder:INSERT=44,cinder:DELETE=10 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:43:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-97d2abef-b875-4d84-849c-c5ab5acddb60 tempest-VolumesDeleteCascade-645296602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:22 devstack sudo[102885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6.info Aug 11 04:43:22 devstack sudo[102885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:22 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-acb68f0e-de9e-4a3c-8b9a-6f7755ba2423 tempest-VolumesTransfersV357Test-1009111257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:43:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-acb68f0e-de9e-4a3c-8b9a-6f7755ba2423 tempest-VolumesTransfersV357Test-1009111257 None] Flow 'volume_create_manager' (f78958c2-4da1-4791-93c6-670abc039dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:43:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-acb68f0e-de9e-4a3c-8b9a-6f7755ba2423 tempest-VolumesTransfersV357Test-1009111257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63d3a530-8a4b-45b4-8636-2052fd497fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-acb68f0e-de9e-4a3c-8b9a-6f7755ba2423 tempest-VolumesTransfersV357Test-1009111257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63d3a530-8a4b-45b4-8636-2052fd497fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1095571133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=885fbca7-0b67-40e6-b070-ee52fa1b1189,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bab38fcd396d459b9e053493efc37725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:43:22Z,use_quota=True,user_id='2f67a19f60454c2eb54c933933781f3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-acb68f0e-de9e-4a3c-8b9a-6f7755ba2423 tempest-VolumesTransfersV357Test-1009111257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30882acb-85f8-41bc-b901-2b4cbdd487e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-acb68f0e-de9e-4a3c-8b9a-6f7755ba2423 tempest-VolumesTransfersV357Test-1009111257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30882acb-85f8-41bc-b901-2b4cbdd487e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-acb68f0e-de9e-4a3c-8b9a-6f7755ba2423 tempest-VolumesTransfersV357Test-1009111257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84193c1e-195d-4d97-8f7c-ac5ebf800369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-acb68f0e-de9e-4a3c-8b9a-6f7755ba2423 tempest-VolumesTransfersV357Test-1009111257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84193c1e-195d-4d97-8f7c-ac5ebf800369) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '885fbca7-0b67-40e6-b070-ee52fa1b1189', 'volume_name': 'volume-885fbca7-0b67-40e6-b070-ee52fa1b1189', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-acb68f0e-de9e-4a3c-8b9a-6f7755ba2423 tempest-VolumesTransfersV357Test-1009111257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (143092bf-3c5c-4938-95f5-957ea8d30022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-acb68f0e-de9e-4a3c-8b9a-6f7755ba2423 tempest-VolumesTransfersV357Test-1009111257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (143092bf-3c5c-4938-95f5-957ea8d30022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-acb68f0e-de9e-4a3c-8b9a-6f7755ba2423 tempest-VolumesTransfersV357Test-1009111257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9284f270-6b50-439e-90b5-dbcefb8869e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:22 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-acb68f0e-de9e-4a3c-8b9a-6f7755ba2423 tempest-VolumesTransfersV357Test-1009111257 None] Volume 885fbca7-0b67-40e6-b070-ee52fa1b1189: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-885fbca7-0b67-40e6-b070-ee52fa1b1189', 'volume_size': 1} Aug 11 04:43:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-acb68f0e-de9e-4a3c-8b9a-6f7755ba2423 tempest-VolumesTransfersV357Test-1009111257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:43:22 devstack sudo[102885]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-97d2abef-b875-4d84-849c-c5ab5acddb60 tempest-VolumesDeleteCascade-645296602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6.info" returned: 0 in 0.393s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:22 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-97d2abef-b875-4d84-849c-c5ab5acddb60 tempest-VolumesDeleteCascade-645296602 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6.info is being set with open permissions: ugo+rw Aug 11 04:43:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-97d2abef-b875-4d84-849c-c5ab5acddb60 tempest-VolumesDeleteCascade-645296602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:22 devstack sudo[102888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6.info Aug 11 04:43:22 devstack sudo[102888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:22 devstack sudo[102888]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-97d2abef-b875-4d84-849c-c5ab5acddb60 tempest-VolumesDeleteCascade-645296602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6.info" returned: 0 in 0.399s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-97d2abef-b875-4d84-849c-c5ab5acddb60 tempest-VolumesDeleteCascade-645296602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.507s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:43:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-96dbc788-7ecc-4a23-93f0-6eee9d66a6c7 tempest-VolumesGetTest-667192801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.109s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:43:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-96dbc788-7ecc-4a23-93f0-6eee9d66a6c7 tempest-VolumesGetTest-667192801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:43:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-377851528',display_name='tempest-VolumesGetTest-Volume-1753488184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05da807c-d523-4a09-a381-b557f1038d40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4be18a68d5524857b2b7b1bf2e849c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:43:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:43:19Z,use_quota=True,user_id='885fd20bf9004603a4c318af0014813d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:43:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-96dbc788-7ecc-4a23-93f0-6eee9d66a6c7 tempest-VolumesGetTest-667192801 None] Creating volume 05da807c-d523-4a09-a381-b557f1038d40 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:43:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-96dbc788-7ecc-4a23-93f0-6eee9d66a6c7 tempest-VolumesGetTest-667192801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:43:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-96dbc788-7ecc-4a23-93f0-6eee9d66a6c7 tempest-VolumesGetTest-667192801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:43:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-96dbc788-7ecc-4a23-93f0-6eee9d66a6c7 tempest-VolumesGetTest-667192801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:43:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-96dbc788-7ecc-4a23-93f0-6eee9d66a6c7 tempest-VolumesGetTest-667192801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:43:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-96dbc788-7ecc-4a23-93f0-6eee9d66a6c7 tempest-VolumesGetTest-667192801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:43:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-96dbc788-7ecc-4a23-93f0-6eee9d66a6c7 tempest-VolumesGetTest-667192801 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:43:22 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-96dbc788-7ecc-4a23-93f0-6eee9d66a6c7 tempest-VolumesGetTest-667192801 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:43:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-96dbc788-7ecc-4a23-93f0-6eee9d66a6c7 tempest-VolumesGetTest-667192801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-05da807c-d523-4a09-a381-b557f1038d40 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:22 devstack sudo[102893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-05da807c-d523-4a09-a381-b557f1038d40 1073741824 Aug 11 04:43:22 devstack sudo[102893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:22 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-97d2abef-b875-4d84-849c-c5ab5acddb60 tempest-VolumesDeleteCascade-645296602 None] Create snapshot completed successfully Aug 11 04:43:23 devstack sudo[102893]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-96dbc788-7ecc-4a23-93f0-6eee9d66a6c7 tempest-VolumesGetTest-667192801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-05da807c-d523-4a09-a381-b557f1038d40 1073741824" returned: 0 in 0.529s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-96dbc788-7ecc-4a23-93f0-6eee9d66a6c7 tempest-VolumesGetTest-667192801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-05da807c-d523-4a09-a381-b557f1038d40 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:23 devstack sudo[102899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-05da807c-d523-4a09-a381-b557f1038d40 Aug 11 04:43:23 devstack sudo[102899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:23 devstack sudo[102899]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-96dbc788-7ecc-4a23-93f0-6eee9d66a6c7 tempest-VolumesGetTest-667192801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-05da807c-d523-4a09-a381-b557f1038d40" returned: 0 in 0.540s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:23 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-96dbc788-7ecc-4a23-93f0-6eee9d66a6c7 tempest-VolumesGetTest-667192801 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:43:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-96dbc788-7ecc-4a23-93f0-6eee9d66a6c7 tempest-VolumesGetTest-667192801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:43:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-acb68f0e-de9e-4a3c-8b9a-6f7755ba2423 tempest-VolumesTransfersV357Test-1009111257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.626s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:43:23 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-acb68f0e-de9e-4a3c-8b9a-6f7755ba2423 tempest-VolumesTransfersV357Test-1009111257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1095571133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=885fbca7-0b67-40e6-b070-ee52fa1b1189,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bab38fcd396d459b9e053493efc37725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:43:22Z,use_quota=True,user_id='2f67a19f60454c2eb54c933933781f3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:43:23 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-acb68f0e-de9e-4a3c-8b9a-6f7755ba2423 tempest-VolumesTransfersV357Test-1009111257 None] Creating volume 885fbca7-0b67-40e6-b070-ee52fa1b1189 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:43:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-acb68f0e-de9e-4a3c-8b9a-6f7755ba2423 tempest-VolumesTransfersV357Test-1009111257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:43:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-acb68f0e-de9e-4a3c-8b9a-6f7755ba2423 tempest-VolumesTransfersV357Test-1009111257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:43:23 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-acb68f0e-de9e-4a3c-8b9a-6f7755ba2423 tempest-VolumesTransfersV357Test-1009111257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:43:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-acb68f0e-de9e-4a3c-8b9a-6f7755ba2423 tempest-VolumesTransfersV357Test-1009111257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:43:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-acb68f0e-de9e-4a3c-8b9a-6f7755ba2423 tempest-VolumesTransfersV357Test-1009111257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:43:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-acb68f0e-de9e-4a3c-8b9a-6f7755ba2423 tempest-VolumesTransfersV357Test-1009111257 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:43:24 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-acb68f0e-de9e-4a3c-8b9a-6f7755ba2423 tempest-VolumesTransfersV357Test-1009111257 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:43:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-acb68f0e-de9e-4a3c-8b9a-6f7755ba2423 tempest-VolumesTransfersV357Test-1009111257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-885fbca7-0b67-40e6-b070-ee52fa1b1189 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-96dbc788-7ecc-4a23-93f0-6eee9d66a6c7 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66e3cc6d-7cc8-4b8d-a17f-35656fc9c5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05da807c-d523-4a09-a381-b557f1038d40', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:24 devstack sudo[102910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-885fbca7-0b67-40e6-b070-ee52fa1b1189 1073741824 Aug 11 04:43:24 devstack sudo[102910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-96dbc788-7ecc-4a23-93f0-6eee9d66a6c7 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec0a9e92-1e8d-4d99-ac09-c6ffaa834bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:24 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-96dbc788-7ecc-4a23-93f0-6eee9d66a6c7 tempest-VolumesGetTest-667192801 None] Volume volume-05da807c-d523-4a09-a381-b557f1038d40 (05da807c-d523-4a09-a381-b557f1038d40): created successfully Aug 11 04:43:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-96dbc788-7ecc-4a23-93f0-6eee9d66a6c7 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec0a9e92-1e8d-4d99-ac09-c6ffaa834bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-96dbc788-7ecc-4a23-93f0-6eee9d66a6c7 tempest-VolumesGetTest-667192801 None] Flow 'volume_create_manager' (7006152a-7b10-4341-9bfd-ffb5a6463a0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:43:24 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-96dbc788-7ecc-4a23-93f0-6eee9d66a6c7 tempest-VolumesGetTest-667192801 None] Created volume successfully. Aug 11 04:43:24 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4a1f069-13f2-4ee1-82a4-a84152588ba8 tempest-VolumesDeleteCascade-645296602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:43:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d4a1f069-13f2-4ee1-82a4-a84152588ba8 tempest-VolumesDeleteCascade-645296602 None] Flow 'volume_create_manager' (3c821f66-5bfe-4bfa-9500-a6eab8b0c50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:43:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d4a1f069-13f2-4ee1-82a4-a84152588ba8 tempest-VolumesDeleteCascade-645296602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3ff7596-683b-4003-a4e5-4cf64fe279f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d4a1f069-13f2-4ee1-82a4-a84152588ba8 tempest-VolumesDeleteCascade-645296602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3ff7596-683b-4003-a4e5-4cf64fe279f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:43:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1011230601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e337794a-eca7-4183-8931-e51264966c53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbe93bb5603848eba45539e8146020cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7f3ad172-bf2a-433c-8955-5390974effb9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:43:25Z,use_quota=True,user_id='7fa33174b58b4d279b065a80d28891ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d4a1f069-13f2-4ee1-82a4-a84152588ba8 tempest-VolumesDeleteCascade-645296602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65de2743-5ba2-4332-a173-fa6d41ade8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d4a1f069-13f2-4ee1-82a4-a84152588ba8 tempest-VolumesDeleteCascade-645296602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65de2743-5ba2-4332-a173-fa6d41ade8a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:24 devstack sudo[102910]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d4a1f069-13f2-4ee1-82a4-a84152588ba8 tempest-VolumesDeleteCascade-645296602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a331b8fb-ad8f-4d4c-96d8-1ceb5194016a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d4a1f069-13f2-4ee1-82a4-a84152588ba8 tempest-VolumesDeleteCascade-645296602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a331b8fb-ad8f-4d4c-96d8-1ceb5194016a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e337794a-eca7-4183-8931-e51264966c53', 'volume_name': 'volume-e337794a-eca7-4183-8931-e51264966c53', 'volume_size': 1, 'snapshot_id': '7f3ad172-bf2a-433c-8955-5390974effb9'}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d4a1f069-13f2-4ee1-82a4-a84152588ba8 tempest-VolumesDeleteCascade-645296602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4ffb780-fdf1-4d0c-bded-aceee85dac06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d4a1f069-13f2-4ee1-82a4-a84152588ba8 tempest-VolumesDeleteCascade-645296602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4ffb780-fdf1-4d0c-bded-aceee85dac06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d4a1f069-13f2-4ee1-82a4-a84152588ba8 tempest-VolumesDeleteCascade-645296602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63959417-90f0-4870-b6ff-ae10acc2b186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:24 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-d4a1f069-13f2-4ee1-82a4-a84152588ba8 tempest-VolumesDeleteCascade-645296602 None] Volume e337794a-eca7-4183-8931-e51264966c53: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e337794a-eca7-4183-8931-e51264966c53', 'volume_size': 1, 'snapshot_id': '7f3ad172-bf2a-433c-8955-5390974effb9'} Aug 11 04:43:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-acb68f0e-de9e-4a3c-8b9a-6f7755ba2423 tempest-VolumesTransfersV357Test-1009111257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-885fbca7-0b67-40e6-b070-ee52fa1b1189 1073741824" returned: 0 in 0.848s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d4a1f069-13f2-4ee1-82a4-a84152588ba8 tempest-VolumesDeleteCascade-645296602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:43:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-acb68f0e-de9e-4a3c-8b9a-6f7755ba2423 tempest-VolumesTransfersV357Test-1009111257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-885fbca7-0b67-40e6-b070-ee52fa1b1189 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:24 devstack sudo[102916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-885fbca7-0b67-40e6-b070-ee52fa1b1189 Aug 11 04:43:24 devstack sudo[102916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b6d74e15-ea99-4a5d-8e8e-bc906edd6600 tempest-VolumesGetTest-667192801 None] Acquiring lock "cinder-05da807c-d523-4a09-a381-b557f1038d40-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:43:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b6d74e15-ea99-4a5d-8e8e-bc906edd6600 tempest-VolumesGetTest-667192801 None] Lock "cinder-05da807c-d523-4a09-a381-b557f1038d40-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:43:25 devstack sudo[102916]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-acb68f0e-de9e-4a3c-8b9a-6f7755ba2423 tempest-VolumesTransfersV357Test-1009111257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-885fbca7-0b67-40e6-b070-ee52fa1b1189" returned: 0 in 0.412s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:25 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-acb68f0e-de9e-4a3c-8b9a-6f7755ba2423 tempest-VolumesTransfersV357Test-1009111257 None] <== create_volume: return (1343ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:43:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-acb68f0e-de9e-4a3c-8b9a-6f7755ba2423 tempest-VolumesTransfersV357Test-1009111257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.352s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:43:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d4a1f069-13f2-4ee1-82a4-a84152588ba8 tempest-VolumesDeleteCascade-645296602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.470s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:43:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d4a1f069-13f2-4ee1-82a4-a84152588ba8 tempest-VolumesDeleteCascade-645296602 None] Acquiring lock "cinder-quobyte-7f3ad172-bf2a-433c-8955-5390974effb9-e337794a-eca7-4183-8931-e51264966c53" by "_create_volume_from_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:43:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b6d74e15-ea99-4a5d-8e8e-bc906edd6600 tempest-VolumesGetTest-667192801 None] Acquiring lock "cinder-quobyte-05da807c-d523-4a09-a381-b557f1038d40" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:43:25 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-acb68f0e-de9e-4a3c-8b9a-6f7755ba2423 tempest-VolumesTransfersV357Test-1009111257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9284f270-6b50-439e-90b5-dbcefb8869e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-885fbca7-0b67-40e6-b070-ee52fa1b1189', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:25 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-acb68f0e-de9e-4a3c-8b9a-6f7755ba2423 tempest-VolumesTransfersV357Test-1009111257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ad64c9c-9e51-43e6-8109-746db4b9f0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b6d74e15-ea99-4a5d-8e8e-bc906edd6600 tempest-VolumesGetTest-667192801 None] Lock "cinder-quobyte-05da807c-d523-4a09-a381-b557f1038d40" acquired by "delete_volume" :: waited 0.042s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:43:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d4a1f069-13f2-4ee1-82a4-a84152588ba8 tempest-VolumesDeleteCascade-645296602 None] Lock "cinder-quobyte-7f3ad172-bf2a-433c-8955-5390974effb9-e337794a-eca7-4183-8931-e51264966c53" acquired by "_create_volume_from_snapshot" :: waited 0.069s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:43:25 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d4a1f069-13f2-4ee1-82a4-a84152588ba8 tempest-VolumesDeleteCascade-645296602 None] Creating volume e337794a-eca7-4183-8931-e51264966c53 from snapshot 7f3ad172-bf2a-433c-8955-5390974effb9 {{(pid=94472) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 11 04:43:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d4a1f069-13f2-4ee1-82a4-a84152588ba8 tempest-VolumesDeleteCascade-645296602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:43:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d4a1f069-13f2-4ee1-82a4-a84152588ba8 tempest-VolumesDeleteCascade-645296602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:43:25 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d4a1f069-13f2-4ee1-82a4-a84152588ba8 tempest-VolumesDeleteCascade-645296602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:43:25 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d4a1f069-13f2-4ee1-82a4-a84152588ba8 tempest-VolumesDeleteCascade-645296602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:43:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d4a1f069-13f2-4ee1-82a4-a84152588ba8 tempest-VolumesDeleteCascade-645296602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:43:25 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d4a1f069-13f2-4ee1-82a4-a84152588ba8 tempest-VolumesDeleteCascade-645296602 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:43:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d4a1f069-13f2-4ee1-82a4-a84152588ba8 tempest-VolumesDeleteCascade-645296602 None] Acquiring lock "cinder-quobyte-e337794a-eca7-4183-8931-e51264966c53" by "_copy_volume_from_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:43:25 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-acb68f0e-de9e-4a3c-8b9a-6f7755ba2423 tempest-VolumesTransfersV357Test-1009111257 None] Volume volume-885fbca7-0b67-40e6-b070-ee52fa1b1189 (885fbca7-0b67-40e6-b070-ee52fa1b1189): created successfully Aug 11 04:43:25 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-acb68f0e-de9e-4a3c-8b9a-6f7755ba2423 tempest-VolumesTransfersV357Test-1009111257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ad64c9c-9e51-43e6-8109-746db4b9f0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:25 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-acb68f0e-de9e-4a3c-8b9a-6f7755ba2423 tempest-VolumesTransfersV357Test-1009111257 None] Flow 'volume_create_manager' (f78958c2-4da1-4791-93c6-670abc039dc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:43:25 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[d228572b-cd94-4e47-bc4b-f016bace767a]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:43:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b6d74e15-ea99-4a5d-8e8e-bc906edd6600 tempest-VolumesGetTest-667192801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-05da807c-d523-4a09-a381-b557f1038d40 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d4a1f069-13f2-4ee1-82a4-a84152588ba8 tempest-VolumesDeleteCascade-645296602 None] Lock "cinder-quobyte-e337794a-eca7-4183-8931-e51264966c53" acquired by "_copy_volume_from_snapshot" :: waited 0.061s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:43:25 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d4a1f069-13f2-4ee1-82a4-a84152588ba8 tempest-VolumesDeleteCascade-645296602 None] snapshot: 7f3ad172-bf2a-433c-8955-5390974effb9, volume: e337794a-eca7-4183-8931-e51264966c53, {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 11 04:43:25 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-acb68f0e-de9e-4a3c-8b9a-6f7755ba2423 tempest-VolumesTransfersV357Test-1009111257 None] Created volume successfully. Aug 11 04:43:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d4a1f069-13f2-4ee1-82a4-a84152588ba8 tempest-VolumesDeleteCascade-645296602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:43:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d4a1f069-13f2-4ee1-82a4-a84152588ba8 tempest-VolumesDeleteCascade-645296602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:43:25 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d4a1f069-13f2-4ee1-82a4-a84152588ba8 tempest-VolumesDeleteCascade-645296602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:43:25 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d4a1f069-13f2-4ee1-82a4-a84152588ba8 tempest-VolumesDeleteCascade-645296602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:43:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d4a1f069-13f2-4ee1-82a4-a84152588ba8 tempest-VolumesDeleteCascade-645296602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:43:25 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a217fb8-7598-4779-9379-7efa24f26030]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:43:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d4a1f069-13f2-4ee1-82a4-a84152588ba8 tempest-VolumesDeleteCascade-645296602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6.7f3ad172-bf2a-433c-8955-5390974effb9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:25 devstack sudo[102919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-05da807c-d523-4a09-a381-b557f1038d40 Aug 11 04:43:25 devstack sudo[102919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:25 devstack sudo[102920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6.7f3ad172-bf2a-433c-8955-5390974effb9 Aug 11 04:43:25 devstack sudo[102920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:26 devstack sudo[102919]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b6d74e15-ea99-4a5d-8e8e-bc906edd6600 tempest-VolumesGetTest-667192801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-05da807c-d523-4a09-a381-b557f1038d40" returned: 0 in 0.564s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b6d74e15-ea99-4a5d-8e8e-bc906edd6600 tempest-VolumesGetTest-667192801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-05da807c-d523-4a09-a381-b557f1038d40 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:26 devstack sudo[102928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-05da807c-d523-4a09-a381-b557f1038d40 Aug 11 04:43:26 devstack sudo[102928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:26 devstack sudo[102920]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d4a1f069-13f2-4ee1-82a4-a84152588ba8 tempest-VolumesDeleteCascade-645296602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6.7f3ad172-bf2a-433c-8955-5390974effb9" returned: 0 in 0.574s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:26 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-d4a1f069-13f2-4ee1-82a4-a84152588ba8 tempest-VolumesDeleteCascade-645296602 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:43:26 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[5833939b-7dbf-4a36-a0be-92e9d8caa3cd]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:43:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d4a1f069-13f2-4ee1-82a4-a84152588ba8 tempest-VolumesDeleteCascade-645296602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:26 devstack sudo[102931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6 Aug 11 04:43:26 devstack sudo[102931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:26 devstack sudo[102928]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b6d74e15-ea99-4a5d-8e8e-bc906edd6600 tempest-VolumesGetTest-667192801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-05da807c-d523-4a09-a381-b557f1038d40" returned: 0 in 0.361s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:26 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b6d74e15-ea99-4a5d-8e8e-bc906edd6600 tempest-VolumesGetTest-667192801 None] Lock "cinder-quobyte-05da807c-d523-4a09-a381-b557f1038d40" released by "delete_volume" :: held 1.029s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:43:26 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-b6d74e15-ea99-4a5d-8e8e-bc906edd6600 tempest-VolumesGetTest-667192801 None] Created reservations ['8f49c50f-336d-4c26-8fac-485fcf46dee5', '385ee89f-d257-40bc-bded-990ade2e8ddd', '5ed29c51-5e37-4b10-bbe2-5d36c65b2b1c', '14653baf-e088-4786-b4a4-295bb3cff121'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:43:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b6d74e15-ea99-4a5d-8e8e-bc906edd6600 tempest-VolumesGetTest-667192801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:43:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b6d74e15-ea99-4a5d-8e8e-bc906edd6600 tempest-VolumesGetTest-667192801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:43:26 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b6d74e15-ea99-4a5d-8e8e-bc906edd6600 tempest-VolumesGetTest-667192801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:43:26 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b6d74e15-ea99-4a5d-8e8e-bc906edd6600 tempest-VolumesGetTest-667192801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:43:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b6d74e15-ea99-4a5d-8e8e-bc906edd6600 tempest-VolumesGetTest-667192801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:43:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b6d74e15-ea99-4a5d-8e8e-bc906edd6600 tempest-VolumesGetTest-667192801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:26 devstack sudo[102931]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d4a1f069-13f2-4ee1-82a4-a84152588ba8 tempest-VolumesDeleteCascade-645296602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6" returned: 0 in 0.585s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:26 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d4a1f069-13f2-4ee1-82a4-a84152588ba8 tempest-VolumesDeleteCascade-645296602 None] will copy from snapshot at /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6 {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 11 04:43:26 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d4a1f069-13f2-4ee1-82a4-a84152588ba8 tempest-VolumesDeleteCascade-645296602 None] Creating direct copy from snapshot {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 11 04:43:26 devstack cinder-volume[94472]: DEBUG cinder.utils [None req-d4a1f069-13f2-4ee1-82a4-a84152588ba8 tempest-VolumesDeleteCascade-645296602 None] Path /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e337794a-eca7-4183-8931-e51264966c53 not found in is_blk_device check {{(pid=94472) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 11 04:43:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d4a1f069-13f2-4ee1-82a4-a84152588ba8 tempest-VolumesDeleteCascade-645296602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e337794a-eca7-4183-8931-e51264966c53 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:26 devstack sudo[102937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:43:26 devstack sudo[102937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:26 devstack sudo[102939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e337794a-eca7-4183-8931-e51264966c53 Aug 11 04:43:26 devstack sudo[102939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:27 devstack sudo[102937]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b6d74e15-ea99-4a5d-8e8e-bc906edd6600 tempest-VolumesGetTest-667192801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.472s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:27 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-b6d74e15-ea99-4a5d-8e8e-bc906edd6600 tempest-VolumesGetTest-667192801 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:43:27 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-b6d74e15-ea99-4a5d-8e8e-bc906edd6600 tempest-VolumesGetTest-667192801 None] Deleted volume successfully. Aug 11 04:43:27 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b6d74e15-ea99-4a5d-8e8e-bc906edd6600 tempest-VolumesGetTest-667192801 None] Lock "cinder-05da807c-d523-4a09-a381-b557f1038d40-delete_volume" released by "delete_volume" :: held 1.979s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:43:27 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-953f53c4-e860-4b6f-9679-b9edc30f8ac9 tempest-VolumesTransfersV357Test-1536557300 None] Transfer volume completed successfully. Aug 11 04:43:28 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-252ac617-3f2f-47f8-bf8c-fc1278fa60fd tempest-VolumesGetTest-667192801 None] Acquiring lock "cinder-1badf4b3-7b55-4074-9ee4-59bda24b6688-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:43:28 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-252ac617-3f2f-47f8-bf8c-fc1278fa60fd tempest-VolumesGetTest-667192801 None] Lock "cinder-1badf4b3-7b55-4074-9ee4-59bda24b6688-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:43:28 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-252ac617-3f2f-47f8-bf8c-fc1278fa60fd tempest-VolumesGetTest-667192801 None] Acquiring lock "cinder-quobyte-1badf4b3-7b55-4074-9ee4-59bda24b6688" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:43:28 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-252ac617-3f2f-47f8-bf8c-fc1278fa60fd tempest-VolumesGetTest-667192801 None] Lock "cinder-quobyte-1badf4b3-7b55-4074-9ee4-59bda24b6688" acquired by "delete_volume" :: waited 0.029s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:43:28 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e7125c-61e5-4281-8b78-7d7e09562f89]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:43:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-252ac617-3f2f-47f8-bf8c-fc1278fa60fd tempest-VolumesGetTest-667192801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1badf4b3-7b55-4074-9ee4-59bda24b6688 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:28 devstack sudo[103001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1badf4b3-7b55-4074-9ee4-59bda24b6688 Aug 11 04:43:28 devstack sudo[103001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:28 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-39720421-f40f-425a-b466-fac67d5244a4 req-591423b9-3ccd-4e27-a7ee-7405c6899575 tempest-ServerActionsTestOtherA-1583977559 None] Terminate volume connection completed successfully. Aug 11 04:43:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-39720421-f40f-425a-b466-fac67d5244a4 req-591423b9-3ccd-4e27-a7ee-7405c6899575 tempest-ServerActionsTestOtherA-1583977559 None] Deleting attachment e9563909-99ce-488b-b1ce-751ab29b8010. {{(pid=94472) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 11 04:43:29 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b290cadf-77b9-4969-96d2-2c031e99fc00 tempest-VolumesTransfersV357Test-815564328 None] Acquiring lock "cinder-885fbca7-0b67-40e6-b070-ee52fa1b1189-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:43:29 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b290cadf-77b9-4969-96d2-2c031e99fc00 tempest-VolumesTransfersV357Test-815564328 None] Lock "cinder-885fbca7-0b67-40e6-b070-ee52fa1b1189-delete_volume" acquired by "delete_volume" :: waited 0.110s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:43:29 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b290cadf-77b9-4969-96d2-2c031e99fc00 tempest-VolumesTransfersV357Test-815564328 None] Acquiring lock "cinder-quobyte-885fbca7-0b67-40e6-b070-ee52fa1b1189" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:43:29 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b290cadf-77b9-4969-96d2-2c031e99fc00 tempest-VolumesTransfersV357Test-815564328 None] Lock "cinder-quobyte-885fbca7-0b67-40e6-b070-ee52fa1b1189" acquired by "delete_volume" :: waited 0.064s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:43:29 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64a1cfb-b690-413f-a28d-c3664deddc47]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:43:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b290cadf-77b9-4969-96d2-2c031e99fc00 tempest-VolumesTransfersV357Test-815564328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-885fbca7-0b67-40e6-b070-ee52fa1b1189 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:29 devstack sudo[103001]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-252ac617-3f2f-47f8-bf8c-fc1278fa60fd tempest-VolumesGetTest-667192801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1badf4b3-7b55-4074-9ee4-59bda24b6688" returned: 0 in 1.351s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-252ac617-3f2f-47f8-bf8c-fc1278fa60fd tempest-VolumesGetTest-667192801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1badf4b3-7b55-4074-9ee4-59bda24b6688 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:29 devstack sudo[103003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-885fbca7-0b67-40e6-b070-ee52fa1b1189 Aug 11 04:43:29 devstack sudo[103003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:29 devstack sudo[103010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1badf4b3-7b55-4074-9ee4-59bda24b6688 Aug 11 04:43:29 devstack sudo[103010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:30 devstack sudo[103003]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b290cadf-77b9-4969-96d2-2c031e99fc00 tempest-VolumesTransfersV357Test-815564328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-885fbca7-0b67-40e6-b070-ee52fa1b1189" returned: 0 in 1.201s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b290cadf-77b9-4969-96d2-2c031e99fc00 tempest-VolumesTransfersV357Test-815564328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-885fbca7-0b67-40e6-b070-ee52fa1b1189 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:30 devstack sudo[103016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-885fbca7-0b67-40e6-b070-ee52fa1b1189 Aug 11 04:43:30 devstack sudo[103016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:30 devstack sudo[103010]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-252ac617-3f2f-47f8-bf8c-fc1278fa60fd tempest-VolumesGetTest-667192801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1badf4b3-7b55-4074-9ee4-59bda24b6688" returned: 0 in 0.938s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-252ac617-3f2f-47f8-bf8c-fc1278fa60fd tempest-VolumesGetTest-667192801 None] Lock "cinder-quobyte-1badf4b3-7b55-4074-9ee4-59bda24b6688" released by "delete_volume" :: held 2.423s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:43:31 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-252ac617-3f2f-47f8-bf8c-fc1278fa60fd tempest-VolumesGetTest-667192801 None] Created reservations ['b7afbdb6-06b6-42cf-9f77-613cf620c89e', '73d7ebe4-6ed2-4926-bd21-793d7b13327d', 'dc090cbc-6ddd-425d-a525-c964c31ba411', 'e5e502aa-184c-4b09-9f54-bf6a9f216b65'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:43:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-252ac617-3f2f-47f8-bf8c-fc1278fa60fd tempest-VolumesGetTest-667192801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:43:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-252ac617-3f2f-47f8-bf8c-fc1278fa60fd tempest-VolumesGetTest-667192801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:43:31 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-252ac617-3f2f-47f8-bf8c-fc1278fa60fd tempest-VolumesGetTest-667192801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:43:31 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-252ac617-3f2f-47f8-bf8c-fc1278fa60fd tempest-VolumesGetTest-667192801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:43:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-252ac617-3f2f-47f8-bf8c-fc1278fa60fd tempest-VolumesGetTest-667192801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:43:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-252ac617-3f2f-47f8-bf8c-fc1278fa60fd tempest-VolumesGetTest-667192801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:31 devstack sudo[103019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:43:31 devstack sudo[103019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:31 devstack sudo[103016]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b290cadf-77b9-4969-96d2-2c031e99fc00 tempest-VolumesTransfersV357Test-815564328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-885fbca7-0b67-40e6-b070-ee52fa1b1189" returned: 0 in 0.880s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:31 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b290cadf-77b9-4969-96d2-2c031e99fc00 tempest-VolumesTransfersV357Test-815564328 None] Lock "cinder-quobyte-885fbca7-0b67-40e6-b070-ee52fa1b1189" released by "delete_volume" :: held 2.208s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:43:31 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-b290cadf-77b9-4969-96d2-2c031e99fc00 tempest-VolumesTransfersV357Test-815564328 None] Created reservations ['d559c92e-bff8-4041-9a41-8b0e42e2804f', '858ab3f1-9d37-4025-a3fe-eb129701c6f1', 'b31e5ecf-494d-413f-8867-b972d982ca81', '9ea74e23-5cd5-4d74-97d0-2862f19b5048'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:43:31 devstack sudo[103019]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b290cadf-77b9-4969-96d2-2c031e99fc00 tempest-VolumesTransfersV357Test-815564328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:43:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b290cadf-77b9-4969-96d2-2c031e99fc00 tempest-VolumesTransfersV357Test-815564328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:43:31 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b290cadf-77b9-4969-96d2-2c031e99fc00 tempest-VolumesTransfersV357Test-815564328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:43:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b290cadf-77b9-4969-96d2-2c031e99fc00 tempest-VolumesTransfersV357Test-815564328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:43:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b290cadf-77b9-4969-96d2-2c031e99fc00 tempest-VolumesTransfersV357Test-815564328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:43:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b290cadf-77b9-4969-96d2-2c031e99fc00 tempest-VolumesTransfersV357Test-815564328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-252ac617-3f2f-47f8-bf8c-fc1278fa60fd tempest-VolumesGetTest-667192801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.805s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:32 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-252ac617-3f2f-47f8-bf8c-fc1278fa60fd tempest-VolumesGetTest-667192801 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:43:32 devstack sudo[103023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:43:32 devstack sudo[103023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:32 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-252ac617-3f2f-47f8-bf8c-fc1278fa60fd tempest-VolumesGetTest-667192801 None] Deleted volume successfully. Aug 11 04:43:32 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-252ac617-3f2f-47f8-bf8c-fc1278fa60fd tempest-VolumesGetTest-667192801 None] Lock "cinder-1badf4b3-7b55-4074-9ee4-59bda24b6688-delete_volume" released by "delete_volume" :: held 3.899s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:43:32 devstack sudo[103023]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b290cadf-77b9-4969-96d2-2c031e99fc00 tempest-VolumesTransfersV357Test-815564328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.905s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:32 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-b290cadf-77b9-4969-96d2-2c031e99fc00 tempest-VolumesTransfersV357Test-815564328 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:43:32 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-b290cadf-77b9-4969-96d2-2c031e99fc00 tempest-VolumesTransfersV357Test-815564328 None] Deleted volume successfully. Aug 11 04:43:32 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:UPDATE=180,cinder:SELECT=151,cinder:INSERT=58,cinder:DELETE=21 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:43:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b290cadf-77b9-4969-96d2-2c031e99fc00 tempest-VolumesTransfersV357Test-815564328 None] Lock "cinder-885fbca7-0b67-40e6-b070-ee52fa1b1189-delete_volume" released by "delete_volume" :: held 3.759s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:43:33 devstack sudo[102939]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d4a1f069-13f2-4ee1-82a4-a84152588ba8 tempest-VolumesDeleteCascade-645296602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e337794a-eca7-4183-8931-e51264966c53" returned: 0 in 6.751s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:33 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-d4a1f069-13f2-4ee1-82a4-a84152588ba8 tempest-VolumesDeleteCascade-645296602 None] Image conversion details: src /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6, size 1024.00 MB, duration 6.75 sec, destination /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e337794a-eca7-4183-8931-e51264966c53 {{(pid=94472) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 11 04:43:33 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-d4a1f069-13f2-4ee1-82a4-a84152588ba8 tempest-VolumesDeleteCascade-645296602 None] Converted 1024.00 MB image at 151.67 MB/s Aug 11 04:43:33 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-d4a1f069-13f2-4ee1-82a4-a84152588ba8 tempest-VolumesDeleteCascade-645296602 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e337794a-eca7-4183-8931-e51264966c53 is being set with open permissions: ugo+rw Aug 11 04:43:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d4a1f069-13f2-4ee1-82a4-a84152588ba8 tempest-VolumesDeleteCascade-645296602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e337794a-eca7-4183-8931-e51264966c53 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:33 devstack sudo[103036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e337794a-eca7-4183-8931-e51264966c53 Aug 11 04:43:33 devstack sudo[103036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-39720421-f40f-425a-b466-fac67d5244a4 req-07d64896-a0d9-4d7c-8c59-9431960aada5 tempest-ServerActionsTestOtherA-1583977559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:43:33 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-17b82252-f0ae-48fa-94cd-5e1f5804a561 tempest-VolumesGetTest-667192801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:43:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-17b82252-f0ae-48fa-94cd-5e1f5804a561 tempest-VolumesGetTest-667192801 None] Flow 'volume_create_manager' (93ea2e4c-a021-449d-802a-30f7fd6ae094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:43:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-17b82252-f0ae-48fa-94cd-5e1f5804a561 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab8fb1af-b8fe-471d-8a74-e7f47a1ba20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-17b82252-f0ae-48fa-94cd-5e1f5804a561 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab8fb1af-b8fe-471d-8a74-e7f47a1ba20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:43:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1122162202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9996e5b-3c6d-4092-b4ed-aaa421a04f4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4be18a68d5524857b2b7b1bf2e849c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:43:34Z,use_quota=True,user_id='885fd20bf9004603a4c318af0014813d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-17b82252-f0ae-48fa-94cd-5e1f5804a561 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bc4c090-7bc2-4ad9-b2c6-7f344a8bf52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-17b82252-f0ae-48fa-94cd-5e1f5804a561 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bc4c090-7bc2-4ad9-b2c6-7f344a8bf52b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-17b82252-f0ae-48fa-94cd-5e1f5804a561 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd588432-2a4a-402d-86ee-ab7594e88af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-17b82252-f0ae-48fa-94cd-5e1f5804a561 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd588432-2a4a-402d-86ee-ab7594e88af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9996e5b-3c6d-4092-b4ed-aaa421a04f4f', 'volume_name': 'volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-17b82252-f0ae-48fa-94cd-5e1f5804a561 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2707d138-493a-4ad7-837f-e2ec60b37d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-17b82252-f0ae-48fa-94cd-5e1f5804a561 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2707d138-493a-4ad7-837f-e2ec60b37d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-17b82252-f0ae-48fa-94cd-5e1f5804a561 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1892d207-19fe-429a-bb93-7af36ca53c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:33 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-17b82252-f0ae-48fa-94cd-5e1f5804a561 tempest-VolumesGetTest-667192801 None] Volume d9996e5b-3c6d-4092-b4ed-aaa421a04f4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f', 'volume_size': 1} Aug 11 04:43:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-17b82252-f0ae-48fa-94cd-5e1f5804a561 tempest-VolumesGetTest-667192801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:43:33 devstack sudo[103036]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d4a1f069-13f2-4ee1-82a4-a84152588ba8 tempest-VolumesDeleteCascade-645296602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e337794a-eca7-4183-8931-e51264966c53" returned: 0 in 0.287s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d4a1f069-13f2-4ee1-82a4-a84152588ba8 tempest-VolumesDeleteCascade-645296602 None] Lock "cinder-quobyte-e337794a-eca7-4183-8931-e51264966c53" released by "_copy_volume_from_snapshot" :: held 8.326s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:43:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d4a1f069-13f2-4ee1-82a4-a84152588ba8 tempest-VolumesDeleteCascade-645296602 None] Lock "cinder-quobyte-7f3ad172-bf2a-433c-8955-5390974effb9-e337794a-eca7-4183-8931-e51264966c53" released by "_create_volume_from_snapshot" :: held 8.452s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:43:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d4a1f069-13f2-4ee1-82a4-a84152588ba8 tempest-VolumesDeleteCascade-645296602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.522s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:43:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-39720421-f40f-425a-b466-fac67d5244a4 req-07d64896-a0d9-4d7c-8c59-9431960aada5 tempest-ServerActionsTestOtherA-1583977559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.254s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:43:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-39720421-f40f-425a-b466-fac67d5244a4 req-07d64896-a0d9-4d7c-8c59-9431960aada5 tempest-ServerActionsTestOtherA-1583977559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:43:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-17b82252-f0ae-48fa-94cd-5e1f5804a561 tempest-VolumesGetTest-667192801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.132s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:43:33 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-17b82252-f0ae-48fa-94cd-5e1f5804a561 tempest-VolumesGetTest-667192801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:43:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1122162202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9996e5b-3c6d-4092-b4ed-aaa421a04f4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4be18a68d5524857b2b7b1bf2e849c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:43:34Z,use_quota=True,user_id='885fd20bf9004603a4c318af0014813d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:43:33 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-17b82252-f0ae-48fa-94cd-5e1f5804a561 tempest-VolumesGetTest-667192801 None] Creating volume d9996e5b-3c6d-4092-b4ed-aaa421a04f4f {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:43:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-17b82252-f0ae-48fa-94cd-5e1f5804a561 tempest-VolumesGetTest-667192801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:43:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-17b82252-f0ae-48fa-94cd-5e1f5804a561 tempest-VolumesGetTest-667192801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:43:33 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-17b82252-f0ae-48fa-94cd-5e1f5804a561 tempest-VolumesGetTest-667192801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:43:33 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-17b82252-f0ae-48fa-94cd-5e1f5804a561 tempest-VolumesGetTest-667192801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:43:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-17b82252-f0ae-48fa-94cd-5e1f5804a561 tempest-VolumesGetTest-667192801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:43:33 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-17b82252-f0ae-48fa-94cd-5e1f5804a561 tempest-VolumesGetTest-667192801 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:43:33 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-17b82252-f0ae-48fa-94cd-5e1f5804a561 tempest-VolumesGetTest-667192801 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:43:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-17b82252-f0ae-48fa-94cd-5e1f5804a561 tempest-VolumesGetTest-667192801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d4a1f069-13f2-4ee1-82a4-a84152588ba8 tempest-VolumesDeleteCascade-645296602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63959417-90f0-4870-b6ff-ae10acc2b186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e337794a-eca7-4183-8931-e51264966c53', 'volume_size': 1, 'snapshot_id': '7f3ad172-bf2a-433c-8955-5390974effb9'}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:33 devstack sudo[103039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f 1073741824 Aug 11 04:43:33 devstack sudo[103039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d4a1f069-13f2-4ee1-82a4-a84152588ba8 tempest-VolumesDeleteCascade-645296602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63094f75-aca8-4f68-9f55-2af829437366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:33 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f41f622-403c-4e6b-8834-c331a86ffa23 tempest-VolumesTransfersV357Test-1009111257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:43:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0f41f622-403c-4e6b-8834-c331a86ffa23 tempest-VolumesTransfersV357Test-1009111257 None] Flow 'volume_create_manager' (aa025d18-ed1c-4650-b6c0-d9326da24cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:43:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0f41f622-403c-4e6b-8834-c331a86ffa23 tempest-VolumesTransfersV357Test-1009111257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5924c367-822a-4223-88fc-341a6a3214ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:33 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-d4a1f069-13f2-4ee1-82a4-a84152588ba8 tempest-VolumesDeleteCascade-645296602 None] Volume volume-e337794a-eca7-4183-8931-e51264966c53 (e337794a-eca7-4183-8931-e51264966c53): created successfully Aug 11 04:43:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d4a1f069-13f2-4ee1-82a4-a84152588ba8 tempest-VolumesDeleteCascade-645296602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63094f75-aca8-4f68-9f55-2af829437366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d4a1f069-13f2-4ee1-82a4-a84152588ba8 tempest-VolumesDeleteCascade-645296602 None] Flow 'volume_create_manager' (3c821f66-5bfe-4bfa-9500-a6eab8b0c50c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:43:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0f41f622-403c-4e6b-8834-c331a86ffa23 tempest-VolumesTransfersV357Test-1009111257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5924c367-822a-4223-88fc-341a6a3214ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2020875057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e08dc92-cf10-4dd9-9bd9-3e460ee49ca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bab38fcd396d459b9e053493efc37725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:43:34Z,use_quota=True,user_id='2f67a19f60454c2eb54c933933781f3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0f41f622-403c-4e6b-8834-c331a86ffa23 tempest-VolumesTransfersV357Test-1009111257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1032e0a-6c6f-4a23-b004-c4d10d2f4fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0f41f622-403c-4e6b-8834-c331a86ffa23 tempest-VolumesTransfersV357Test-1009111257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1032e0a-6c6f-4a23-b004-c4d10d2f4fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0f41f622-403c-4e6b-8834-c331a86ffa23 tempest-VolumesTransfersV357Test-1009111257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f07cd339-e31e-47e0-b14d-395ce6426268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0f41f622-403c-4e6b-8834-c331a86ffa23 tempest-VolumesTransfersV357Test-1009111257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f07cd339-e31e-47e0-b14d-395ce6426268) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e08dc92-cf10-4dd9-9bd9-3e460ee49ca8', 'volume_name': 'volume-9e08dc92-cf10-4dd9-9bd9-3e460ee49ca8', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0f41f622-403c-4e6b-8834-c331a86ffa23 tempest-VolumesTransfersV357Test-1009111257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bd0da25-1698-458e-9264-d5adb72d73cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0f41f622-403c-4e6b-8834-c331a86ffa23 tempest-VolumesTransfersV357Test-1009111257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bd0da25-1698-458e-9264-d5adb72d73cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0f41f622-403c-4e6b-8834-c331a86ffa23 tempest-VolumesTransfersV357Test-1009111257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (175d1553-037c-4cb2-96f1-3a3d749f160c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:34 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-0f41f622-403c-4e6b-8834-c331a86ffa23 tempest-VolumesTransfersV357Test-1009111257 None] Volume 9e08dc92-cf10-4dd9-9bd9-3e460ee49ca8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e08dc92-cf10-4dd9-9bd9-3e460ee49ca8', 'volume_size': 1} Aug 11 04:43:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0f41f622-403c-4e6b-8834-c331a86ffa23 tempest-VolumesTransfersV357Test-1009111257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:43:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-39720421-f40f-425a-b466-fac67d5244a4 req-07d64896-a0d9-4d7c-8c59-9431960aada5 tempest-ServerActionsTestOtherA-1583977559 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd', 'name': 'volume-94c58ff1-a7f5-4c32-9664-ce0425ceb324', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '93aa7fd7-4314-4c16-8fe6-627f9a34c1e0', 'enforce_multipath': True} {{(pid=94472) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 11 04:43:34 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-d4a1f069-13f2-4ee1-82a4-a84152588ba8 tempest-VolumesDeleteCascade-645296602 None] Created volume successfully. Aug 11 04:43:34 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-39720421-f40f-425a-b466-fac67d5244a4 req-07d64896-a0d9-4d7c-8c59-9431960aada5 tempest-ServerActionsTestOtherA-1583977559 None] attachment_update completed successfully. Aug 11 04:43:34 devstack sudo[103039]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-17b82252-f0ae-48fa-94cd-5e1f5804a561 tempest-VolumesGetTest-667192801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f 1073741824" returned: 0 in 0.499s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-17b82252-f0ae-48fa-94cd-5e1f5804a561 tempest-VolumesGetTest-667192801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:34 devstack sudo[103088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f Aug 11 04:43:34 devstack sudo[103088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:34 devstack sudo[103088]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-17b82252-f0ae-48fa-94cd-5e1f5804a561 tempest-VolumesGetTest-667192801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f" returned: 0 in 0.345s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-17b82252-f0ae-48fa-94cd-5e1f5804a561 tempest-VolumesGetTest-667192801 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:43:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-17b82252-f0ae-48fa-94cd-5e1f5804a561 tempest-VolumesGetTest-667192801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:43:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0f41f622-403c-4e6b-8834-c331a86ffa23 tempest-VolumesTransfersV357Test-1009111257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.754s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:43:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0f41f622-403c-4e6b-8834-c331a86ffa23 tempest-VolumesTransfersV357Test-1009111257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2020875057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e08dc92-cf10-4dd9-9bd9-3e460ee49ca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bab38fcd396d459b9e053493efc37725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:43:34Z,use_quota=True,user_id='2f67a19f60454c2eb54c933933781f3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:43:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-0f41f622-403c-4e6b-8834-c331a86ffa23 tempest-VolumesTransfersV357Test-1009111257 None] Creating volume 9e08dc92-cf10-4dd9-9bd9-3e460ee49ca8 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:43:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0f41f622-403c-4e6b-8834-c331a86ffa23 tempest-VolumesTransfersV357Test-1009111257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:43:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0f41f622-403c-4e6b-8834-c331a86ffa23 tempest-VolumesTransfersV357Test-1009111257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:43:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0f41f622-403c-4e6b-8834-c331a86ffa23 tempest-VolumesTransfersV357Test-1009111257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:43:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0f41f622-403c-4e6b-8834-c331a86ffa23 tempest-VolumesTransfersV357Test-1009111257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:43:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0f41f622-403c-4e6b-8834-c331a86ffa23 tempest-VolumesTransfersV357Test-1009111257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:43:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0f41f622-403c-4e6b-8834-c331a86ffa23 tempest-VolumesTransfersV357Test-1009111257 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:43:34 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-0f41f622-403c-4e6b-8834-c331a86ffa23 tempest-VolumesTransfersV357Test-1009111257 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:43:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0f41f622-403c-4e6b-8834-c331a86ffa23 tempest-VolumesTransfersV357Test-1009111257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9e08dc92-cf10-4dd9-9bd9-3e460ee49ca8 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:34 devstack sudo[103130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9e08dc92-cf10-4dd9-9bd9-3e460ee49ca8 1073741824 Aug 11 04:43:34 devstack sudo[103130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-17b82252-f0ae-48fa-94cd-5e1f5804a561 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1892d207-19fe-429a-bb93-7af36ca53c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-17b82252-f0ae-48fa-94cd-5e1f5804a561 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dada736-0b6a-4ee0-a817-62257745a8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:34 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-17b82252-f0ae-48fa-94cd-5e1f5804a561 tempest-VolumesGetTest-667192801 None] Volume volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f (d9996e5b-3c6d-4092-b4ed-aaa421a04f4f): created successfully Aug 11 04:43:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-17b82252-f0ae-48fa-94cd-5e1f5804a561 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dada736-0b6a-4ee0-a817-62257745a8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-17b82252-f0ae-48fa-94cd-5e1f5804a561 tempest-VolumesGetTest-667192801 None] Flow 'volume_create_manager' (93ea2e4c-a021-449d-802a-30f7fd6ae094) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:43:34 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-17b82252-f0ae-48fa-94cd-5e1f5804a561 tempest-VolumesGetTest-667192801 None] Created volume successfully. Aug 11 04:43:35 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-30de5a84-8a59-43cf-8728-7f99f7a14a53 tempest-VolumesDeleteCascade-645296602 None] Acquiring lock "cinder-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:43:35 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-30de5a84-8a59-43cf-8728-7f99f7a14a53 tempest-VolumesDeleteCascade-645296602 None] Lock "cinder-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:43:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-30de5a84-8a59-43cf-8728-7f99f7a14a53 tempest-VolumesDeleteCascade-645296602 None] Performing cascade delete. {{(pid=94472) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 11 04:43:35 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-30de5a84-8a59-43cf-8728-7f99f7a14a53 tempest-VolumesDeleteCascade-645296602 None] Acquiring lock "cinder-7f3ad172-bf2a-433c-8955-5390974effb9-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:43:35 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-30de5a84-8a59-43cf-8728-7f99f7a14a53 tempest-VolumesDeleteCascade-645296602 None] Lock "cinder-7f3ad172-bf2a-433c-8955-5390974effb9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:43:35 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-30de5a84-8a59-43cf-8728-7f99f7a14a53 tempest-VolumesDeleteCascade-645296602 None] Acquiring lock "cinder-quobyte-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:43:35 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-30de5a84-8a59-43cf-8728-7f99f7a14a53 tempest-VolumesDeleteCascade-645296602 None] Lock "cinder-quobyte-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:43:35 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-30de5a84-8a59-43cf-8728-7f99f7a14a53 tempest-VolumesDeleteCascade-645296602 None] Acquiring lock "cinder-quobyte-7f3ad172-bf2a-433c-8955-5390974effb9" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:43:35 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-30de5a84-8a59-43cf-8728-7f99f7a14a53 tempest-VolumesDeleteCascade-645296602 None] Lock "cinder-quobyte-7f3ad172-bf2a-433c-8955-5390974effb9" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:43:35 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-30de5a84-8a59-43cf-8728-7f99f7a14a53 tempest-VolumesDeleteCascade-645296602 None] Deleting offline snapshot 7f3ad172-bf2a-433c-8955-5390974effb9 of volume cf50e816-c2e1-4fc8-8f9e-0e815765c2d6 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 04:43:35 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-30de5a84-8a59-43cf-8728-7f99f7a14a53 tempest-VolumesDeleteCascade-645296602 None] snapshot_file for this snap is: volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6.7f3ad172-bf2a-433c-8955-5390974effb9 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 04:43:35 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[9713afd7-ffd2-433d-b542-21440286b1bb]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:43:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-30de5a84-8a59-43cf-8728-7f99f7a14a53 tempest-VolumesDeleteCascade-645296602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6.7f3ad172-bf2a-433c-8955-5390974effb9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:35 devstack sudo[103130]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0f41f622-403c-4e6b-8834-c331a86ffa23 tempest-VolumesTransfersV357Test-1009111257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9e08dc92-cf10-4dd9-9bd9-3e460ee49ca8 1073741824" returned: 0 in 0.641s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0f41f622-403c-4e6b-8834-c331a86ffa23 tempest-VolumesTransfersV357Test-1009111257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9e08dc92-cf10-4dd9-9bd9-3e460ee49ca8 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:35 devstack sudo[103465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9e08dc92-cf10-4dd9-9bd9-3e460ee49ca8 Aug 11 04:43:35 devstack sudo[103465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:35 devstack sudo[103461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6.7f3ad172-bf2a-433c-8955-5390974effb9 Aug 11 04:43:35 devstack sudo[103461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:35 devstack sudo[103465]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0f41f622-403c-4e6b-8834-c331a86ffa23 tempest-VolumesTransfersV357Test-1009111257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9e08dc92-cf10-4dd9-9bd9-3e460ee49ca8" returned: 0 in 0.312s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:35 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0f41f622-403c-4e6b-8834-c331a86ffa23 tempest-VolumesTransfersV357Test-1009111257 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:43:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0f41f622-403c-4e6b-8834-c331a86ffa23 tempest-VolumesTransfersV357Test-1009111257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:43:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0f41f622-403c-4e6b-8834-c331a86ffa23 tempest-VolumesTransfersV357Test-1009111257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (175d1553-037c-4cb2-96f1-3a3d749f160c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e08dc92-cf10-4dd9-9bd9-3e460ee49ca8', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0f41f622-403c-4e6b-8834-c331a86ffa23 tempest-VolumesTransfersV357Test-1009111257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffafebc5-3091-409c-8336-ff67695a07dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:35 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-0f41f622-403c-4e6b-8834-c331a86ffa23 tempest-VolumesTransfersV357Test-1009111257 None] Volume volume-9e08dc92-cf10-4dd9-9bd9-3e460ee49ca8 (9e08dc92-cf10-4dd9-9bd9-3e460ee49ca8): created successfully Aug 11 04:43:35 devstack sudo[103461]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0f41f622-403c-4e6b-8834-c331a86ffa23 tempest-VolumesTransfersV357Test-1009111257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffafebc5-3091-409c-8336-ff67695a07dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0f41f622-403c-4e6b-8834-c331a86ffa23 tempest-VolumesTransfersV357Test-1009111257 None] Flow 'volume_create_manager' (aa025d18-ed1c-4650-b6c0-d9326da24cda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:43:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-30de5a84-8a59-43cf-8728-7f99f7a14a53 tempest-VolumesDeleteCascade-645296602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6.7f3ad172-bf2a-433c-8955-5390974effb9" returned: 0 in 0.479s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:35 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-30de5a84-8a59-43cf-8728-7f99f7a14a53 tempest-VolumesDeleteCascade-645296602 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:43:35 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-0f41f622-403c-4e6b-8834-c331a86ffa23 tempest-VolumesTransfersV357Test-1009111257 None] Created volume successfully. Aug 11 04:43:35 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd009ca5-d894-44f2-98db-fed8d40b53d1]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:43:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-30de5a84-8a59-43cf-8728-7f99f7a14a53 tempest-VolumesDeleteCascade-645296602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:36 devstack sudo[103481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6 Aug 11 04:43:36 devstack sudo[103481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:36 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f931519f-1037-41aa-8c46-a6f08bf21aa7 tempest-VolumesTransfersV357Test-815564328 None] Acquiring lock "cinder-9e08dc92-cf10-4dd9-9bd9-3e460ee49ca8-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:43:36 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:43:36 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f931519f-1037-41aa-8c46-a6f08bf21aa7 tempest-VolumesTransfersV357Test-815564328 None] Lock "cinder-9e08dc92-cf10-4dd9-9bd9-3e460ee49ca8-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:43:36 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] Flow 'volume_create_manager' (a09e09dc-a25e-4cea-8969-8d7d164c2681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:43:36 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26c906b8-d6b9-41a8-9a0d-878854237301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:36 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26c906b8-d6b9-41a8-9a0d-878854237301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:43:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1869100575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1224c9fd-1f96-422d-8a0d-2a5aabe853c2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4be18a68d5524857b2b7b1bf2e849c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=d9996e5b-3c6d-4092-b4ed-aaa421a04f4f,status='creating',terminated_at=None,updated_at=2026-08-11T02:43:36Z,use_quota=True,user_id='885fd20bf9004603a4c318af0014813d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:36 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daaef20d-b993-4c7d-a3fa-40979f36a67a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:36 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daaef20d-b993-4c7d-a3fa-40979f36a67a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:36 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3835b3fc-6e89-4f3c-bea1-fc2d55e050fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:36 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3835b3fc-6e89-4f3c-bea1-fc2d55e050fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '1224c9fd-1f96-422d-8a0d-2a5aabe853c2', 'volume_name': 'volume-1224c9fd-1f96-422d-8a0d-2a5aabe853c2', 'volume_size': 1, 'source_volid': 'd9996e5b-3c6d-4092-b4ed-aaa421a04f4f', 'source_volstatus': 'available'}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:36 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3958f64a-7066-47cc-b988-56e5f97d1155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:36 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3958f64a-7066-47cc-b988-56e5f97d1155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:36 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c469cca-8e7b-48d6-85d2-a47ebdb21483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:36 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] Volume 1224c9fd-1f96-422d-8a0d-2a5aabe853c2: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-1224c9fd-1f96-422d-8a0d-2a5aabe853c2', 'volume_size': 1, 'source_volid': 'd9996e5b-3c6d-4092-b4ed-aaa421a04f4f', 'source_volstatus': 'available'} Aug 11 04:43:36 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f931519f-1037-41aa-8c46-a6f08bf21aa7 tempest-VolumesTransfersV357Test-815564328 None] Acquiring lock "cinder-quobyte-9e08dc92-cf10-4dd9-9bd9-3e460ee49ca8" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:43:36 devstack sudo[103481]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-30de5a84-8a59-43cf-8728-7f99f7a14a53 tempest-VolumesDeleteCascade-645296602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6" returned: 0 in 0.703s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-30de5a84-8a59-43cf-8728-7f99f7a14a53 tempest-VolumesDeleteCascade-645296602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6.7f3ad172-bf2a-433c-8955-5390974effb9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:43:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:43:36 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] Cloning volume d9996e5b-3c6d-4092-b4ed-aaa421a04f4f to volume 1224c9fd-1f96-422d-8a0d-2a5aabe853c2 Aug 11 04:43:36 devstack sudo[103503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6.7f3ad172-bf2a-433c-8955-5390974effb9 Aug 11 04:43:36 devstack sudo[103503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:36 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f931519f-1037-41aa-8c46-a6f08bf21aa7 tempest-VolumesTransfersV357Test-815564328 None] Lock "cinder-quobyte-9e08dc92-cf10-4dd9-9bd9-3e460ee49ca8" acquired by "delete_volume" :: waited 0.047s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:43:36 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] Creating offline snapshot 2d32c552-f4cf-4072-8a15-ec4073789cfd of volume d9996e5b-3c6d-4092-b4ed-aaa421a04f4f {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 04:43:36 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49b84c6-64ae-42d4-a78f-644db66721bd]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:43:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f931519f-1037-41aa-8c46-a6f08bf21aa7 tempest-VolumesTransfersV357Test-815564328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9e08dc92-cf10-4dd9-9bd9-3e460ee49ca8 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:36 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[67154320-cd8b-48bf-beaa-7fc65c053e4b]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:43:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:36 devstack sudo[103505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9e08dc92-cf10-4dd9-9bd9-3e460ee49ca8 Aug 11 04:43:36 devstack sudo[103506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f Aug 11 04:43:36 devstack sudo[103505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:36 devstack sudo[103506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:37 devstack sudo[103503]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-30de5a84-8a59-43cf-8728-7f99f7a14a53 tempest-VolumesDeleteCascade-645296602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6.7f3ad172-bf2a-433c-8955-5390974effb9" returned: 0 in 0.529s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-30de5a84-8a59-43cf-8728-7f99f7a14a53 tempest-VolumesDeleteCascade-645296602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6.7f3ad172-bf2a-433c-8955-5390974effb9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:37 devstack sudo[103506]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f" returned: 0 in 0.474s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f.2d32c552-f4cf-4072-8a15-ec4073789cfd 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:37 devstack sudo[103520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6.7f3ad172-bf2a-433c-8955-5390974effb9 Aug 11 04:43:37 devstack sudo[103520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:37 devstack sudo[103521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f.2d32c552-f4cf-4072-8a15-ec4073789cfd 1G Aug 11 04:43:37 devstack sudo[103521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:37 devstack sudo[103505]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f931519f-1037-41aa-8c46-a6f08bf21aa7 tempest-VolumesTransfersV357Test-815564328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9e08dc92-cf10-4dd9-9bd9-3e460ee49ca8" returned: 0 in 0.552s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f931519f-1037-41aa-8c46-a6f08bf21aa7 tempest-VolumesTransfersV357Test-815564328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9e08dc92-cf10-4dd9-9bd9-3e460ee49ca8 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:37 devstack sudo[103524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9e08dc92-cf10-4dd9-9bd9-3e460ee49ca8 Aug 11 04:43:37 devstack sudo[103524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:37 devstack sudo[103520]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-30de5a84-8a59-43cf-8728-7f99f7a14a53 tempest-VolumesDeleteCascade-645296602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6.7f3ad172-bf2a-433c-8955-5390974effb9" returned: 0 in 0.390s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-30de5a84-8a59-43cf-8728-7f99f7a14a53 tempest-VolumesDeleteCascade-645296602 None] Lock "cinder-quobyte-7f3ad172-bf2a-433c-8955-5390974effb9" released by "_delete_snapshot" :: held 2.240s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:43:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-30de5a84-8a59-43cf-8728-7f99f7a14a53 tempest-VolumesDeleteCascade-645296602 None] Lock "cinder-quobyte-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6" released by "delete_snapshot" :: held 2.273s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:43:37 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-30de5a84-8a59-43cf-8728-7f99f7a14a53 tempest-VolumesDeleteCascade-645296602 None] Created reservations ['2dddd45c-7d73-44b2-9aec-e8ac95af2354', '25104ac8-2c73-40fe-9842-afd0edc0aeb3', '974dd41d-1022-4355-b9f9-4dd4135a1ff6', '7a862015-ec0a-4d64-b0ff-d10501e357b5'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:43:37 devstack sudo[103524]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f931519f-1037-41aa-8c46-a6f08bf21aa7 tempest-VolumesTransfersV357Test-815564328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9e08dc92-cf10-4dd9-9bd9-3e460ee49ca8" returned: 0 in 0.492s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f931519f-1037-41aa-8c46-a6f08bf21aa7 tempest-VolumesTransfersV357Test-815564328 None] Lock "cinder-quobyte-9e08dc92-cf10-4dd9-9bd9-3e460ee49ca8" released by "delete_volume" :: held 1.108s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:43:37 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-30de5a84-8a59-43cf-8728-7f99f7a14a53 tempest-VolumesDeleteCascade-645296602 None] Delete snapshot completed successfully. Aug 11 04:43:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-30de5a84-8a59-43cf-8728-7f99f7a14a53 tempest-VolumesDeleteCascade-645296602 None] Lock "cinder-7f3ad172-bf2a-433c-8955-5390974effb9-delete_snapshot" released by "delete_snapshot" :: held 2.549s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:43:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-30de5a84-8a59-43cf-8728-7f99f7a14a53 tempest-VolumesDeleteCascade-645296602 None] Snapshots deleted, issuing volume delete {{(pid=94472) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 11 04:43:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-30de5a84-8a59-43cf-8728-7f99f7a14a53 tempest-VolumesDeleteCascade-645296602 None] Acquiring lock "cinder-quobyte-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:43:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-30de5a84-8a59-43cf-8728-7f99f7a14a53 tempest-VolumesDeleteCascade-645296602 None] Lock "cinder-quobyte-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6" acquired by "delete_volume" :: waited 0.029s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:43:37 devstack sudo[103521]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:37 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-f931519f-1037-41aa-8c46-a6f08bf21aa7 tempest-VolumesTransfersV357Test-815564328 None] Created reservations ['3dff13bc-c2fa-459d-babb-d4e66451244d', '26a8fc96-f7a8-40c8-87e6-f09e0efbac0d', 'eb632cf7-5cca-485c-a205-380d8749c980', 'e0f4e746-ae96-4f23-b71c-ab4f649e685c'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:43:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f.2d32c552-f4cf-4072-8a15-ec4073789cfd 1G" returned: 0 in 0.745s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f.2d32c552-f4cf-4072-8a15-ec4073789cfd {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:37 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[2acaf7cb-2038-4a79-8e4f-95e1c18a4ad8]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:43:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-30de5a84-8a59-43cf-8728-7f99f7a14a53 tempest-VolumesDeleteCascade-645296602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:37 devstack sudo[103534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f.2d32c552-f4cf-4072-8a15-ec4073789cfd Aug 11 04:43:37 devstack sudo[103534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f931519f-1037-41aa-8c46-a6f08bf21aa7 tempest-VolumesTransfersV357Test-815564328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:43:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f931519f-1037-41aa-8c46-a6f08bf21aa7 tempest-VolumesTransfersV357Test-815564328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:43:38 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f931519f-1037-41aa-8c46-a6f08bf21aa7 tempest-VolumesTransfersV357Test-815564328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:43:38 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f931519f-1037-41aa-8c46-a6f08bf21aa7 tempest-VolumesTransfersV357Test-815564328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:43:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f931519f-1037-41aa-8c46-a6f08bf21aa7 tempest-VolumesTransfersV357Test-815564328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:43:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f931519f-1037-41aa-8c46-a6f08bf21aa7 tempest-VolumesTransfersV357Test-815564328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:38 devstack sudo[103536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6 Aug 11 04:43:38 devstack sudo[103536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:38 devstack sudo[103537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:43:38 devstack sudo[103537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:38 devstack sudo[103534]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f.2d32c552-f4cf-4072-8a15-ec4073789cfd" returned: 0 in 0.497s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:38 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f.2d32c552-f4cf-4072-8a15-ec4073789cfd is being set with open permissions: ugo+rw Aug 11 04:43:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f.2d32c552-f4cf-4072-8a15-ec4073789cfd {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:38 devstack sudo[103544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f.2d32c552-f4cf-4072-8a15-ec4073789cfd Aug 11 04:43:38 devstack sudo[103544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:38 devstack sudo[103537]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f931519f-1037-41aa-8c46-a6f08bf21aa7 tempest-VolumesTransfersV357Test-815564328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.376s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:38 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-f931519f-1037-41aa-8c46-a6f08bf21aa7 tempest-VolumesTransfersV357Test-815564328 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:43:38 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-f931519f-1037-41aa-8c46-a6f08bf21aa7 tempest-VolumesTransfersV357Test-815564328 None] Deleted volume successfully. Aug 11 04:43:38 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f931519f-1037-41aa-8c46-a6f08bf21aa7 tempest-VolumesTransfersV357Test-815564328 None] Lock "cinder-9e08dc92-cf10-4dd9-9bd9-3e460ee49ca8-delete_volume" released by "delete_volume" :: held 2.096s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:43:38 devstack sudo[103536]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-30de5a84-8a59-43cf-8728-7f99f7a14a53 tempest-VolumesDeleteCascade-645296602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6" returned: 0 in 0.694s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-30de5a84-8a59-43cf-8728-7f99f7a14a53 tempest-VolumesDeleteCascade-645296602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:38 devstack sudo[103549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6 Aug 11 04:43:38 devstack sudo[103549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:38 devstack sudo[103544]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f.2d32c552-f4cf-4072-8a15-ec4073789cfd" returned: 0 in 0.404s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:39 devstack sudo[103553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f.info Aug 11 04:43:39 devstack sudo[103553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:39 devstack sudo[103549]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-30de5a84-8a59-43cf-8728-7f99f7a14a53 tempest-VolumesDeleteCascade-645296602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6" returned: 0 in 0.551s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-30de5a84-8a59-43cf-8728-7f99f7a14a53 tempest-VolumesDeleteCascade-645296602 None] Lock "cinder-quobyte-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6" released by "delete_volume" :: held 1.351s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:43:39 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-30de5a84-8a59-43cf-8728-7f99f7a14a53 tempest-VolumesDeleteCascade-645296602 None] Created reservations ['b3e328f4-73c5-4081-b8eb-55e7caff1994', '72b09880-0576-477f-b5cf-fffceb86c0c5', '2ed531d1-da52-425c-bd05-aa652a8e5e9c', '4b0e10de-85ca-4d5e-8d7c-d26ac8948027'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:43:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-30de5a84-8a59-43cf-8728-7f99f7a14a53 tempest-VolumesDeleteCascade-645296602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:43:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-30de5a84-8a59-43cf-8728-7f99f7a14a53 tempest-VolumesDeleteCascade-645296602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:43:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-30de5a84-8a59-43cf-8728-7f99f7a14a53 tempest-VolumesDeleteCascade-645296602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:43:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-30de5a84-8a59-43cf-8728-7f99f7a14a53 tempest-VolumesDeleteCascade-645296602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:43:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-30de5a84-8a59-43cf-8728-7f99f7a14a53 tempest-VolumesDeleteCascade-645296602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:43:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-30de5a84-8a59-43cf-8728-7f99f7a14a53 tempest-VolumesDeleteCascade-645296602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:39 devstack sudo[103553]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f.info" returned: 0 in 0.570s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:39 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f.info is being set with open permissions: ugo+rw Aug 11 04:43:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:39 devstack sudo[103558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:43:39 devstack sudo[103558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:39 devstack sudo[103559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f.info Aug 11 04:43:39 devstack sudo[103559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:39 devstack sudo[103559]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f.info" returned: 0 in 0.419s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:39 devstack sudo[103558]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] Acquiring lock "cinder-quobyte-1224c9fd-1f96-422d-8a0d-2a5aabe853c2" by "_copy_volume_from_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:43:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-30de5a84-8a59-43cf-8728-7f99f7a14a53 tempest-VolumesDeleteCascade-645296602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.514s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:40 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-30de5a84-8a59-43cf-8728-7f99f7a14a53 tempest-VolumesDeleteCascade-645296602 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:43:40 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-30de5a84-8a59-43cf-8728-7f99f7a14a53 tempest-VolumesDeleteCascade-645296602 None] Deleted volume successfully. Aug 11 04:43:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] Lock "cinder-quobyte-1224c9fd-1f96-422d-8a0d-2a5aabe853c2" acquired by "_copy_volume_from_snapshot" :: waited 0.084s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:43:40 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] snapshot: 2d32c552-f4cf-4072-8a15-ec4073789cfd, volume: 1224c9fd-1f96-422d-8a0d-2a5aabe853c2, {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 11 04:43:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:43:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:43:40 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:43:40 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:43:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:43:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c9f5cf83-5a13-49fd-91f3-c1e70d4b514b tempest-VolumesDeleteCascade-645296602 None] Acquiring lock "cinder-e337794a-eca7-4183-8931-e51264966c53-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:43:40 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[a321213a-5157-4bea-8923-e97a3fd934a0]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:43:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f.2d32c552-f4cf-4072-8a15-ec4073789cfd {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c9f5cf83-5a13-49fd-91f3-c1e70d4b514b tempest-VolumesDeleteCascade-645296602 None] Lock "cinder-e337794a-eca7-4183-8931-e51264966c53-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:43:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-30de5a84-8a59-43cf-8728-7f99f7a14a53 tempest-VolumesDeleteCascade-645296602 None] Lock "cinder-cf50e816-c2e1-4fc8-8f9e-0e815765c2d6-delete_volume" released by "delete_volume" :: held 5.007s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:43:40 devstack sudo[103564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f.2d32c552-f4cf-4072-8a15-ec4073789cfd Aug 11 04:43:40 devstack sudo[103564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c9f5cf83-5a13-49fd-91f3-c1e70d4b514b tempest-VolumesDeleteCascade-645296602 None] Acquiring lock "cinder-quobyte-e337794a-eca7-4183-8931-e51264966c53" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:43:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c9f5cf83-5a13-49fd-91f3-c1e70d4b514b tempest-VolumesDeleteCascade-645296602 None] Lock "cinder-quobyte-e337794a-eca7-4183-8931-e51264966c53" acquired by "delete_volume" :: waited 0.036s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:43:40 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac41b49-9ce0-4f30-acda-fbe3f7611146]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:43:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c9f5cf83-5a13-49fd-91f3-c1e70d4b514b tempest-VolumesDeleteCascade-645296602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e337794a-eca7-4183-8931-e51264966c53 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:40 devstack sudo[103566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e337794a-eca7-4183-8931-e51264966c53 Aug 11 04:43:40 devstack sudo[103566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:40 devstack sudo[103564]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f.2d32c552-f4cf-4072-8a15-ec4073789cfd" returned: 0 in 0.633s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:40 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:43:40 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[e318b4b5-d2a3-4dfd-8384-61fb647267d0]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:43:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:41 devstack sudo[103571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f Aug 11 04:43:41 devstack sudo[103571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:41 devstack sudo[103566]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c9f5cf83-5a13-49fd-91f3-c1e70d4b514b tempest-VolumesDeleteCascade-645296602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e337794a-eca7-4183-8931-e51264966c53" returned: 0 in 0.771s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c9f5cf83-5a13-49fd-91f3-c1e70d4b514b tempest-VolumesDeleteCascade-645296602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e337794a-eca7-4183-8931-e51264966c53 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:41 devstack sudo[103576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e337794a-eca7-4183-8931-e51264966c53 Aug 11 04:43:41 devstack sudo[103576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:41 devstack sudo[103571]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f" returned: 0 in 0.672s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] will copy from snapshot at /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 11 04:43:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] Creating direct copy from snapshot {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 11 04:43:41 devstack cinder-volume[94472]: DEBUG cinder.utils [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] Path /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1224c9fd-1f96-422d-8a0d-2a5aabe853c2 not found in is_blk_device check {{(pid=94472) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 11 04:43:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1224c9fd-1f96-422d-8a0d-2a5aabe853c2 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:41 devstack sudo[103581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1224c9fd-1f96-422d-8a0d-2a5aabe853c2 Aug 11 04:43:41 devstack sudo[103581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:41 devstack sudo[103576]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c9f5cf83-5a13-49fd-91f3-c1e70d4b514b tempest-VolumesDeleteCascade-645296602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e337794a-eca7-4183-8931-e51264966c53" returned: 0 in 0.542s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:41 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c9f5cf83-5a13-49fd-91f3-c1e70d4b514b tempest-VolumesDeleteCascade-645296602 None] Lock "cinder-quobyte-e337794a-eca7-4183-8931-e51264966c53" released by "delete_volume" :: held 1.404s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:43:41 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-c9f5cf83-5a13-49fd-91f3-c1e70d4b514b tempest-VolumesDeleteCascade-645296602 None] Created reservations ['1b72ef63-b3ae-42aa-8b27-c9f87a9965ec', '2edc8207-145d-48ca-9114-cd34e5943e66', 'b852b282-44e2-4953-b63f-439df6ac90e1', '37408cbb-167e-4b5e-8d70-04de1689cc7c'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:43:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c9f5cf83-5a13-49fd-91f3-c1e70d4b514b tempest-VolumesDeleteCascade-645296602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:43:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c9f5cf83-5a13-49fd-91f3-c1e70d4b514b tempest-VolumesDeleteCascade-645296602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:43:42 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c9f5cf83-5a13-49fd-91f3-c1e70d4b514b tempest-VolumesDeleteCascade-645296602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:43:42 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c9f5cf83-5a13-49fd-91f3-c1e70d4b514b tempest-VolumesDeleteCascade-645296602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:43:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c9f5cf83-5a13-49fd-91f3-c1e70d4b514b tempest-VolumesDeleteCascade-645296602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:43:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c9f5cf83-5a13-49fd-91f3-c1e70d4b514b tempest-VolumesDeleteCascade-645296602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:42 devstack sudo[103587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:43:42 devstack sudo[103587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:42 devstack sudo[103587]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c9f5cf83-5a13-49fd-91f3-c1e70d4b514b tempest-VolumesDeleteCascade-645296602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.751s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:42 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-c9f5cf83-5a13-49fd-91f3-c1e70d4b514b tempest-VolumesDeleteCascade-645296602 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:43:42 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-c9f5cf83-5a13-49fd-91f3-c1e70d4b514b tempest-VolumesDeleteCascade-645296602 None] Deleted volume successfully. Aug 11 04:43:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c9f5cf83-5a13-49fd-91f3-c1e70d4b514b tempest-VolumesDeleteCascade-645296602 None] Lock "cinder-e337794a-eca7-4183-8931-e51264966c53-delete_volume" released by "delete_volume" :: held 2.823s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:43:49 devstack sudo[103581]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1224c9fd-1f96-422d-8a0d-2a5aabe853c2" returned: 0 in 7.856s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:49 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] Image conversion details: src /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f, size 1024.00 MB, duration 7.86 sec, destination /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1224c9fd-1f96-422d-8a0d-2a5aabe853c2 {{(pid=94472) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 11 04:43:49 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] Converted 1024.00 MB image at 130.32 MB/s Aug 11 04:43:49 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1224c9fd-1f96-422d-8a0d-2a5aabe853c2 is being set with open permissions: ugo+rw Aug 11 04:43:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1224c9fd-1f96-422d-8a0d-2a5aabe853c2 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:49 devstack sudo[103609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1224c9fd-1f96-422d-8a0d-2a5aabe853c2 Aug 11 04:43:49 devstack sudo[103609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:49 devstack sudo[103609]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1224c9fd-1f96-422d-8a0d-2a5aabe853c2" returned: 0 in 0.384s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:49 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] Lock "cinder-quobyte-1224c9fd-1f96-422d-8a0d-2a5aabe853c2" released by "_copy_volume_from_snapshot" :: held 9.746s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:43:49 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] Acquiring lock "cinder-quobyte-2d32c552-f4cf-4072-8a15-ec4073789cfd" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:43:49 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] Lock "cinder-quobyte-2d32c552-f4cf-4072-8a15-ec4073789cfd" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:43:49 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] Deleting offline snapshot 2d32c552-f4cf-4072-8a15-ec4073789cfd of volume d9996e5b-3c6d-4092-b4ed-aaa421a04f4f {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 04:43:49 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] snapshot_file for this snap is: volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f.2d32c552-f4cf-4072-8a15-ec4073789cfd {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 04:43:49 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abd7aca-12c5-4a0a-9778-4e3fab250909]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:43:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f.2d32c552-f4cf-4072-8a15-ec4073789cfd {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:50 devstack sudo[103616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f.2d32c552-f4cf-4072-8a15-ec4073789cfd Aug 11 04:43:50 devstack sudo[103616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:50 devstack sudo[103616]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f.2d32c552-f4cf-4072-8a15-ec4073789cfd" returned: 0 in 0.531s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:50 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:43:50 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[093b0d8a-19f1-4ffb-b767-bd281fb97c58]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:43:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:50 devstack sudo[103621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f Aug 11 04:43:50 devstack sudo[103621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:51 devstack sudo[103621]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f" returned: 0 in 0.604s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f.2d32c552-f4cf-4072-8a15-ec4073789cfd {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:51 devstack sudo[103627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f.2d32c552-f4cf-4072-8a15-ec4073789cfd Aug 11 04:43:51 devstack sudo[103627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:51 devstack sudo[103627]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f.2d32c552-f4cf-4072-8a15-ec4073789cfd" returned: 0 in 0.462s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f.2d32c552-f4cf-4072-8a15-ec4073789cfd {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:51 devstack sudo[103633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f.2d32c552-f4cf-4072-8a15-ec4073789cfd Aug 11 04:43:51 devstack sudo[103633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:51 devstack sudo[103633]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f.2d32c552-f4cf-4072-8a15-ec4073789cfd" returned: 0 in 0.297s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:51 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] Lock "cinder-quobyte-2d32c552-f4cf-4072-8a15-ec4073789cfd" released by "_delete_snapshot" :: held 2.009s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:43:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.255s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:43:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c469cca-8e7b-48d6-85d2-a47ebdb21483) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1224c9fd-1f96-422d-8a0d-2a5aabe853c2', 'volume_size': 1, 'source_volid': 'd9996e5b-3c6d-4092-b4ed-aaa421a04f4f', 'source_volstatus': 'available'}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (334c50df-188a-4904-be73-3288b84f2450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:51 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] Volume volume-1224c9fd-1f96-422d-8a0d-2a5aabe853c2 (1224c9fd-1f96-422d-8a0d-2a5aabe853c2): created successfully Aug 11 04:43:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (334c50df-188a-4904-be73-3288b84f2450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] Flow 'volume_create_manager' (a09e09dc-a25e-4cea-8969-8d7d164c2681) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:43:51 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-754e28c5-4b5e-46cf-9081-140a00bb204d tempest-VolumesGetTest-667192801 None] Created volume successfully. Aug 11 04:43:52 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a029c5d-929f-4993-9ea8-a2ed434e6d54 tempest-VolumesListTestJSON-556543254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:43:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8a029c5d-929f-4993-9ea8-a2ed434e6d54 tempest-VolumesListTestJSON-556543254 None] Flow 'volume_create_manager' (4f782bf8-eeb0-44ec-9c8c-0eb5923f7efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:43:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8a029c5d-929f-4993-9ea8-a2ed434e6d54 tempest-VolumesListTestJSON-556543254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daa4ecfa-97ed-4a74-a701-c34ed39dd968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8a029c5d-929f-4993-9ea8-a2ed434e6d54 tempest-VolumesListTestJSON-556543254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daa4ecfa-97ed-4a74-a701-c34ed39dd968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2035255279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3df951b-0b3d-4e28-b8e6-a6e5cfa7d9b5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8f7182f23b3b4eb5966fb33170ef22d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:43:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:43:53Z,use_quota=True,user_id='f55c7f95a0db47738e275cd3a645a0ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8a029c5d-929f-4993-9ea8-a2ed434e6d54 tempest-VolumesListTestJSON-556543254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bc022a5-95c0-458c-ae75-41475ddb5586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8a029c5d-929f-4993-9ea8-a2ed434e6d54 tempest-VolumesListTestJSON-556543254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bc022a5-95c0-458c-ae75-41475ddb5586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8a029c5d-929f-4993-9ea8-a2ed434e6d54 tempest-VolumesListTestJSON-556543254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b62dac5a-0f6c-4729-811e-d7dfb510e5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8a029c5d-929f-4993-9ea8-a2ed434e6d54 tempest-VolumesListTestJSON-556543254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b62dac5a-0f6c-4729-811e-d7dfb510e5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3df951b-0b3d-4e28-b8e6-a6e5cfa7d9b5', 'volume_name': 'volume-d3df951b-0b3d-4e28-b8e6-a6e5cfa7d9b5', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8a029c5d-929f-4993-9ea8-a2ed434e6d54 tempest-VolumesListTestJSON-556543254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e819ef04-81b3-4f0f-a619-737a378d8fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8a029c5d-929f-4993-9ea8-a2ed434e6d54 tempest-VolumesListTestJSON-556543254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e819ef04-81b3-4f0f-a619-737a378d8fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8a029c5d-929f-4993-9ea8-a2ed434e6d54 tempest-VolumesListTestJSON-556543254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c8aa345-cffc-49f0-a256-26e0669f0424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:52 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-8a029c5d-929f-4993-9ea8-a2ed434e6d54 tempest-VolumesListTestJSON-556543254 None] Volume d3df951b-0b3d-4e28-b8e6-a6e5cfa7d9b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3df951b-0b3d-4e28-b8e6-a6e5cfa7d9b5', 'volume_size': 1} Aug 11 04:43:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8a029c5d-929f-4993-9ea8-a2ed434e6d54 tempest-VolumesListTestJSON-556543254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:43:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8a029c5d-929f-4993-9ea8-a2ed434e6d54 tempest-VolumesListTestJSON-556543254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:43:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-8a029c5d-929f-4993-9ea8-a2ed434e6d54 tempest-VolumesListTestJSON-556543254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2035255279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3df951b-0b3d-4e28-b8e6-a6e5cfa7d9b5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8f7182f23b3b4eb5966fb33170ef22d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:43:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:43:53Z,use_quota=True,user_id='f55c7f95a0db47738e275cd3a645a0ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:43:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-8a029c5d-929f-4993-9ea8-a2ed434e6d54 tempest-VolumesListTestJSON-556543254 None] Creating volume d3df951b-0b3d-4e28-b8e6-a6e5cfa7d9b5 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:43:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8a029c5d-929f-4993-9ea8-a2ed434e6d54 tempest-VolumesListTestJSON-556543254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:43:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8a029c5d-929f-4993-9ea8-a2ed434e6d54 tempest-VolumesListTestJSON-556543254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:43:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-8a029c5d-929f-4993-9ea8-a2ed434e6d54 tempest-VolumesListTestJSON-556543254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:43:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-8a029c5d-929f-4993-9ea8-a2ed434e6d54 tempest-VolumesListTestJSON-556543254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:43:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8a029c5d-929f-4993-9ea8-a2ed434e6d54 tempest-VolumesListTestJSON-556543254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:43:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-8a029c5d-929f-4993-9ea8-a2ed434e6d54 tempest-VolumesListTestJSON-556543254 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:43:52 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-8a029c5d-929f-4993-9ea8-a2ed434e6d54 tempest-VolumesListTestJSON-556543254 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:43:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8a029c5d-929f-4993-9ea8-a2ed434e6d54 tempest-VolumesListTestJSON-556543254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d3df951b-0b3d-4e28-b8e6-a6e5cfa7d9b5 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:53 devstack sudo[103637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d3df951b-0b3d-4e28-b8e6-a6e5cfa7d9b5 1073741824 Aug 11 04:43:53 devstack sudo[103637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:53 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f6f1cf7-1e38-4e86-acf0-45b8f022c778 tempest-VolumesTransfersTest-1185021633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:43:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2f6f1cf7-1e38-4e86-acf0-45b8f022c778 tempest-VolumesTransfersTest-1185021633 None] Flow 'volume_create_manager' (d10300e2-5447-4f9b-b02c-17e1450bf079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:43:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2f6f1cf7-1e38-4e86-acf0-45b8f022c778 tempest-VolumesTransfersTest-1185021633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d4e3822-67b1-445e-a8d2-6ca9db4cc5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2f6f1cf7-1e38-4e86-acf0-45b8f022c778 tempest-VolumesTransfersTest-1185021633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d4e3822-67b1-445e-a8d2-6ca9db4cc5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:43:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-283384569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fada6e55-1814-4646-8dbf-b5e01edadd8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3c7e4541293431a914dc1f32cf4a036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:43:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:43:53Z,use_quota=True,user_id='46b2f1305f4a462ab4e4c64b9f4a8aa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2f6f1cf7-1e38-4e86-acf0-45b8f022c778 tempest-VolumesTransfersTest-1185021633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d3866c2-0501-4639-8ee6-b16e1660c629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2f6f1cf7-1e38-4e86-acf0-45b8f022c778 tempest-VolumesTransfersTest-1185021633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d3866c2-0501-4639-8ee6-b16e1660c629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2f6f1cf7-1e38-4e86-acf0-45b8f022c778 tempest-VolumesTransfersTest-1185021633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c827d2b0-1a1c-4562-99b9-d031146ecd8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2f6f1cf7-1e38-4e86-acf0-45b8f022c778 tempest-VolumesTransfersTest-1185021633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c827d2b0-1a1c-4562-99b9-d031146ecd8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fada6e55-1814-4646-8dbf-b5e01edadd8d', 'volume_name': 'volume-fada6e55-1814-4646-8dbf-b5e01edadd8d', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2f6f1cf7-1e38-4e86-acf0-45b8f022c778 tempest-VolumesTransfersTest-1185021633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8afb4897-8ea3-4e2f-af1f-5201f79ac299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2f6f1cf7-1e38-4e86-acf0-45b8f022c778 tempest-VolumesTransfersTest-1185021633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8afb4897-8ea3-4e2f-af1f-5201f79ac299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2f6f1cf7-1e38-4e86-acf0-45b8f022c778 tempest-VolumesTransfersTest-1185021633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71d599fd-cc68-4cd5-8de1-2b1e2a525e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:53 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-2f6f1cf7-1e38-4e86-acf0-45b8f022c778 tempest-VolumesTransfersTest-1185021633 None] Volume fada6e55-1814-4646-8dbf-b5e01edadd8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fada6e55-1814-4646-8dbf-b5e01edadd8d', 'volume_size': 1} Aug 11 04:43:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2f6f1cf7-1e38-4e86-acf0-45b8f022c778 tempest-VolumesTransfersTest-1185021633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:43:53 devstack sudo[103637]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8a029c5d-929f-4993-9ea8-a2ed434e6d54 tempest-VolumesListTestJSON-556543254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d3df951b-0b3d-4e28-b8e6-a6e5cfa7d9b5 1073741824" returned: 0 in 0.537s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8a029c5d-929f-4993-9ea8-a2ed434e6d54 tempest-VolumesListTestJSON-556543254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d3df951b-0b3d-4e28-b8e6-a6e5cfa7d9b5 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:53 devstack sudo[103643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d3df951b-0b3d-4e28-b8e6-a6e5cfa7d9b5 Aug 11 04:43:53 devstack sudo[103643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:53 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-2388a06e-bfb3-4a88-918f-629bd85f0f13 tempest-VolumesGetTest-667192801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:43:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2388a06e-bfb3-4a88-918f-629bd85f0f13 tempest-VolumesGetTest-667192801 None] Flow 'volume_create_manager' (319cf0d3-5ef3-4134-a821-783136cf6f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:43:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2388a06e-bfb3-4a88-918f-629bd85f0f13 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1812fa4-5da5-4eba-a7ef-32e20355108c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2388a06e-bfb3-4a88-918f-629bd85f0f13 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1812fa4-5da5-4eba-a7ef-32e20355108c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:43:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-867656465',display_name='tempest-VolumesGetTest-Volume-1091439658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b30a9d3-e136-4b6b-a5d7-990968de420a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4be18a68d5524857b2b7b1bf2e849c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:43:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:43:54Z,use_quota=True,user_id='885fd20bf9004603a4c318af0014813d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2388a06e-bfb3-4a88-918f-629bd85f0f13 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22d9b13f-bb24-44cf-8f74-bb684d8bd335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2388a06e-bfb3-4a88-918f-629bd85f0f13 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22d9b13f-bb24-44cf-8f74-bb684d8bd335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:53 devstack sudo[103643]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2388a06e-bfb3-4a88-918f-629bd85f0f13 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8852585-deec-4fe6-a1bb-f893066d2cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2388a06e-bfb3-4a88-918f-629bd85f0f13 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8852585-deec-4fe6-a1bb-f893066d2cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b30a9d3-e136-4b6b-a5d7-990968de420a', 'volume_name': 'volume-2b30a9d3-e136-4b6b-a5d7-990968de420a', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2388a06e-bfb3-4a88-918f-629bd85f0f13 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4110b306-4ad2-47fb-8cd5-b2506f6f8662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2388a06e-bfb3-4a88-918f-629bd85f0f13 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4110b306-4ad2-47fb-8cd5-b2506f6f8662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2388a06e-bfb3-4a88-918f-629bd85f0f13 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9efbc7d7-1b74-4f24-8341-b3a546454d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:53 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-2388a06e-bfb3-4a88-918f-629bd85f0f13 tempest-VolumesGetTest-667192801 None] Volume 2b30a9d3-e136-4b6b-a5d7-990968de420a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b30a9d3-e136-4b6b-a5d7-990968de420a', 'volume_size': 1} Aug 11 04:43:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2388a06e-bfb3-4a88-918f-629bd85f0f13 tempest-VolumesGetTest-667192801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:43:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8a029c5d-929f-4993-9ea8-a2ed434e6d54 tempest-VolumesListTestJSON-556543254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d3df951b-0b3d-4e28-b8e6-a6e5cfa7d9b5" returned: 0 in 0.319s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:53 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-8a029c5d-929f-4993-9ea8-a2ed434e6d54 tempest-VolumesListTestJSON-556543254 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:43:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8a029c5d-929f-4993-9ea8-a2ed434e6d54 tempest-VolumesListTestJSON-556543254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:43:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2f6f1cf7-1e38-4e86-acf0-45b8f022c778 tempest-VolumesTransfersTest-1185021633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.563s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:43:53 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2f6f1cf7-1e38-4e86-acf0-45b8f022c778 tempest-VolumesTransfersTest-1185021633 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:43:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-283384569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fada6e55-1814-4646-8dbf-b5e01edadd8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3c7e4541293431a914dc1f32cf4a036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:43:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:43:53Z,use_quota=True,user_id='46b2f1305f4a462ab4e4c64b9f4a8aa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:43:53 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-2f6f1cf7-1e38-4e86-acf0-45b8f022c778 tempest-VolumesTransfersTest-1185021633 None] Creating volume fada6e55-1814-4646-8dbf-b5e01edadd8d {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:43:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2f6f1cf7-1e38-4e86-acf0-45b8f022c778 tempest-VolumesTransfersTest-1185021633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:43:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2f6f1cf7-1e38-4e86-acf0-45b8f022c778 tempest-VolumesTransfersTest-1185021633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:43:53 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2f6f1cf7-1e38-4e86-acf0-45b8f022c778 tempest-VolumesTransfersTest-1185021633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:43:53 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2f6f1cf7-1e38-4e86-acf0-45b8f022c778 tempest-VolumesTransfersTest-1185021633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:43:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2f6f1cf7-1e38-4e86-acf0-45b8f022c778 tempest-VolumesTransfersTest-1185021633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:43:53 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2f6f1cf7-1e38-4e86-acf0-45b8f022c778 tempest-VolumesTransfersTest-1185021633 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:43:53 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-2f6f1cf7-1e38-4e86-acf0-45b8f022c778 tempest-VolumesTransfersTest-1185021633 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:43:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2f6f1cf7-1e38-4e86-acf0-45b8f022c778 tempest-VolumesTransfersTest-1185021633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-fada6e55-1814-4646-8dbf-b5e01edadd8d 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8a029c5d-929f-4993-9ea8-a2ed434e6d54 tempest-VolumesListTestJSON-556543254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c8aa345-cffc-49f0-a256-26e0669f0424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3df951b-0b3d-4e28-b8e6-a6e5cfa7d9b5', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8a029c5d-929f-4993-9ea8-a2ed434e6d54 tempest-VolumesListTestJSON-556543254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76c60d31-279c-475c-9987-8a6ddb317d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:53 devstack sudo[103646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-fada6e55-1814-4646-8dbf-b5e01edadd8d 1073741824 Aug 11 04:43:53 devstack sudo[103646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:53 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-8a029c5d-929f-4993-9ea8-a2ed434e6d54 tempest-VolumesListTestJSON-556543254 None] Volume volume-d3df951b-0b3d-4e28-b8e6-a6e5cfa7d9b5 (d3df951b-0b3d-4e28-b8e6-a6e5cfa7d9b5): created successfully Aug 11 04:43:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8a029c5d-929f-4993-9ea8-a2ed434e6d54 tempest-VolumesListTestJSON-556543254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76c60d31-279c-475c-9987-8a6ddb317d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8a029c5d-929f-4993-9ea8-a2ed434e6d54 tempest-VolumesListTestJSON-556543254 None] Flow 'volume_create_manager' (4f782bf8-eeb0-44ec-9c8c-0eb5923f7efc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:43:53 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-8a029c5d-929f-4993-9ea8-a2ed434e6d54 tempest-VolumesListTestJSON-556543254 None] Created volume successfully. Aug 11 04:43:54 devstack sudo[103646]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2f6f1cf7-1e38-4e86-acf0-45b8f022c778 tempest-VolumesTransfersTest-1185021633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-fada6e55-1814-4646-8dbf-b5e01edadd8d 1073741824" returned: 0 in 0.425s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2f6f1cf7-1e38-4e86-acf0-45b8f022c778 tempest-VolumesTransfersTest-1185021633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-fada6e55-1814-4646-8dbf-b5e01edadd8d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:54 devstack sudo[103652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-fada6e55-1814-4646-8dbf-b5e01edadd8d Aug 11 04:43:54 devstack sudo[103652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:54 devstack sudo[103652]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2f6f1cf7-1e38-4e86-acf0-45b8f022c778 tempest-VolumesTransfersTest-1185021633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-fada6e55-1814-4646-8dbf-b5e01edadd8d" returned: 0 in 0.249s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:54 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2f6f1cf7-1e38-4e86-acf0-45b8f022c778 tempest-VolumesTransfersTest-1185021633 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:43:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2f6f1cf7-1e38-4e86-acf0-45b8f022c778 tempest-VolumesTransfersTest-1185021633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:43:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2388a06e-bfb3-4a88-918f-629bd85f0f13 tempest-VolumesGetTest-667192801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.742s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:43:54 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2388a06e-bfb3-4a88-918f-629bd85f0f13 tempest-VolumesGetTest-667192801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:43:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-867656465',display_name='tempest-VolumesGetTest-Volume-1091439658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b30a9d3-e136-4b6b-a5d7-990968de420a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4be18a68d5524857b2b7b1bf2e849c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:43:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:43:54Z,use_quota=True,user_id='885fd20bf9004603a4c318af0014813d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:43:54 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-2388a06e-bfb3-4a88-918f-629bd85f0f13 tempest-VolumesGetTest-667192801 None] Creating volume 2b30a9d3-e136-4b6b-a5d7-990968de420a {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:43:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2388a06e-bfb3-4a88-918f-629bd85f0f13 tempest-VolumesGetTest-667192801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:43:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2388a06e-bfb3-4a88-918f-629bd85f0f13 tempest-VolumesGetTest-667192801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:43:54 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2388a06e-bfb3-4a88-918f-629bd85f0f13 tempest-VolumesGetTest-667192801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:43:54 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2388a06e-bfb3-4a88-918f-629bd85f0f13 tempest-VolumesGetTest-667192801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:43:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2388a06e-bfb3-4a88-918f-629bd85f0f13 tempest-VolumesGetTest-667192801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:43:54 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2388a06e-bfb3-4a88-918f-629bd85f0f13 tempest-VolumesGetTest-667192801 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:43:54 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-2388a06e-bfb3-4a88-918f-629bd85f0f13 tempest-VolumesGetTest-667192801 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:43:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2388a06e-bfb3-4a88-918f-629bd85f0f13 tempest-VolumesGetTest-667192801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2b30a9d3-e136-4b6b-a5d7-990968de420a 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:54 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2f6f1cf7-1e38-4e86-acf0-45b8f022c778 tempest-VolumesTransfersTest-1185021633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71d599fd-cc68-4cd5-8de1-2b1e2a525e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fada6e55-1814-4646-8dbf-b5e01edadd8d', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:54 devstack sudo[103679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2b30a9d3-e136-4b6b-a5d7-990968de420a 1073741824 Aug 11 04:43:54 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2f6f1cf7-1e38-4e86-acf0-45b8f022c778 tempest-VolumesTransfersTest-1185021633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (857e7d95-23db-49ab-b6dd-9679cebece55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:54 devstack sudo[103679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:54 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-2f6f1cf7-1e38-4e86-acf0-45b8f022c778 tempest-VolumesTransfersTest-1185021633 None] Volume volume-fada6e55-1814-4646-8dbf-b5e01edadd8d (fada6e55-1814-4646-8dbf-b5e01edadd8d): created successfully Aug 11 04:43:54 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2f6f1cf7-1e38-4e86-acf0-45b8f022c778 tempest-VolumesTransfersTest-1185021633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (857e7d95-23db-49ab-b6dd-9679cebece55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:54 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2f6f1cf7-1e38-4e86-acf0-45b8f022c778 tempest-VolumesTransfersTest-1185021633 None] Flow 'volume_create_manager' (d10300e2-5447-4f9b-b02c-17e1450bf079) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:43:54 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-2f6f1cf7-1e38-4e86-acf0-45b8f022c778 tempest-VolumesTransfersTest-1185021633 None] Created volume successfully. Aug 11 04:43:55 devstack sudo[103679]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2388a06e-bfb3-4a88-918f-629bd85f0f13 tempest-VolumesGetTest-667192801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2b30a9d3-e136-4b6b-a5d7-990968de420a 1073741824" returned: 0 in 0.578s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2388a06e-bfb3-4a88-918f-629bd85f0f13 tempest-VolumesGetTest-667192801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2b30a9d3-e136-4b6b-a5d7-990968de420a {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:55 devstack sudo[103685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2b30a9d3-e136-4b6b-a5d7-990968de420a Aug 11 04:43:55 devstack sudo[103685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:55 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e13098d-3579-4f47-a422-321b6ece9177 tempest-VolumesListTestJSON-556543254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:43:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2e13098d-3579-4f47-a422-321b6ece9177 tempest-VolumesListTestJSON-556543254 None] Flow 'volume_create_manager' (fdb50d37-54c8-4338-a42b-a0cd1a4422f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:43:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2e13098d-3579-4f47-a422-321b6ece9177 tempest-VolumesListTestJSON-556543254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70880089-36bd-4d12-a86b-e8820cc6dae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2e13098d-3579-4f47-a422-321b6ece9177 tempest-VolumesListTestJSON-556543254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70880089-36bd-4d12-a86b-e8820cc6dae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:43:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-952254911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d8b09b9-235a-4c4a-a6e7-1e69a6367b15,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8f7182f23b3b4eb5966fb33170ef22d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:43:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:43:56Z,use_quota=True,user_id='f55c7f95a0db47738e275cd3a645a0ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2e13098d-3579-4f47-a422-321b6ece9177 tempest-VolumesListTestJSON-556543254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2aed421-cfcc-4b9b-b39b-d9b36200924f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:55 devstack sudo[103685]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2e13098d-3579-4f47-a422-321b6ece9177 tempest-VolumesListTestJSON-556543254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2aed421-cfcc-4b9b-b39b-d9b36200924f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2e13098d-3579-4f47-a422-321b6ece9177 tempest-VolumesListTestJSON-556543254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf3921bb-82a7-4512-8a62-cb29668eb194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2e13098d-3579-4f47-a422-321b6ece9177 tempest-VolumesListTestJSON-556543254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf3921bb-82a7-4512-8a62-cb29668eb194) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d8b09b9-235a-4c4a-a6e7-1e69a6367b15', 'volume_name': 'volume-3d8b09b9-235a-4c4a-a6e7-1e69a6367b15', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2e13098d-3579-4f47-a422-321b6ece9177 tempest-VolumesListTestJSON-556543254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d59f0021-2a4e-4ba1-a5fc-542c28e53ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2e13098d-3579-4f47-a422-321b6ece9177 tempest-VolumesListTestJSON-556543254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d59f0021-2a4e-4ba1-a5fc-542c28e53ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2e13098d-3579-4f47-a422-321b6ece9177 tempest-VolumesListTestJSON-556543254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83d38492-463c-43e0-bb8d-7e8bfd8b36ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:55 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-2e13098d-3579-4f47-a422-321b6ece9177 tempest-VolumesListTestJSON-556543254 None] Volume 3d8b09b9-235a-4c4a-a6e7-1e69a6367b15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d8b09b9-235a-4c4a-a6e7-1e69a6367b15', 'volume_size': 1} Aug 11 04:43:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2e13098d-3579-4f47-a422-321b6ece9177 tempest-VolumesListTestJSON-556543254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:43:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2388a06e-bfb3-4a88-918f-629bd85f0f13 tempest-VolumesGetTest-667192801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2b30a9d3-e136-4b6b-a5d7-990968de420a" returned: 0 in 0.434s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:55 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2388a06e-bfb3-4a88-918f-629bd85f0f13 tempest-VolumesGetTest-667192801 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:43:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2388a06e-bfb3-4a88-918f-629bd85f0f13 tempest-VolumesGetTest-667192801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:43:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2e13098d-3579-4f47-a422-321b6ece9177 tempest-VolumesListTestJSON-556543254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:43:55 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2e13098d-3579-4f47-a422-321b6ece9177 tempest-VolumesListTestJSON-556543254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:43:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-952254911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d8b09b9-235a-4c4a-a6e7-1e69a6367b15,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8f7182f23b3b4eb5966fb33170ef22d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:43:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:43:56Z,use_quota=True,user_id='f55c7f95a0db47738e275cd3a645a0ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:43:55 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-2e13098d-3579-4f47-a422-321b6ece9177 tempest-VolumesListTestJSON-556543254 None] Creating volume 3d8b09b9-235a-4c4a-a6e7-1e69a6367b15 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:43:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2e13098d-3579-4f47-a422-321b6ece9177 tempest-VolumesListTestJSON-556543254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:43:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2e13098d-3579-4f47-a422-321b6ece9177 tempest-VolumesListTestJSON-556543254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:43:55 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2e13098d-3579-4f47-a422-321b6ece9177 tempest-VolumesListTestJSON-556543254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:43:55 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2e13098d-3579-4f47-a422-321b6ece9177 tempest-VolumesListTestJSON-556543254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:43:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2e13098d-3579-4f47-a422-321b6ece9177 tempest-VolumesListTestJSON-556543254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:43:55 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2e13098d-3579-4f47-a422-321b6ece9177 tempest-VolumesListTestJSON-556543254 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:43:55 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-2e13098d-3579-4f47-a422-321b6ece9177 tempest-VolumesListTestJSON-556543254 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:43:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2e13098d-3579-4f47-a422-321b6ece9177 tempest-VolumesListTestJSON-556543254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d8b09b9-235a-4c4a-a6e7-1e69a6367b15 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2388a06e-bfb3-4a88-918f-629bd85f0f13 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9efbc7d7-1b74-4f24-8341-b3a546454d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b30a9d3-e136-4b6b-a5d7-990968de420a', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:55 devstack sudo[103689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d8b09b9-235a-4c4a-a6e7-1e69a6367b15 1073741824 Aug 11 04:43:55 devstack sudo[103689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2388a06e-bfb3-4a88-918f-629bd85f0f13 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4024ee2-7e67-4cd8-8fc3-4d6b6a213f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:55 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-2388a06e-bfb3-4a88-918f-629bd85f0f13 tempest-VolumesGetTest-667192801 None] Volume volume-2b30a9d3-e136-4b6b-a5d7-990968de420a (2b30a9d3-e136-4b6b-a5d7-990968de420a): created successfully Aug 11 04:43:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2388a06e-bfb3-4a88-918f-629bd85f0f13 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4024ee2-7e67-4cd8-8fc3-4d6b6a213f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2388a06e-bfb3-4a88-918f-629bd85f0f13 tempest-VolumesGetTest-667192801 None] Flow 'volume_create_manager' (319cf0d3-5ef3-4134-a821-783136cf6f6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:43:55 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-2388a06e-bfb3-4a88-918f-629bd85f0f13 tempest-VolumesGetTest-667192801 None] Created volume successfully. Aug 11 04:43:56 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-5e281990-0304-4d58-ac85-c5d6301fc41b tempest-VolumesTransfersTest-1248807191 None] Transfer volume completed successfully. Aug 11 04:43:56 devstack sudo[103689]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2e13098d-3579-4f47-a422-321b6ece9177 tempest-VolumesListTestJSON-556543254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d8b09b9-235a-4c4a-a6e7-1e69a6367b15 1073741824" returned: 0 in 0.593s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2e13098d-3579-4f47-a422-321b6ece9177 tempest-VolumesListTestJSON-556543254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d8b09b9-235a-4c4a-a6e7-1e69a6367b15 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:56 devstack sudo[103700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d8b09b9-235a-4c4a-a6e7-1e69a6367b15 Aug 11 04:43:56 devstack sudo[103700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:56 devstack sudo[103700]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2e13098d-3579-4f47-a422-321b6ece9177 tempest-VolumesListTestJSON-556543254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d8b09b9-235a-4c4a-a6e7-1e69a6367b15" returned: 0 in 0.271s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2e13098d-3579-4f47-a422-321b6ece9177 tempest-VolumesListTestJSON-556543254 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:43:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2e13098d-3579-4f47-a422-321b6ece9177 tempest-VolumesListTestJSON-556543254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:43:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2e13098d-3579-4f47-a422-321b6ece9177 tempest-VolumesListTestJSON-556543254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83d38492-463c-43e0-bb8d-7e8bfd8b36ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d8b09b9-235a-4c4a-a6e7-1e69a6367b15', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2e13098d-3579-4f47-a422-321b6ece9177 tempest-VolumesListTestJSON-556543254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (553868c8-938f-4a2c-9b42-dd1f36c64b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:56 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-2e13098d-3579-4f47-a422-321b6ece9177 tempest-VolumesListTestJSON-556543254 None] Volume volume-3d8b09b9-235a-4c4a-a6e7-1e69a6367b15 (3d8b09b9-235a-4c4a-a6e7-1e69a6367b15): created successfully Aug 11 04:43:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2e13098d-3579-4f47-a422-321b6ece9177 tempest-VolumesListTestJSON-556543254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (553868c8-938f-4a2c-9b42-dd1f36c64b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2e13098d-3579-4f47-a422-321b6ece9177 tempest-VolumesListTestJSON-556543254 None] Flow 'volume_create_manager' (fdb50d37-54c8-4338-a42b-a0cd1a4422f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:43:56 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c16690eb-dc4c-49f6-bfcc-27612bfaa1c7 tempest-VolumesTransfersTest-2091503109 None] Acquiring lock "cinder-fada6e55-1814-4646-8dbf-b5e01edadd8d-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:43:56 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-2e13098d-3579-4f47-a422-321b6ece9177 tempest-VolumesListTestJSON-556543254 None] Created volume successfully. Aug 11 04:43:56 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c16690eb-dc4c-49f6-bfcc-27612bfaa1c7 tempest-VolumesTransfersTest-2091503109 None] Lock "cinder-fada6e55-1814-4646-8dbf-b5e01edadd8d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:43:56 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c16690eb-dc4c-49f6-bfcc-27612bfaa1c7 tempest-VolumesTransfersTest-2091503109 None] Acquiring lock "cinder-quobyte-fada6e55-1814-4646-8dbf-b5e01edadd8d" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:43:56 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c16690eb-dc4c-49f6-bfcc-27612bfaa1c7 tempest-VolumesTransfersTest-2091503109 None] Lock "cinder-quobyte-fada6e55-1814-4646-8dbf-b5e01edadd8d" acquired by "delete_volume" :: waited 0.014s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:43:56 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[d596362a-4d9d-4c35-b8e0-0688a7df8e5d]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:43:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c16690eb-dc4c-49f6-bfcc-27612bfaa1c7 tempest-VolumesTransfersTest-2091503109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-fada6e55-1814-4646-8dbf-b5e01edadd8d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:56 devstack sudo[103703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-fada6e55-1814-4646-8dbf-b5e01edadd8d Aug 11 04:43:56 devstack sudo[103703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:57 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f4597236-287e-4869-a499-37c142ceddc4 tempest-VolumesGetTest-667192801 None] Acquiring lock "cinder-2b30a9d3-e136-4b6b-a5d7-990968de420a-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:43:57 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f4597236-287e-4869-a499-37c142ceddc4 tempest-VolumesGetTest-667192801 None] Lock "cinder-2b30a9d3-e136-4b6b-a5d7-990968de420a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:43:57 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f4597236-287e-4869-a499-37c142ceddc4 tempest-VolumesGetTest-667192801 None] Acquiring lock "cinder-quobyte-2b30a9d3-e136-4b6b-a5d7-990968de420a" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:43:57 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f4597236-287e-4869-a499-37c142ceddc4 tempest-VolumesGetTest-667192801 None] Lock "cinder-quobyte-2b30a9d3-e136-4b6b-a5d7-990968de420a" acquired by "delete_volume" :: waited 0.021s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:43:57 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11fcd42-5424-43ee-88da-cda9a7396d02]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:43:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f4597236-287e-4869-a499-37c142ceddc4 tempest-VolumesGetTest-667192801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2b30a9d3-e136-4b6b-a5d7-990968de420a {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:57 devstack sudo[103703]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c16690eb-dc4c-49f6-bfcc-27612bfaa1c7 tempest-VolumesTransfersTest-2091503109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-fada6e55-1814-4646-8dbf-b5e01edadd8d" returned: 0 in 0.453s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c16690eb-dc4c-49f6-bfcc-27612bfaa1c7 tempest-VolumesTransfersTest-2091503109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-fada6e55-1814-4646-8dbf-b5e01edadd8d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:57 devstack sudo[103717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-fada6e55-1814-4646-8dbf-b5e01edadd8d Aug 11 04:43:57 devstack sudo[103717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:57 devstack sudo[103716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2b30a9d3-e136-4b6b-a5d7-990968de420a Aug 11 04:43:57 devstack sudo[103716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:57 devstack sudo[103717]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c16690eb-dc4c-49f6-bfcc-27612bfaa1c7 tempest-VolumesTransfersTest-2091503109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-fada6e55-1814-4646-8dbf-b5e01edadd8d" returned: 0 in 0.292s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:57 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c16690eb-dc4c-49f6-bfcc-27612bfaa1c7 tempest-VolumesTransfersTest-2091503109 None] Lock "cinder-quobyte-fada6e55-1814-4646-8dbf-b5e01edadd8d" released by "delete_volume" :: held 0.799s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:43:57 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-c16690eb-dc4c-49f6-bfcc-27612bfaa1c7 tempest-VolumesTransfersTest-2091503109 None] Created reservations ['11f9aa29-1e9f-4a9c-b04c-6789fcd765c5', '85509ace-a544-42e6-b9e8-0e3e7e515b37', '4f6d17e5-b72f-4268-b496-a9f5afffe043', 'f67a6f4b-b9e3-4b1e-8d2d-d97e93720b80'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:43:57 devstack sudo[103716]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f4597236-287e-4869-a499-37c142ceddc4 tempest-VolumesGetTest-667192801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2b30a9d3-e136-4b6b-a5d7-990968de420a" returned: 0 in 0.506s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f4597236-287e-4869-a499-37c142ceddc4 tempest-VolumesGetTest-667192801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2b30a9d3-e136-4b6b-a5d7-990968de420a {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c16690eb-dc4c-49f6-bfcc-27612bfaa1c7 tempest-VolumesTransfersTest-2091503109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:43:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c16690eb-dc4c-49f6-bfcc-27612bfaa1c7 tempest-VolumesTransfersTest-2091503109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:43:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c16690eb-dc4c-49f6-bfcc-27612bfaa1c7 tempest-VolumesTransfersTest-2091503109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:43:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c16690eb-dc4c-49f6-bfcc-27612bfaa1c7 tempest-VolumesTransfersTest-2091503109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:43:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c16690eb-dc4c-49f6-bfcc-27612bfaa1c7 tempest-VolumesTransfersTest-2091503109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:43:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c16690eb-dc4c-49f6-bfcc-27612bfaa1c7 tempest-VolumesTransfersTest-2091503109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:57 devstack sudo[103724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2b30a9d3-e136-4b6b-a5d7-990968de420a Aug 11 04:43:57 devstack sudo[103724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:57 devstack sudo[103726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:43:57 devstack sudo[103726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:58 devstack sudo[103726]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c16690eb-dc4c-49f6-bfcc-27612bfaa1c7 tempest-VolumesTransfersTest-2091503109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.328s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-c16690eb-dc4c-49f6-bfcc-27612bfaa1c7 tempest-VolumesTransfersTest-2091503109 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:43:58 devstack sudo[103724]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:58 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-c16690eb-dc4c-49f6-bfcc-27612bfaa1c7 tempest-VolumesTransfersTest-2091503109 None] Deleted volume successfully. Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f4597236-287e-4869-a499-37c142ceddc4 tempest-VolumesGetTest-667192801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2b30a9d3-e136-4b6b-a5d7-990968de420a" returned: 0 in 0.403s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f4597236-287e-4869-a499-37c142ceddc4 tempest-VolumesGetTest-667192801 None] Lock "cinder-quobyte-2b30a9d3-e136-4b6b-a5d7-990968de420a" released by "delete_volume" :: held 0.963s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c16690eb-dc4c-49f6-bfcc-27612bfaa1c7 tempest-VolumesTransfersTest-2091503109 None] Lock "cinder-fada6e55-1814-4646-8dbf-b5e01edadd8d-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-f4597236-287e-4869-a499-37c142ceddc4 tempest-VolumesGetTest-667192801 None] Created reservations ['3fefcfda-c073-4f02-99e0-52dcf49bb93d', 'd17445cc-871c-456e-9d41-ffe7636f6d90', '460621a2-e144-49c4-a5ad-454a2d3af343', 'f178c55b-d0c3-41e9-a02c-4de828cdbc03'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f4597236-287e-4869-a499-37c142ceddc4 tempest-VolumesGetTest-667192801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f4597236-287e-4869-a499-37c142ceddc4 tempest-VolumesGetTest-667192801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f4597236-287e-4869-a499-37c142ceddc4 tempest-VolumesGetTest-667192801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f4597236-287e-4869-a499-37c142ceddc4 tempest-VolumesGetTest-667192801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f4597236-287e-4869-a499-37c142ceddc4 tempest-VolumesGetTest-667192801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f4597236-287e-4869-a499-37c142ceddc4 tempest-VolumesGetTest-667192801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:58 devstack sudo[103730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:43:58 devstack sudo[103730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:58 devstack sudo[103732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:43:58 devstack sudo[103732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:58 devstack sudo[103730]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f4597236-287e-4869-a499-37c142ceddc4 tempest-VolumesGetTest-667192801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.258s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-f4597236-287e-4869-a499-37c142ceddc4 tempest-VolumesGetTest-667192801 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:43:58 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-f4597236-287e-4869-a499-37c142ceddc4 tempest-VolumesGetTest-667192801 None] Deleted volume successfully. Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-777333cc-11e1-4956-9505-bb2c1d5954f6 tempest-VolumesListTestJSON-556543254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-777333cc-11e1-4956-9505-bb2c1d5954f6 tempest-VolumesListTestJSON-556543254 None] Flow 'volume_create_manager' (d4a50e28-02a2-495b-8d8e-47d3875816ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-777333cc-11e1-4956-9505-bb2c1d5954f6 tempest-VolumesListTestJSON-556543254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (013ae597-0a5c-465d-bd0d-dfb4a7b14375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f4597236-287e-4869-a499-37c142ceddc4 tempest-VolumesGetTest-667192801 None] Lock "cinder-2b30a9d3-e136-4b6b-a5d7-990968de420a-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-777333cc-11e1-4956-9505-bb2c1d5954f6 tempest-VolumesListTestJSON-556543254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (013ae597-0a5c-465d-bd0d-dfb4a7b14375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:43:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1516884178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d43cff93-49a1-443e-b17a-9360554d2020,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8f7182f23b3b4eb5966fb33170ef22d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:43:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:43:59Z,use_quota=True,user_id='f55c7f95a0db47738e275cd3a645a0ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-777333cc-11e1-4956-9505-bb2c1d5954f6 tempest-VolumesListTestJSON-556543254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbd118db-450d-4d8e-a0f5-82f6a9da8993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-777333cc-11e1-4956-9505-bb2c1d5954f6 tempest-VolumesListTestJSON-556543254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbd118db-450d-4d8e-a0f5-82f6a9da8993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-777333cc-11e1-4956-9505-bb2c1d5954f6 tempest-VolumesListTestJSON-556543254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fdf16fd-0361-4527-971d-0ea8667e1a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-777333cc-11e1-4956-9505-bb2c1d5954f6 tempest-VolumesListTestJSON-556543254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fdf16fd-0361-4527-971d-0ea8667e1a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd43cff93-49a1-443e-b17a-9360554d2020', 'volume_name': 'volume-d43cff93-49a1-443e-b17a-9360554d2020', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-777333cc-11e1-4956-9505-bb2c1d5954f6 tempest-VolumesListTestJSON-556543254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee222d88-5a7a-4c06-a7de-c8c2c82835d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-777333cc-11e1-4956-9505-bb2c1d5954f6 tempest-VolumesListTestJSON-556543254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee222d88-5a7a-4c06-a7de-c8c2c82835d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-777333cc-11e1-4956-9505-bb2c1d5954f6 tempest-VolumesListTestJSON-556543254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (355d1331-b507-4af1-a940-d4e8fceced15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:58 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-777333cc-11e1-4956-9505-bb2c1d5954f6 tempest-VolumesListTestJSON-556543254 None] Volume d43cff93-49a1-443e-b17a-9360554d2020: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d43cff93-49a1-443e-b17a-9360554d2020', 'volume_size': 1} Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-777333cc-11e1-4956-9505-bb2c1d5954f6 tempest-VolumesListTestJSON-556543254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-777333cc-11e1-4956-9505-bb2c1d5954f6 tempest-VolumesListTestJSON-556543254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-777333cc-11e1-4956-9505-bb2c1d5954f6 tempest-VolumesListTestJSON-556543254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:43:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1516884178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d43cff93-49a1-443e-b17a-9360554d2020,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8f7182f23b3b4eb5966fb33170ef22d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:43:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:43:59Z,use_quota=True,user_id='f55c7f95a0db47738e275cd3a645a0ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-777333cc-11e1-4956-9505-bb2c1d5954f6 tempest-VolumesListTestJSON-556543254 None] Creating volume d43cff93-49a1-443e-b17a-9360554d2020 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-777333cc-11e1-4956-9505-bb2c1d5954f6 tempest-VolumesListTestJSON-556543254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-777333cc-11e1-4956-9505-bb2c1d5954f6 tempest-VolumesListTestJSON-556543254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-777333cc-11e1-4956-9505-bb2c1d5954f6 tempest-VolumesListTestJSON-556543254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-777333cc-11e1-4956-9505-bb2c1d5954f6 tempest-VolumesListTestJSON-556543254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-777333cc-11e1-4956-9505-bb2c1d5954f6 tempest-VolumesListTestJSON-556543254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-777333cc-11e1-4956-9505-bb2c1d5954f6 tempest-VolumesListTestJSON-556543254 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:43:58 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-777333cc-11e1-4956-9505-bb2c1d5954f6 tempest-VolumesListTestJSON-556543254 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-777333cc-11e1-4956-9505-bb2c1d5954f6 tempest-VolumesListTestJSON-556543254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d43cff93-49a1-443e-b17a-9360554d2020 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:58 devstack sudo[103732]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-499d8215-12ae-45c5-b805-09fab1aea35a tempest-VolumesTransfersTest-1185021633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:43:58 devstack sudo[103737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d43cff93-49a1-443e-b17a-9360554d2020 1073741824 Aug 11 04:43:58 devstack sudo[103737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-499d8215-12ae-45c5-b805-09fab1aea35a tempest-VolumesTransfersTest-1185021633 None] Flow 'volume_create_manager' (fb722211-dbaf-4966-a7dc-460345473c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-499d8215-12ae-45c5-b805-09fab1aea35a tempest-VolumesTransfersTest-1185021633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d97146ac-bd0f-4b81-bc21-0fecc730ea81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.294s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running periodic task VolumeManager._thread_info {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] thread count: 28 {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] thread info: [<_MainThread(MainThread, started 133315846115456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-499d8215-12ae-45c5-b805-09fab1aea35a tempest-VolumesTransfersTest-1185021633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d97146ac-bd0f-4b81-bc21-0fecc730ea81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:43:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1643108857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c4ed3a1-5050-4142-b3ba-00c05310da2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3c7e4541293431a914dc1f32cf4a036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:43:59Z,use_quota=True,user_id='46b2f1305f4a462ab4e4c64b9f4a8aa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-499d8215-12ae-45c5-b805-09fab1aea35a tempest-VolumesTransfersTest-1185021633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f7164c4-cc28-4889-9c1b-d03e7be07609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-499d8215-12ae-45c5-b805-09fab1aea35a tempest-VolumesTransfersTest-1185021633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f7164c4-cc28-4889-9c1b-d03e7be07609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-499d8215-12ae-45c5-b805-09fab1aea35a tempest-VolumesTransfersTest-1185021633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5edd3aa9-5c3e-4786-924e-fbeb8b0ae4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-499d8215-12ae-45c5-b805-09fab1aea35a tempest-VolumesTransfersTest-1185021633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5edd3aa9-5c3e-4786-924e-fbeb8b0ae4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c4ed3a1-5050-4142-b3ba-00c05310da2c', 'volume_name': 'volume-8c4ed3a1-5050-4142-b3ba-00c05310da2c', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-499d8215-12ae-45c5-b805-09fab1aea35a tempest-VolumesTransfersTest-1185021633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aa65035-9d18-4468-8e2e-94825b84d06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-499d8215-12ae-45c5-b805-09fab1aea35a tempest-VolumesTransfersTest-1185021633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aa65035-9d18-4468-8e2e-94825b84d06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-499d8215-12ae-45c5-b805-09fab1aea35a tempest-VolumesTransfersTest-1185021633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d62b73-d730-4c0f-a31a-79a8569666bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:58 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-499d8215-12ae-45c5-b805-09fab1aea35a tempest-VolumesTransfersTest-1185021633 None] Volume 8c4ed3a1-5050-4142-b3ba-00c05310da2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c4ed3a1-5050-4142-b3ba-00c05310da2c', 'volume_size': 1} Aug 11 04:43:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-499d8215-12ae-45c5-b805-09fab1aea35a tempest-VolumesTransfersTest-1185021633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:43:59 devstack sudo[103737]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-777333cc-11e1-4956-9505-bb2c1d5954f6 tempest-VolumesListTestJSON-556543254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d43cff93-49a1-443e-b17a-9360554d2020 1073741824" returned: 0 in 0.434s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-777333cc-11e1-4956-9505-bb2c1d5954f6 tempest-VolumesListTestJSON-556543254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d43cff93-49a1-443e-b17a-9360554d2020 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:59 devstack sudo[103743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d43cff93-49a1-443e-b17a-9360554d2020 Aug 11 04:43:59 devstack sudo[103743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:59 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d37d9875-ac92-4668-91c3-728695e267a5 tempest-VolumesGetTest-667192801 None] Acquiring lock "cinder-1224c9fd-1f96-422d-8a0d-2a5aabe853c2-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:43:59 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d37d9875-ac92-4668-91c3-728695e267a5 tempest-VolumesGetTest-667192801 None] Lock "cinder-1224c9fd-1f96-422d-8a0d-2a5aabe853c2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:43:59 devstack sudo[103743]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-777333cc-11e1-4956-9505-bb2c1d5954f6 tempest-VolumesListTestJSON-556543254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d43cff93-49a1-443e-b17a-9360554d2020" returned: 0 in 0.265s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:59 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-777333cc-11e1-4956-9505-bb2c1d5954f6 tempest-VolumesListTestJSON-556543254 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:43:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-777333cc-11e1-4956-9505-bb2c1d5954f6 tempest-VolumesListTestJSON-556543254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:43:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-499d8215-12ae-45c5-b805-09fab1aea35a tempest-VolumesTransfersTest-1185021633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.624s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:43:59 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-499d8215-12ae-45c5-b805-09fab1aea35a tempest-VolumesTransfersTest-1185021633 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:43:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1643108857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c4ed3a1-5050-4142-b3ba-00c05310da2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3c7e4541293431a914dc1f32cf4a036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:43:59Z,use_quota=True,user_id='46b2f1305f4a462ab4e4c64b9f4a8aa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:43:59 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-499d8215-12ae-45c5-b805-09fab1aea35a tempest-VolumesTransfersTest-1185021633 None] Creating volume 8c4ed3a1-5050-4142-b3ba-00c05310da2c {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:43:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-499d8215-12ae-45c5-b805-09fab1aea35a tempest-VolumesTransfersTest-1185021633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:43:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-499d8215-12ae-45c5-b805-09fab1aea35a tempest-VolumesTransfersTest-1185021633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:43:59 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-499d8215-12ae-45c5-b805-09fab1aea35a tempest-VolumesTransfersTest-1185021633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:43:59 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-499d8215-12ae-45c5-b805-09fab1aea35a tempest-VolumesTransfersTest-1185021633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:43:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-499d8215-12ae-45c5-b805-09fab1aea35a tempest-VolumesTransfersTest-1185021633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:43:59 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-499d8215-12ae-45c5-b805-09fab1aea35a tempest-VolumesTransfersTest-1185021633 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:43:59 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-499d8215-12ae-45c5-b805-09fab1aea35a tempest-VolumesTransfersTest-1185021633 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:43:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-499d8215-12ae-45c5-b805-09fab1aea35a tempest-VolumesTransfersTest-1185021633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8c4ed3a1-5050-4142-b3ba-00c05310da2c 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:59 devstack sudo[103746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8c4ed3a1-5050-4142-b3ba-00c05310da2c 1073741824 Aug 11 04:43:59 devstack sudo[103746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:59 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d37d9875-ac92-4668-91c3-728695e267a5 tempest-VolumesGetTest-667192801 None] Acquiring lock "cinder-quobyte-1224c9fd-1f96-422d-8a0d-2a5aabe853c2" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:43:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-777333cc-11e1-4956-9505-bb2c1d5954f6 tempest-VolumesListTestJSON-556543254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (355d1331-b507-4af1-a940-d4e8fceced15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d43cff93-49a1-443e-b17a-9360554d2020', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-777333cc-11e1-4956-9505-bb2c1d5954f6 tempest-VolumesListTestJSON-556543254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54fe1fb9-eb7d-446d-91db-f3905af2742d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:43:59 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d37d9875-ac92-4668-91c3-728695e267a5 tempest-VolumesGetTest-667192801 None] Lock "cinder-quobyte-1224c9fd-1f96-422d-8a0d-2a5aabe853c2" acquired by "delete_volume" :: waited 0.029s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:43:59 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-777333cc-11e1-4956-9505-bb2c1d5954f6 tempest-VolumesListTestJSON-556543254 None] Volume volume-d43cff93-49a1-443e-b17a-9360554d2020 (d43cff93-49a1-443e-b17a-9360554d2020): created successfully Aug 11 04:43:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-777333cc-11e1-4956-9505-bb2c1d5954f6 tempest-VolumesListTestJSON-556543254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54fe1fb9-eb7d-446d-91db-f3905af2742d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:43:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-777333cc-11e1-4956-9505-bb2c1d5954f6 tempest-VolumesListTestJSON-556543254 None] Flow 'volume_create_manager' (d4a50e28-02a2-495b-8d8e-47d3875816ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:43:59 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fdf45ed-5820-488b-af5e-5aa0cccbf7ad]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:43:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d37d9875-ac92-4668-91c3-728695e267a5 tempest-VolumesGetTest-667192801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1224c9fd-1f96-422d-8a0d-2a5aabe853c2 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:59 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-777333cc-11e1-4956-9505-bb2c1d5954f6 tempest-VolumesListTestJSON-556543254 None] Created volume successfully. Aug 11 04:43:59 devstack sudo[103748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1224c9fd-1f96-422d-8a0d-2a5aabe853c2 Aug 11 04:43:59 devstack sudo[103748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:59 devstack sudo[103746]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-499d8215-12ae-45c5-b805-09fab1aea35a tempest-VolumesTransfersTest-1185021633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8c4ed3a1-5050-4142-b3ba-00c05310da2c 1073741824" returned: 0 in 0.427s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-499d8215-12ae-45c5-b805-09fab1aea35a tempest-VolumesTransfersTest-1185021633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8c4ed3a1-5050-4142-b3ba-00c05310da2c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:59 devstack sudo[103748]: pam_unix(sudo:session): session closed for user root Aug 11 04:43:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d37d9875-ac92-4668-91c3-728695e267a5 tempest-VolumesGetTest-667192801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1224c9fd-1f96-422d-8a0d-2a5aabe853c2" returned: 0 in 0.376s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:43:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d37d9875-ac92-4668-91c3-728695e267a5 tempest-VolumesGetTest-667192801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1224c9fd-1f96-422d-8a0d-2a5aabe853c2 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:43:59 devstack sudo[103756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8c4ed3a1-5050-4142-b3ba-00c05310da2c Aug 11 04:43:59 devstack sudo[103756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:43:59 devstack sudo[103757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1224c9fd-1f96-422d-8a0d-2a5aabe853c2 Aug 11 04:43:59 devstack sudo[103757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:44:00 devstack sudo[103756]: pam_unix(sudo:session): session closed for user root Aug 11 04:44:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-499d8215-12ae-45c5-b805-09fab1aea35a tempest-VolumesTransfersTest-1185021633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8c4ed3a1-5050-4142-b3ba-00c05310da2c" returned: 0 in 0.267s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:44:00 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-499d8215-12ae-45c5-b805-09fab1aea35a tempest-VolumesTransfersTest-1185021633 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:44:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-499d8215-12ae-45c5-b805-09fab1aea35a tempest-VolumesTransfersTest-1185021633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:44:00 devstack sudo[103757]: pam_unix(sudo:session): session closed for user root Aug 11 04:44:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d37d9875-ac92-4668-91c3-728695e267a5 tempest-VolumesGetTest-667192801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1224c9fd-1f96-422d-8a0d-2a5aabe853c2" returned: 0 in 0.261s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:44:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-499d8215-12ae-45c5-b805-09fab1aea35a tempest-VolumesTransfersTest-1185021633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d62b73-d730-4c0f-a31a-79a8569666bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c4ed3a1-5050-4142-b3ba-00c05310da2c', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:44:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-499d8215-12ae-45c5-b805-09fab1aea35a tempest-VolumesTransfersTest-1185021633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41b255dc-5f93-489c-85fe-38e969b569fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:44:00 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d37d9875-ac92-4668-91c3-728695e267a5 tempest-VolumesGetTest-667192801 None] Lock "cinder-quobyte-1224c9fd-1f96-422d-8a0d-2a5aabe853c2" released by "delete_volume" :: held 0.691s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:44:00 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-499d8215-12ae-45c5-b805-09fab1aea35a tempest-VolumesTransfersTest-1185021633 None] Volume volume-8c4ed3a1-5050-4142-b3ba-00c05310da2c (8c4ed3a1-5050-4142-b3ba-00c05310da2c): created successfully Aug 11 04:44:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-499d8215-12ae-45c5-b805-09fab1aea35a tempest-VolumesTransfersTest-1185021633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41b255dc-5f93-489c-85fe-38e969b569fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:44:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-499d8215-12ae-45c5-b805-09fab1aea35a tempest-VolumesTransfersTest-1185021633 None] Flow 'volume_create_manager' (fb722211-dbaf-4966-a7dc-460345473c9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:44:00 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-499d8215-12ae-45c5-b805-09fab1aea35a tempest-VolumesTransfersTest-1185021633 None] Created volume successfully. Aug 11 04:44:00 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-d37d9875-ac92-4668-91c3-728695e267a5 tempest-VolumesGetTest-667192801 None] Created reservations ['4345454f-b311-4145-bafe-2ba8e1e29f06', 'a04fb9e0-b24f-48bb-8213-3db01d4a5c3d', '64a37394-390f-4b87-ad37-9e1b2d56960a', '7dbf69f9-4e32-4bea-82b4-cca6ec25e39a'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:44:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d37d9875-ac92-4668-91c3-728695e267a5 tempest-VolumesGetTest-667192801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:44:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d37d9875-ac92-4668-91c3-728695e267a5 tempest-VolumesGetTest-667192801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:44:00 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d37d9875-ac92-4668-91c3-728695e267a5 tempest-VolumesGetTest-667192801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:44:00 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d37d9875-ac92-4668-91c3-728695e267a5 tempest-VolumesGetTest-667192801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:44:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d37d9875-ac92-4668-91c3-728695e267a5 tempest-VolumesGetTest-667192801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:44:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d37d9875-ac92-4668-91c3-728695e267a5 tempest-VolumesGetTest-667192801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:44:00 devstack sudo[103762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:44:00 devstack sudo[103762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:44:00 devstack sudo[103762]: pam_unix(sudo:session): session closed for user root Aug 11 04:44:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d37d9875-ac92-4668-91c3-728695e267a5 tempest-VolumesGetTest-667192801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.287s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:44:00 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-d37d9875-ac92-4668-91c3-728695e267a5 tempest-VolumesGetTest-667192801 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:44:00 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-d37d9875-ac92-4668-91c3-728695e267a5 tempest-VolumesGetTest-667192801 None] Deleted volume successfully. Aug 11 04:44:00 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d37d9875-ac92-4668-91c3-728695e267a5 tempest-VolumesGetTest-667192801 None] Lock "cinder-1224c9fd-1f96-422d-8a0d-2a5aabe853c2-delete_volume" released by "delete_volume" :: held 1.262s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:44:00 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1557ab0d-4d29-4f05-8dd2-bad7ff8e6dae tempest-VolumesGetTest-667192801 None] Acquiring lock "cinder-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:44:00 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1557ab0d-4d29-4f05-8dd2-bad7ff8e6dae tempest-VolumesGetTest-667192801 None] Lock "cinder-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:44:00 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1557ab0d-4d29-4f05-8dd2-bad7ff8e6dae tempest-VolumesGetTest-667192801 None] Acquiring lock "cinder-quobyte-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:44:00 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1557ab0d-4d29-4f05-8dd2-bad7ff8e6dae tempest-VolumesGetTest-667192801 None] Lock "cinder-quobyte-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f" acquired by "delete_volume" :: waited 0.018s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:44:00 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7684dc-b768-4867-9a21-9c010806a9de]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:44:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1557ab0d-4d29-4f05-8dd2-bad7ff8e6dae tempest-VolumesGetTest-667192801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:44:00 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-cbee3171-86c1-444f-b435-e39723ade68d tempest-VolumesTransfersTest-2091503109 None] Acquiring lock "cinder-8c4ed3a1-5050-4142-b3ba-00c05310da2c-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:44:00 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-cbee3171-86c1-444f-b435-e39723ade68d tempest-VolumesTransfersTest-2091503109 None] Lock "cinder-8c4ed3a1-5050-4142-b3ba-00c05310da2c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:44:00 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-cbee3171-86c1-444f-b435-e39723ade68d tempest-VolumesTransfersTest-2091503109 None] Acquiring lock "cinder-quobyte-8c4ed3a1-5050-4142-b3ba-00c05310da2c" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:44:00 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-cbee3171-86c1-444f-b435-e39723ade68d tempest-VolumesTransfersTest-2091503109 None] Lock "cinder-quobyte-8c4ed3a1-5050-4142-b3ba-00c05310da2c" acquired by "delete_volume" :: waited 0.016s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:44:01 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb9e0a8-c4fc-4fc5-8bd6-63b0f3556c24]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:44:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cbee3171-86c1-444f-b435-e39723ade68d tempest-VolumesTransfersTest-2091503109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8c4ed3a1-5050-4142-b3ba-00c05310da2c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:44:01 devstack sudo[103765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f Aug 11 04:44:01 devstack sudo[103765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:44:01 devstack sudo[103766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8c4ed3a1-5050-4142-b3ba-00c05310da2c Aug 11 04:44:01 devstack sudo[103766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:44:01 devstack sudo[103765]: pam_unix(sudo:session): session closed for user root Aug 11 04:44:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1557ab0d-4d29-4f05-8dd2-bad7ff8e6dae tempest-VolumesGetTest-667192801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f" returned: 0 in 0.455s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:44:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1557ab0d-4d29-4f05-8dd2-bad7ff8e6dae tempest-VolumesGetTest-667192801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:44:01 devstack sudo[103774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f Aug 11 04:44:01 devstack sudo[103774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:44:01 devstack sudo[103766]: pam_unix(sudo:session): session closed for user root Aug 11 04:44:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cbee3171-86c1-444f-b435-e39723ade68d tempest-VolumesTransfersTest-2091503109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8c4ed3a1-5050-4142-b3ba-00c05310da2c" returned: 0 in 0.391s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:44:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cbee3171-86c1-444f-b435-e39723ade68d tempest-VolumesTransfersTest-2091503109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8c4ed3a1-5050-4142-b3ba-00c05310da2c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:44:01 devstack sudo[103777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8c4ed3a1-5050-4142-b3ba-00c05310da2c Aug 11 04:44:01 devstack sudo[103777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:44:01 devstack sudo[103774]: pam_unix(sudo:session): session closed for user root Aug 11 04:44:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1557ab0d-4d29-4f05-8dd2-bad7ff8e6dae tempest-VolumesGetTest-667192801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f" returned: 0 in 0.291s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:44:01 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1557ab0d-4d29-4f05-8dd2-bad7ff8e6dae tempest-VolumesGetTest-667192801 None] Lock "cinder-quobyte-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f" released by "delete_volume" :: held 0.836s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:44:01 devstack sudo[103777]: pam_unix(sudo:session): session closed for user root Aug 11 04:44:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cbee3171-86c1-444f-b435-e39723ade68d tempest-VolumesTransfersTest-2091503109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8c4ed3a1-5050-4142-b3ba-00c05310da2c" returned: 0 in 0.269s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:44:01 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-cbee3171-86c1-444f-b435-e39723ade68d tempest-VolumesTransfersTest-2091503109 None] Lock "cinder-quobyte-8c4ed3a1-5050-4142-b3ba-00c05310da2c" released by "delete_volume" :: held 0.724s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:44:01 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-1557ab0d-4d29-4f05-8dd2-bad7ff8e6dae tempest-VolumesGetTest-667192801 None] Created reservations ['f81def80-7a72-4ce1-9e84-ce316c4a74be', 'fee27055-d615-4a53-8a46-72f4b05d79e3', 'ef3ddefe-af02-475f-a17f-bebd8c74c845', '77670658-ead7-42cb-95aa-eb48d08f00b8'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:44:01 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-cbee3171-86c1-444f-b435-e39723ade68d tempest-VolumesTransfersTest-2091503109 None] Created reservations ['cb94319b-a884-41bb-bc7d-37854330b756', 'ad943f3a-0eef-4f37-950c-ba018dfc7061', '4b07043a-7626-4c31-956c-3794dd0c7b19', '7849564a-11fb-4948-8fff-1f6d9a2206f8'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:44:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1557ab0d-4d29-4f05-8dd2-bad7ff8e6dae tempest-VolumesGetTest-667192801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:44:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1557ab0d-4d29-4f05-8dd2-bad7ff8e6dae tempest-VolumesGetTest-667192801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:44:01 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1557ab0d-4d29-4f05-8dd2-bad7ff8e6dae tempest-VolumesGetTest-667192801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:44:01 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1557ab0d-4d29-4f05-8dd2-bad7ff8e6dae tempest-VolumesGetTest-667192801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:44:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1557ab0d-4d29-4f05-8dd2-bad7ff8e6dae tempest-VolumesGetTest-667192801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:44:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1557ab0d-4d29-4f05-8dd2-bad7ff8e6dae tempest-VolumesGetTest-667192801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:44:01 devstack sudo[103781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:44:01 devstack sudo[103781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:44:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-cbee3171-86c1-444f-b435-e39723ade68d tempest-VolumesTransfersTest-2091503109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:44:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-cbee3171-86c1-444f-b435-e39723ade68d tempest-VolumesTransfersTest-2091503109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:44:01 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-cbee3171-86c1-444f-b435-e39723ade68d tempest-VolumesTransfersTest-2091503109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:44:01 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-cbee3171-86c1-444f-b435-e39723ade68d tempest-VolumesTransfersTest-2091503109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:44:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-cbee3171-86c1-444f-b435-e39723ade68d tempest-VolumesTransfersTest-2091503109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:44:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cbee3171-86c1-444f-b435-e39723ade68d tempest-VolumesTransfersTest-2091503109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:44:01 devstack sudo[103783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:44:01 devstack sudo[103783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:44:02 devstack sudo[103781]: pam_unix(sudo:session): session closed for user root Aug 11 04:44:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1557ab0d-4d29-4f05-8dd2-bad7ff8e6dae tempest-VolumesGetTest-667192801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.313s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:44:02 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-1557ab0d-4d29-4f05-8dd2-bad7ff8e6dae tempest-VolumesGetTest-667192801 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:44:02 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-1557ab0d-4d29-4f05-8dd2-bad7ff8e6dae tempest-VolumesGetTest-667192801 None] Deleted volume successfully. Aug 11 04:44:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1557ab0d-4d29-4f05-8dd2-bad7ff8e6dae tempest-VolumesGetTest-667192801 None] Lock "cinder-d9996e5b-3c6d-4092-b4ed-aaa421a04f4f-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:44:02 devstack sudo[103783]: pam_unix(sudo:session): session closed for user root Aug 11 04:44:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cbee3171-86c1-444f-b435-e39723ade68d tempest-VolumesTransfersTest-2091503109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.359s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:44:02 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-cbee3171-86c1-444f-b435-e39723ade68d tempest-VolumesTransfersTest-2091503109 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:44:02 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-cbee3171-86c1-444f-b435-e39723ade68d tempest-VolumesTransfersTest-2091503109 None] Deleted volume successfully. Aug 11 04:44:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-cbee3171-86c1-444f-b435-e39723ade68d tempest-VolumesTransfersTest-2091503109 None] Lock "cinder-8c4ed3a1-5050-4142-b3ba-00c05310da2c-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:44:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2ceb4090-bada-4a9f-ab2c-635ec26de13b tempest-VolumesListTestJSON-556543254 None] Acquiring lock "cinder-d43cff93-49a1-443e-b17a-9360554d2020-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:44:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2ceb4090-bada-4a9f-ab2c-635ec26de13b tempest-VolumesListTestJSON-556543254 None] Lock "cinder-d43cff93-49a1-443e-b17a-9360554d2020-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:44:02 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:44:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] Flow 'volume_create_manager' (340362c5-88ea-4e17-af8e-52f98466a401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:44:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d90e704c-2823-41e8-963c-0e203be3be6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:44:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2ceb4090-bada-4a9f-ab2c-635ec26de13b tempest-VolumesListTestJSON-556543254 None] Acquiring lock "cinder-quobyte-d43cff93-49a1-443e-b17a-9360554d2020" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:44:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d90e704c-2823-41e8-963c-0e203be3be6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:44:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-185987894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ce81a25-f4aa-4e60-8fb1-2e22ecb8cd23,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4be18a68d5524857b2b7b1bf2e849c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:44:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:44:03Z,use_quota=True,user_id='885fd20bf9004603a4c318af0014813d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:44:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6af17e6-3dc8-4627-ad67-aeb58a867444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:44:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6af17e6-3dc8-4627-ad67-aeb58a867444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:44:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12385505-b36d-4612-b5e3-8a8d61599b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:44:02 devstack cinder-volume[94472]: DEBUG cinder.image.glance [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] Creating Keystone auth plugin from conf {{(pid=94472) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 11 04:44:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2ceb4090-bada-4a9f-ab2c-635ec26de13b tempest-VolumesListTestJSON-556543254 None] Lock "cinder-quobyte-d43cff93-49a1-443e-b17a-9360554d2020" acquired by "delete_volume" :: waited 0.049s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:44:02 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[c424708c-69a5-49f0-9157-bdc336d912be]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:44:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2ceb4090-bada-4a9f-ab2c-635ec26de13b tempest-VolumesListTestJSON-556543254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d43cff93-49a1-443e-b17a-9360554d2020 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:44:03 devstack sudo[103788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d43cff93-49a1-443e-b17a-9360554d2020 Aug 11 04:44:03 devstack sudo[103788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:44:03 devstack sudo[103788]: pam_unix(sudo:session): session closed for user root Aug 11 04:44:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2ceb4090-bada-4a9f-ab2c-635ec26de13b tempest-VolumesListTestJSON-556543254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d43cff93-49a1-443e-b17a-9360554d2020" returned: 0 in 0.403s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:44:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2ceb4090-bada-4a9f-ab2c-635ec26de13b tempest-VolumesListTestJSON-556543254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d43cff93-49a1-443e-b17a-9360554d2020 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:44:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12385505-b36d-4612-b5e3-8a8d61599b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1ce81a25-f4aa-4e60-8fb1-2e22ecb8cd23', 'volume_name': 'volume-1ce81a25-f4aa-4e60-8fb1-2e22ecb8cd23', 'volume_size': 1, 'image_id': '935df48c-f244-44af-83c6-4799aff908b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/935df48c-f244-44af-83c6-4799aff908b2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f74f87914afa4c849e1ab3e938cfb579', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '935df48c-f244-44af-83c6-4799aff908b2', 'created_at': datetime.datetime(2026, 8, 11, 2, 32, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 2, 32, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/935df48c-f244-44af-83c6-4799aff908b2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:44:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (105edf62-678e-42b4-a1dc-c3f668eec087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:44:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (105edf62-678e-42b4-a1dc-c3f668eec087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:44:03 devstack sudo[103794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d43cff93-49a1-443e-b17a-9360554d2020 Aug 11 04:44:03 devstack sudo[103794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:44:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33ff1fd4-cbba-4d04-86da-72d1071e2e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:44:03 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] Volume 1ce81a25-f4aa-4e60-8fb1-2e22ecb8cd23: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1ce81a25-f4aa-4e60-8fb1-2e22ecb8cd23', 'volume_size': 1, 'image_id': '935df48c-f244-44af-83c6-4799aff908b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/935df48c-f244-44af-83c6-4799aff908b2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f74f87914afa4c849e1ab3e938cfb579', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '935df48c-f244-44af-83c6-4799aff908b2', 'created_at': datetime.datetime(2026, 8, 11, 2, 32, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 2, 32, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/935df48c-f244-44af-83c6-4799aff908b2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 11 04:44:03 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] Trying to clone 1ce81a25-f4aa-4e60-8fb1-2e22ecb8cd23 from image 935df48c-f244-44af-83c6-4799aff908b2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/935df48c-f244-44af-83c6-4799aff908b2', 'metadata': {}}]). {{(pid=94472) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 11 04:44:03 devstack sudo[103794]: pam_unix(sudo:session): session closed for user root Aug 11 04:44:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2ceb4090-bada-4a9f-ab2c-635ec26de13b tempest-VolumesListTestJSON-556543254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d43cff93-49a1-443e-b17a-9360554d2020" returned: 0 in 0.300s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:44:03 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2ceb4090-bada-4a9f-ab2c-635ec26de13b tempest-VolumesListTestJSON-556543254 None] Lock "cinder-quobyte-d43cff93-49a1-443e-b17a-9360554d2020" released by "delete_volume" :: held 0.787s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:44:03 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_nixeth6vdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 11 04:44:03 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] Image download 20.69 MB at 20.69 MB/s Aug 11 04:44:03 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-2ceb4090-bada-4a9f-ab2c-635ec26de13b tempest-VolumesListTestJSON-556543254 None] Created reservations ['3a14a1c1-7f27-4561-b27b-aefbc46d5aff', 'fd2648a8-2262-4698-801e-fafae0b05b04', 'daf22399-9ee5-437c-86ea-43753afb0d90', '4050fc0d-8bdf-46bc-b180-7710a4062e60'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:44:03 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[544b80de-a453-4054-ba71-4a3e943a3913]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:44:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_nixeth6vdevstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:44:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2ceb4090-bada-4a9f-ab2c-635ec26de13b tempest-VolumesListTestJSON-556543254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:44:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2ceb4090-bada-4a9f-ab2c-635ec26de13b tempest-VolumesListTestJSON-556543254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:44:03 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2ceb4090-bada-4a9f-ab2c-635ec26de13b tempest-VolumesListTestJSON-556543254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:44:03 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2ceb4090-bada-4a9f-ab2c-635ec26de13b tempest-VolumesListTestJSON-556543254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:44:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2ceb4090-bada-4a9f-ab2c-635ec26de13b tempest-VolumesListTestJSON-556543254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:44:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2ceb4090-bada-4a9f-ab2c-635ec26de13b tempest-VolumesListTestJSON-556543254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:44:03 devstack sudo[103799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:44:03 devstack sudo[103799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:44:03 devstack sudo[103798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_nixeth6vdevstack@QuobyteHD Aug 11 04:44:03 devstack sudo[103798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:44:04 devstack sudo[103799]: pam_unix(sudo:session): session closed for user root Aug 11 04:44:04 devstack sudo[103798]: pam_unix(sudo:session): session closed for user root Aug 11 04:44:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2ceb4090-bada-4a9f-ab2c-635ec26de13b tempest-VolumesListTestJSON-556543254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.275s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:44:04 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-2ceb4090-bada-4a9f-ab2c-635ec26de13b tempest-VolumesListTestJSON-556543254 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:44:04 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-2ceb4090-bada-4a9f-ab2c-635ec26de13b tempest-VolumesListTestJSON-556543254 None] Deleted volume successfully. Aug 11 04:44:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_nixeth6vdevstack@QuobyteHD" returned: 0 in 0.380s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:44:04 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] Temporary image 935df48c-f244-44af-83c6-4799aff908b2 is fetched for user 885fd20bf9004603a4c318af0014813d. {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 11 04:44:04 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2ceb4090-bada-4a9f-ab2c-635ec26de13b tempest-VolumesListTestJSON-556543254 None] Lock "cinder-d43cff93-49a1-443e-b17a-9360554d2020-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:44:04 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[5371c025-632f-431f-864d-b1630dca60ab]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:44:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_nixeth6vdevstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:44:04 devstack sudo[103807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_nixeth6vdevstack@QuobyteHD Aug 11 04:44:04 devstack sudo[103807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:44:04 devstack sudo[103807]: pam_unix(sudo:session): session closed for user root Aug 11 04:44:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_nixeth6vdevstack@QuobyteHD" returned: 0 in 0.348s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:44:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:44:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:44:04 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:44:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-185987894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ce81a25-f4aa-4e60-8fb1-2e22ecb8cd23,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4be18a68d5524857b2b7b1bf2e849c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:44:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:44:03Z,use_quota=True,user_id='885fd20bf9004603a4c318af0014813d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:44:04 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] Creating volume 1ce81a25-f4aa-4e60-8fb1-2e22ecb8cd23 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:44:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:44:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:44:04 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:44:04 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:44:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:44:04 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:44:04 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:44:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1ce81a25-f4aa-4e60-8fb1-2e22ecb8cd23 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:44:04 devstack sudo[103813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1ce81a25-f4aa-4e60-8fb1-2e22ecb8cd23 1073741824 Aug 11 04:44:04 devstack sudo[103813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:44:05 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d64fdc6e-741c-4136-a967-5c953ca22906 tempest-VolumesListTestJSON-556543254 None] Acquiring lock "cinder-3d8b09b9-235a-4c4a-a6e7-1e69a6367b15-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:44:05 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d64fdc6e-741c-4136-a967-5c953ca22906 tempest-VolumesListTestJSON-556543254 None] Lock "cinder-3d8b09b9-235a-4c4a-a6e7-1e69a6367b15-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:44:05 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d64fdc6e-741c-4136-a967-5c953ca22906 tempest-VolumesListTestJSON-556543254 None] Acquiring lock "cinder-quobyte-3d8b09b9-235a-4c4a-a6e7-1e69a6367b15" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:44:05 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d64fdc6e-741c-4136-a967-5c953ca22906 tempest-VolumesListTestJSON-556543254 None] Lock "cinder-quobyte-3d8b09b9-235a-4c4a-a6e7-1e69a6367b15" acquired by "delete_volume" :: waited 0.017s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:44:05 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8336a2b-87c4-40e1-84c8-c8b25c37bce7]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:44:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d64fdc6e-741c-4136-a967-5c953ca22906 tempest-VolumesListTestJSON-556543254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d8b09b9-235a-4c4a-a6e7-1e69a6367b15 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:44:05 devstack sudo[103813]: pam_unix(sudo:session): session closed for user root Aug 11 04:44:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1ce81a25-f4aa-4e60-8fb1-2e22ecb8cd23 1073741824" returned: 0 in 0.667s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:44:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1ce81a25-f4aa-4e60-8fb1-2e22ecb8cd23 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:44:05 devstack sudo[103820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1ce81a25-f4aa-4e60-8fb1-2e22ecb8cd23 Aug 11 04:44:05 devstack sudo[103820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:44:05 devstack sudo[103819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d8b09b9-235a-4c4a-a6e7-1e69a6367b15 Aug 11 04:44:05 devstack sudo[103819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:44:05 devstack sudo[103820]: pam_unix(sudo:session): session closed for user root Aug 11 04:44:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1ce81a25-f4aa-4e60-8fb1-2e22ecb8cd23" returned: 0 in 0.314s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:44:05 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:44:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:44:05 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] Attempting download of 935df48c-f244-44af-83c6-4799aff908b2 ((None, [{'url': 'file:///opt/stack/data/glance/images/935df48c-f244-44af-83c6-4799aff908b2', 'metadata': {}}])) to volume 1ce81a25-f4aa-4e60-8fb1-2e22ecb8cd23. {{(pid=94472) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 11 04:44:05 devstack sudo[103819]: pam_unix(sudo:session): session closed for user root Aug 11 04:44:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d64fdc6e-741c-4136-a967-5c953ca22906 tempest-VolumesListTestJSON-556543254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d8b09b9-235a-4c4a-a6e7-1e69a6367b15" returned: 0 in 0.479s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:44:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d64fdc6e-741c-4136-a967-5c953ca22906 tempest-VolumesListTestJSON-556543254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d8b09b9-235a-4c4a-a6e7-1e69a6367b15 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:44:05 devstack sudo[103827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d8b09b9-235a-4c4a-a6e7-1e69a6367b15 Aug 11 04:44:05 devstack sudo[103827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:44:05 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[d500fd1a-545b-4168-b3b4-3de162e16f6b]: (4, 'raw') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:44:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_935df48c-f244-44af-83c6-4799aff908b2_ph9vg_ak {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:44:05 devstack sudo[103829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_935df48c-f244-44af-83c6-4799aff908b2_ph9vg_ak Aug 11 04:44:05 devstack sudo[103829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:44:06 devstack sudo[103827]: pam_unix(sudo:session): session closed for user root Aug 11 04:44:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d64fdc6e-741c-4136-a967-5c953ca22906 tempest-VolumesListTestJSON-556543254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d8b09b9-235a-4c4a-a6e7-1e69a6367b15" returned: 0 in 0.345s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:44:06 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d64fdc6e-741c-4136-a967-5c953ca22906 tempest-VolumesListTestJSON-556543254 None] Lock "cinder-quobyte-3d8b09b9-235a-4c4a-a6e7-1e69a6367b15" released by "delete_volume" :: held 0.878s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:44:06 devstack sudo[103829]: pam_unix(sudo:session): session closed for user root Aug 11 04:44:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_935df48c-f244-44af-83c6-4799aff908b2_ph9vg_ak" returned: 0 in 0.408s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:44:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_935df48c-f244-44af-83c6-4799aff908b2_ph9vg_ak {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:44:06 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-d64fdc6e-741c-4136-a967-5c953ca22906 tempest-VolumesListTestJSON-556543254 None] Created reservations ['d7cb4953-55f4-41bf-818d-6d258aa405ea', 'a19d1985-facc-4f10-8cde-b0564ba46b2f', 'c7f8863d-0e23-42b7-9457-36819a2792e1', 'af5864c9-dc03-40c0-9a78-9392add69abd'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:44:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d64fdc6e-741c-4136-a967-5c953ca22906 tempest-VolumesListTestJSON-556543254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:44:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d64fdc6e-741c-4136-a967-5c953ca22906 tempest-VolumesListTestJSON-556543254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:44:06 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d64fdc6e-741c-4136-a967-5c953ca22906 tempest-VolumesListTestJSON-556543254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:44:06 devstack sudo[103834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_935df48c-f244-44af-83c6-4799aff908b2_ph9vg_ak Aug 11 04:44:06 devstack sudo[103834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:44:06 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d64fdc6e-741c-4136-a967-5c953ca22906 tempest-VolumesListTestJSON-556543254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:44:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d64fdc6e-741c-4136-a967-5c953ca22906 tempest-VolumesListTestJSON-556543254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:44:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d64fdc6e-741c-4136-a967-5c953ca22906 tempest-VolumesListTestJSON-556543254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:44:06 devstack sudo[103836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:44:06 devstack sudo[103836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:44:06 devstack sudo[103836]: pam_unix(sudo:session): session closed for user root Aug 11 04:44:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d64fdc6e-741c-4136-a967-5c953ca22906 tempest-VolumesListTestJSON-556543254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.261s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:44:06 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-d64fdc6e-741c-4136-a967-5c953ca22906 tempest-VolumesListTestJSON-556543254 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:44:06 devstack sudo[103834]: pam_unix(sudo:session): session closed for user root Aug 11 04:44:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_935df48c-f244-44af-83c6-4799aff908b2_ph9vg_ak" returned: 1 in 0.405s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:44:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_935df48c-f244-44af-83c6-4799aff908b2_ph9vg_ak' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 11 04:44:06 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-d64fdc6e-741c-4136-a967-5c953ca22906 tempest-VolumesListTestJSON-556543254 None] Deleted volume successfully. Aug 11 04:44:06 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[695d3551-4946-437b-a22c-42824a6a535c]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:44:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_nixeth6vdevstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:44:06 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d64fdc6e-741c-4136-a967-5c953ca22906 tempest-VolumesListTestJSON-556543254 None] Lock "cinder-3d8b09b9-235a-4c4a-a6e7-1e69a6367b15-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:44:06 devstack sudo[103847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_nixeth6vdevstack@QuobyteHD Aug 11 04:44:06 devstack sudo[103847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:44:07 devstack sudo[103847]: pam_unix(sudo:session): session closed for user root Aug 11 04:44:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_nixeth6vdevstack@QuobyteHD" returned: 0 in 0.445s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:44:07 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] 935df48c-f244-44af-83c6-4799aff908b2 was qcow2, converting to qcow2 {{(pid=94472) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 11 04:44:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_nixeth6vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1ce81a25-f4aa-4e60-8fb1-2e22ecb8cd23 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:44:07 devstack sudo[103852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_nixeth6vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1ce81a25-f4aa-4e60-8fb1-2e22ecb8cd23 Aug 11 04:44:07 devstack sudo[103852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:44:07 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-15bcdbf4-6e7c-4833-82dd-181c3628302d tempest-VolumesListTestJSON-556543254 None] Acquiring lock "cinder-d3df951b-0b3d-4e28-b8e6-a6e5cfa7d9b5-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:44:07 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-15bcdbf4-6e7c-4833-82dd-181c3628302d tempest-VolumesListTestJSON-556543254 None] Lock "cinder-d3df951b-0b3d-4e28-b8e6-a6e5cfa7d9b5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:44:07 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-15bcdbf4-6e7c-4833-82dd-181c3628302d tempest-VolumesListTestJSON-556543254 None] Acquiring lock "cinder-quobyte-d3df951b-0b3d-4e28-b8e6-a6e5cfa7d9b5" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:44:07 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-15bcdbf4-6e7c-4833-82dd-181c3628302d tempest-VolumesListTestJSON-556543254 None] Lock "cinder-quobyte-d3df951b-0b3d-4e28-b8e6-a6e5cfa7d9b5" acquired by "delete_volume" :: waited 0.029s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:44:07 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[13152a86-ab50-49fe-94e0-c5584234ba51]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:44:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-15bcdbf4-6e7c-4833-82dd-181c3628302d tempest-VolumesListTestJSON-556543254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d3df951b-0b3d-4e28-b8e6-a6e5cfa7d9b5 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:44:07 devstack sudo[103861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d3df951b-0b3d-4e28-b8e6-a6e5cfa7d9b5 Aug 11 04:44:07 devstack sudo[103861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:44:08 devstack sudo[103861]: pam_unix(sudo:session): session closed for user root Aug 11 04:44:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-15bcdbf4-6e7c-4833-82dd-181c3628302d tempest-VolumesListTestJSON-556543254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d3df951b-0b3d-4e28-b8e6-a6e5cfa7d9b5" returned: 0 in 0.539s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:44:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-15bcdbf4-6e7c-4833-82dd-181c3628302d tempest-VolumesListTestJSON-556543254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d3df951b-0b3d-4e28-b8e6-a6e5cfa7d9b5 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:44:08 devstack sudo[103868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d3df951b-0b3d-4e28-b8e6-a6e5cfa7d9b5 Aug 11 04:44:08 devstack sudo[103868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:44:08 devstack sudo[103868]: pam_unix(sudo:session): session closed for user root Aug 11 04:44:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-15bcdbf4-6e7c-4833-82dd-181c3628302d tempest-VolumesListTestJSON-556543254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d3df951b-0b3d-4e28-b8e6-a6e5cfa7d9b5" returned: 0 in 0.362s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:44:08 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-15bcdbf4-6e7c-4833-82dd-181c3628302d tempest-VolumesListTestJSON-556543254 None] Lock "cinder-quobyte-d3df951b-0b3d-4e28-b8e6-a6e5cfa7d9b5" released by "delete_volume" :: held 0.958s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:44:08 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-15bcdbf4-6e7c-4833-82dd-181c3628302d tempest-VolumesListTestJSON-556543254 None] Created reservations ['f9074e14-979a-40f1-bedb-4f900d6c32a2', '7cbf072c-f330-4a2e-bae4-2e3056f01abd', '98f4dced-31b8-4877-9565-9607e03d7ba5', '7f8ef045-adab-4c86-a6eb-856ca6940430'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:44:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-15bcdbf4-6e7c-4833-82dd-181c3628302d tempest-VolumesListTestJSON-556543254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:44:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-15bcdbf4-6e7c-4833-82dd-181c3628302d tempest-VolumesListTestJSON-556543254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:44:08 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-15bcdbf4-6e7c-4833-82dd-181c3628302d tempest-VolumesListTestJSON-556543254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:44:08 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-15bcdbf4-6e7c-4833-82dd-181c3628302d tempest-VolumesListTestJSON-556543254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:44:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-15bcdbf4-6e7c-4833-82dd-181c3628302d tempest-VolumesListTestJSON-556543254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:44:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-15bcdbf4-6e7c-4833-82dd-181c3628302d tempest-VolumesListTestJSON-556543254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:44:08 devstack sudo[103891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:44:08 devstack sudo[103891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:44:09 devstack sudo[103891]: pam_unix(sudo:session): session closed for user root Aug 11 04:44:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-15bcdbf4-6e7c-4833-82dd-181c3628302d tempest-VolumesListTestJSON-556543254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.451s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:44:09 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-15bcdbf4-6e7c-4833-82dd-181c3628302d tempest-VolumesListTestJSON-556543254 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:44:09 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-15bcdbf4-6e7c-4833-82dd-181c3628302d tempest-VolumesListTestJSON-556543254 None] Deleted volume successfully. Aug 11 04:44:09 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-15bcdbf4-6e7c-4833-82dd-181c3628302d tempest-VolumesListTestJSON-556543254 None] Lock "cinder-d3df951b-0b3d-4e28-b8e6-a6e5cfa7d9b5-delete_volume" released by "delete_volume" :: held 1.822s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:44:09 devstack sudo[103852]: pam_unix(sudo:session): session closed for user root Aug 11 04:44:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_nixeth6vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1ce81a25-f4aa-4e60-8fb1-2e22ecb8cd23" returned: 0 in 2.605s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:44:09 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_nixeth6vdevstack@QuobyteHD, size 112.00 MB, duration 2.61 sec, destination /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1ce81a25-f4aa-4e60-8fb1-2e22ecb8cd23 {{(pid=94472) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 11 04:44:09 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] Converted 112.00 MB image at 42.98 MB/s Aug 11 04:44:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1ce81a25-f4aa-4e60-8fb1-2e22ecb8cd23 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:44:09 devstack sudo[103902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1ce81a25-f4aa-4e60-8fb1-2e22ecb8cd23 1G Aug 11 04:44:09 devstack sudo[103902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:44:10 devstack sudo[103902]: pam_unix(sudo:session): session closed for user root Aug 11 04:44:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1ce81a25-f4aa-4e60-8fb1-2e22ecb8cd23 1G" returned: 0 in 0.470s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:44:10 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] Downloaded image 935df48c-f244-44af-83c6-4799aff908b2 ((None, [{'url': 'file:///opt/stack/data/glance/images/935df48c-f244-44af-83c6-4799aff908b2', 'metadata': {}}])) to volume 1ce81a25-f4aa-4e60-8fb1-2e22ecb8cd23 successfully. {{(pid=94472) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 11 04:44:10 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] Temporary image 935df48c-f244-44af-83c6-4799aff908b2 for user 885fd20bf9004603a4c318af0014813d is deleted. {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 11 04:44:10 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] Marking volume 1ce81a25-f4aa-4e60-8fb1-2e22ecb8cd23 as bootable. {{(pid=94472) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 11 04:44:10 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] Copying metadata from image 935df48c-f244-44af-83c6-4799aff908b2 to 1ce81a25-f4aa-4e60-8fb1-2e22ecb8cd23. {{(pid=94472) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 11 04:44:10 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] Creating volume glance metadata for volume 1ce81a25-f4aa-4e60-8fb1-2e22ecb8cd23 backed by image 935df48c-f244-44af-83c6-4799aff908b2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '935df48c-f244-44af-83c6-4799aff908b2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94472) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 11 04:44:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33ff1fd4-cbba-4d04-86da-72d1071e2e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ce81a25-f4aa-4e60-8fb1-2e22ecb8cd23', 'volume_size': 1, 'image_id': '935df48c-f244-44af-83c6-4799aff908b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/935df48c-f244-44af-83c6-4799aff908b2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f74f87914afa4c849e1ab3e938cfb579', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '935df48c-f244-44af-83c6-4799aff908b2', 'created_at': datetime.datetime(2026, 8, 11, 2, 32, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 2, 32, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/935df48c-f244-44af-83c6-4799aff908b2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:44:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82f62dbf-9f21-49f3-9a4f-54957615caee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:44:10 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] Volume volume-1ce81a25-f4aa-4e60-8fb1-2e22ecb8cd23 (1ce81a25-f4aa-4e60-8fb1-2e22ecb8cd23): created successfully Aug 11 04:44:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82f62dbf-9f21-49f3-9a4f-54957615caee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:44:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] Flow 'volume_create_manager' (340362c5-88ea-4e17-af8e-52f98466a401) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:44:10 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-6a6ad41a-fbb8-4313-a8d9-ef5c6954ce2a tempest-VolumesGetTest-667192801 None] Created volume successfully. Aug 11 04:44:10 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-af711b1d-46d8-4414-82cb-5f268128b2b2 req-e6a05b73-e7f0-4614-bf5f-2a591927b8b5 tempest-ServerActionsTestOtherA-1583977559 None] Terminate volume connection completed successfully. Aug 11 04:44:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-af711b1d-46d8-4414-82cb-5f268128b2b2 req-e6a05b73-e7f0-4614-bf5f-2a591927b8b5 tempest-ServerActionsTestOtherA-1583977559 None] Deleting attachment 93aa7fd7-4314-4c16-8fe6-627f9a34c1e0. {{(pid=94472) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 11 04:44:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-af711b1d-46d8-4414-82cb-5f268128b2b2 req-20b889ca-afa9-4552-8f8b-fb59e62d486d tempest-ServerActionsTestOtherA-1583977559 None] Acquiring lock "cinder-94c58ff1-a7f5-4c32-9664-ce0425ceb324-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:44:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-af711b1d-46d8-4414-82cb-5f268128b2b2 req-20b889ca-afa9-4552-8f8b-fb59e62d486d tempest-ServerActionsTestOtherA-1583977559 None] Lock "cinder-94c58ff1-a7f5-4c32-9664-ce0425ceb324-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:44:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-af711b1d-46d8-4414-82cb-5f268128b2b2 req-20b889ca-afa9-4552-8f8b-fb59e62d486d tempest-ServerActionsTestOtherA-1583977559 None] Acquiring lock "cinder-quobyte-94c58ff1-a7f5-4c32-9664-ce0425ceb324" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:44:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-af711b1d-46d8-4414-82cb-5f268128b2b2 req-20b889ca-afa9-4552-8f8b-fb59e62d486d tempest-ServerActionsTestOtherA-1583977559 None] Lock "cinder-quobyte-94c58ff1-a7f5-4c32-9664-ce0425ceb324" acquired by "delete_volume" :: waited 0.030s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:44:10 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[335f9ac6-7c12-4401-bfe8-da3b8f0521de]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:44:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-af711b1d-46d8-4414-82cb-5f268128b2b2 req-20b889ca-afa9-4552-8f8b-fb59e62d486d tempest-ServerActionsTestOtherA-1583977559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-94c58ff1-a7f5-4c32-9664-ce0425ceb324 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:44:11 devstack sudo[103944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-94c58ff1-a7f5-4c32-9664-ce0425ceb324 Aug 11 04:44:11 devstack sudo[103944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:44:11 devstack sudo[103944]: pam_unix(sudo:session): session closed for user root Aug 11 04:44:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-af711b1d-46d8-4414-82cb-5f268128b2b2 req-20b889ca-afa9-4552-8f8b-fb59e62d486d tempest-ServerActionsTestOtherA-1583977559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-94c58ff1-a7f5-4c32-9664-ce0425ceb324" returned: 0 in 0.728s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:44:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-af711b1d-46d8-4414-82cb-5f268128b2b2 req-20b889ca-afa9-4552-8f8b-fb59e62d486d tempest-ServerActionsTestOtherA-1583977559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-94c58ff1-a7f5-4c32-9664-ce0425ceb324 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:44:11 devstack sudo[103951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-94c58ff1-a7f5-4c32-9664-ce0425ceb324 Aug 11 04:44:11 devstack sudo[103951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:44:11 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-aff998d7-6155-4bb9-be72-081f2723dff3 tempest-VolumesTransfersV355Test-507484450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:44:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-aff998d7-6155-4bb9-be72-081f2723dff3 tempest-VolumesTransfersV355Test-507484450 None] Flow 'volume_create_manager' (6cc0882b-727f-439f-a3dd-59125a81bd7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:44:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-aff998d7-6155-4bb9-be72-081f2723dff3 tempest-VolumesTransfersV355Test-507484450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e243eb1-7509-4e90-a099-ec4a959a401c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:44:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-aff998d7-6155-4bb9-be72-081f2723dff3 tempest-VolumesTransfersV355Test-507484450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e243eb1-7509-4e90-a099-ec4a959a401c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:44:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-213918083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17ccfed7-8593-4578-9707-c8b4a0b8d19d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eab2de3f0d746c8abfb626a0a5f3407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:44:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:44:12Z,use_quota=True,user_id='3056df6f95c24cb39dae343f0c009e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:44:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-aff998d7-6155-4bb9-be72-081f2723dff3 tempest-VolumesTransfersV355Test-507484450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6e5aed0-a90f-4675-99a9-826e7b156fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:44:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-aff998d7-6155-4bb9-be72-081f2723dff3 tempest-VolumesTransfersV355Test-507484450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6e5aed0-a90f-4675-99a9-826e7b156fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:44:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-aff998d7-6155-4bb9-be72-081f2723dff3 tempest-VolumesTransfersV355Test-507484450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25b1661f-c684-476d-8569-c0aade0e8523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:44:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-aff998d7-6155-4bb9-be72-081f2723dff3 tempest-VolumesTransfersV355Test-507484450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25b1661f-c684-476d-8569-c0aade0e8523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17ccfed7-8593-4578-9707-c8b4a0b8d19d', 'volume_name': 'volume-17ccfed7-8593-4578-9707-c8b4a0b8d19d', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:44:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-aff998d7-6155-4bb9-be72-081f2723dff3 tempest-VolumesTransfersV355Test-507484450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (147f3901-9863-43b4-b903-fdf771083e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:44:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-aff998d7-6155-4bb9-be72-081f2723dff3 tempest-VolumesTransfersV355Test-507484450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (147f3901-9863-43b4-b903-fdf771083e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:44:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-aff998d7-6155-4bb9-be72-081f2723dff3 tempest-VolumesTransfersV355Test-507484450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (837defcc-d951-4f78-8dd4-d63a48e7bba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:44:11 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-aff998d7-6155-4bb9-be72-081f2723dff3 tempest-VolumesTransfersV355Test-507484450 None] Volume 17ccfed7-8593-4578-9707-c8b4a0b8d19d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17ccfed7-8593-4578-9707-c8b4a0b8d19d', 'volume_size': 1} Aug 11 04:44:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-aff998d7-6155-4bb9-be72-081f2723dff3 tempest-VolumesTransfersV355Test-507484450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:44:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-aff998d7-6155-4bb9-be72-081f2723dff3 tempest-VolumesTransfersV355Test-507484450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:44:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-aff998d7-6155-4bb9-be72-081f2723dff3 tempest-VolumesTransfersV355Test-507484450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:44:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-213918083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17ccfed7-8593-4578-9707-c8b4a0b8d19d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eab2de3f0d746c8abfb626a0a5f3407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:44:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:44:12Z,use_quota=True,user_id='3056df6f95c24cb39dae343f0c009e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:44:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-aff998d7-6155-4bb9-be72-081f2723dff3 tempest-VolumesTransfersV355Test-507484450 None] Creating volume 17ccfed7-8593-4578-9707-c8b4a0b8d19d {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:44:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-aff998d7-6155-4bb9-be72-081f2723dff3 tempest-VolumesTransfersV355Test-507484450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:44:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-aff998d7-6155-4bb9-be72-081f2723dff3 tempest-VolumesTransfersV355Test-507484450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:44:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-aff998d7-6155-4bb9-be72-081f2723dff3 tempest-VolumesTransfersV355Test-507484450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:44:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-aff998d7-6155-4bb9-be72-081f2723dff3 tempest-VolumesTransfersV355Test-507484450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:44:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-aff998d7-6155-4bb9-be72-081f2723dff3 tempest-VolumesTransfersV355Test-507484450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:44:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-aff998d7-6155-4bb9-be72-081f2723dff3 tempest-VolumesTransfersV355Test-507484450 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:44:11 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-aff998d7-6155-4bb9-be72-081f2723dff3 tempest-VolumesTransfersV355Test-507484450 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:44:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-aff998d7-6155-4bb9-be72-081f2723dff3 tempest-VolumesTransfersV355Test-507484450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17ccfed7-8593-4578-9707-c8b4a0b8d19d 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:44:11 devstack sudo[103953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17ccfed7-8593-4578-9707-c8b4a0b8d19d 1073741824 Aug 11 04:44:11 devstack sudo[103953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:44:12 devstack sudo[103951]: pam_unix(sudo:session): session closed for user root Aug 11 04:44:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-af711b1d-46d8-4414-82cb-5f268128b2b2 req-20b889ca-afa9-4552-8f8b-fb59e62d486d tempest-ServerActionsTestOtherA-1583977559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-94c58ff1-a7f5-4c32-9664-ce0425ceb324" returned: 0 in 0.321s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:44:12 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-af711b1d-46d8-4414-82cb-5f268128b2b2 req-20b889ca-afa9-4552-8f8b-fb59e62d486d tempest-ServerActionsTestOtherA-1583977559 None] Lock "cinder-quobyte-94c58ff1-a7f5-4c32-9664-ce0425ceb324" released by "delete_volume" :: held 1.118s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:44:12 devstack cinder-volume[94472]: DEBUG cinder.quota [req-af711b1d-46d8-4414-82cb-5f268128b2b2 req-20b889ca-afa9-4552-8f8b-fb59e62d486d tempest-ServerActionsTestOtherA-1583977559 None] Created reservations ['f8a7d650-9f29-427c-b850-a1b6b4d7b759', 'f48f95e6-97d9-4499-908f-f7d9ab128000', 'ec7c623d-8014-4915-9163-d2e98728a07c', '385b22d8-bf66-4a1a-8c72-a80ed980659f'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:44:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-af711b1d-46d8-4414-82cb-5f268128b2b2 req-20b889ca-afa9-4552-8f8b-fb59e62d486d tempest-ServerActionsTestOtherA-1583977559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:44:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-af711b1d-46d8-4414-82cb-5f268128b2b2 req-20b889ca-afa9-4552-8f8b-fb59e62d486d tempest-ServerActionsTestOtherA-1583977559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:44:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [req-af711b1d-46d8-4414-82cb-5f268128b2b2 req-20b889ca-afa9-4552-8f8b-fb59e62d486d tempest-ServerActionsTestOtherA-1583977559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:44:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [req-af711b1d-46d8-4414-82cb-5f268128b2b2 req-20b889ca-afa9-4552-8f8b-fb59e62d486d tempest-ServerActionsTestOtherA-1583977559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:44:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-af711b1d-46d8-4414-82cb-5f268128b2b2 req-20b889ca-afa9-4552-8f8b-fb59e62d486d tempest-ServerActionsTestOtherA-1583977559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:44:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-af711b1d-46d8-4414-82cb-5f268128b2b2 req-20b889ca-afa9-4552-8f8b-fb59e62d486d tempest-ServerActionsTestOtherA-1583977559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:44:12 devstack sudo[103958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:44:12 devstack sudo[103958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:44:12 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2a9d91ff-24a8-4298-95e6-32e5328be756 tempest-ServerActionsTestOtherA-1583977559 None] Acquiring lock "cinder-499eda1c-589a-4063-9f23-453e0c821c80-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:44:12 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2a9d91ff-24a8-4298-95e6-32e5328be756 tempest-ServerActionsTestOtherA-1583977559 None] Lock "cinder-499eda1c-589a-4063-9f23-453e0c821c80-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:44:12 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2a9d91ff-24a8-4298-95e6-32e5328be756 tempest-ServerActionsTestOtherA-1583977559 None] Acquiring lock "cinder-quobyte-499eda1c-589a-4063-9f23-453e0c821c80" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:44:12 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2a9d91ff-24a8-4298-95e6-32e5328be756 tempest-ServerActionsTestOtherA-1583977559 None] Lock "cinder-quobyte-499eda1c-589a-4063-9f23-453e0c821c80" acquired by "delete_volume" :: waited 0.029s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:44:12 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac0295c-2d81-4ecd-9cab-016b7e8f7467]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:44:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2a9d91ff-24a8-4298-95e6-32e5328be756 tempest-ServerActionsTestOtherA-1583977559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-499eda1c-589a-4063-9f23-453e0c821c80 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:44:12 devstack sudo[103953]: pam_unix(sudo:session): session closed for user root Aug 11 04:44:12 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-087fc862-e3ef-445c-96df-9089020e3f84 tempest-VolumesGetTest-667192801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:44:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-087fc862-e3ef-445c-96df-9089020e3f84 tempest-VolumesGetTest-667192801 None] Flow 'volume_create_manager' (5a064f7f-d6aa-4592-a324-1bc516fd97b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:44:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-087fc862-e3ef-445c-96df-9089020e3f84 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (841be10c-ee00-48d2-9261-fba03aa58082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:44:12 devstack sudo[103958]: pam_unix(sudo:session): session closed for user root Aug 11 04:44:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-aff998d7-6155-4bb9-be72-081f2723dff3 tempest-VolumesTransfersV355Test-507484450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17ccfed7-8593-4578-9707-c8b4a0b8d19d 1073741824" returned: 0 in 0.791s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:44:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-af711b1d-46d8-4414-82cb-5f268128b2b2 req-20b889ca-afa9-4552-8f8b-fb59e62d486d tempest-ServerActionsTestOtherA-1583977559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.445s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:44:12 devstack cinder-volume[94472]: DEBUG cinder.manager [req-af711b1d-46d8-4414-82cb-5f268128b2b2 req-20b889ca-afa9-4552-8f8b-fb59e62d486d tempest-ServerActionsTestOtherA-1583977559 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:44:12 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-af711b1d-46d8-4414-82cb-5f268128b2b2 req-20b889ca-afa9-4552-8f8b-fb59e62d486d tempest-ServerActionsTestOtherA-1583977559 None] Deleted volume successfully. Aug 11 04:44:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-087fc862-e3ef-445c-96df-9089020e3f84 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (841be10c-ee00-48d2-9261-fba03aa58082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:44:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1503823078',display_name='tempest-VolumesGetTest-Volume-1650900494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72b2db6a-14e4-4f43-a496-8f4d8fbd925e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4be18a68d5524857b2b7b1bf2e849c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:44:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:44:13Z,use_quota=True,user_id='885fd20bf9004603a4c318af0014813d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:44:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-087fc862-e3ef-445c-96df-9089020e3f84 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba18ea6a-83d1-45ed-856e-b180bfce40a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:44:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-087fc862-e3ef-445c-96df-9089020e3f84 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba18ea6a-83d1-45ed-856e-b180bfce40a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:44:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-087fc862-e3ef-445c-96df-9089020e3f84 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb7cb99a-0534-4425-b197-a20ce28c7c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:44:12 devstack sudo[103962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-499eda1c-589a-4063-9f23-453e0c821c80 Aug 11 04:44:12 devstack sudo[103962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:44:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-087fc862-e3ef-445c-96df-9089020e3f84 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb7cb99a-0534-4425-b197-a20ce28c7c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72b2db6a-14e4-4f43-a496-8f4d8fbd925e', 'volume_name': 'volume-72b2db6a-14e4-4f43-a496-8f4d8fbd925e', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:44:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-087fc862-e3ef-445c-96df-9089020e3f84 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d0a32fa-16b9-418a-92af-ba121fa60dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:44:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-087fc862-e3ef-445c-96df-9089020e3f84 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d0a32fa-16b9-418a-92af-ba121fa60dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:44:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-087fc862-e3ef-445c-96df-9089020e3f84 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21113157-e854-4019-bf64-a29966584290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:44:12 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-087fc862-e3ef-445c-96df-9089020e3f84 tempest-VolumesGetTest-667192801 None] Volume 72b2db6a-14e4-4f43-a496-8f4d8fbd925e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72b2db6a-14e4-4f43-a496-8f4d8fbd925e', 'volume_size': 1} Aug 11 04:44:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-087fc862-e3ef-445c-96df-9089020e3f84 tempest-VolumesGetTest-667192801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:44:12 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-af711b1d-46d8-4414-82cb-5f268128b2b2 req-20b889ca-afa9-4552-8f8b-fb59e62d486d tempest-ServerActionsTestOtherA-1583977559 None] Lock "cinder-94c58ff1-a7f5-4c32-9664-ce0425ceb324-delete_volume" released by "delete_volume" :: held 2.001s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:44:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-aff998d7-6155-4bb9-be72-081f2723dff3 tempest-VolumesTransfersV355Test-507484450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17ccfed7-8593-4578-9707-c8b4a0b8d19d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:44:12 devstack sudo[103966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17ccfed7-8593-4578-9707-c8b4a0b8d19d Aug 11 04:44:12 devstack sudo[103966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:44:13 devstack sudo[103962]: pam_unix(sudo:session): session closed for user root Aug 11 04:44:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2a9d91ff-24a8-4298-95e6-32e5328be756 tempest-ServerActionsTestOtherA-1583977559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-499eda1c-589a-4063-9f23-453e0c821c80" returned: 0 in 0.480s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:44:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2a9d91ff-24a8-4298-95e6-32e5328be756 tempest-ServerActionsTestOtherA-1583977559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-499eda1c-589a-4063-9f23-453e0c821c80 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:44:13 devstack sudo[103966]: pam_unix(sudo:session): session closed for user root Aug 11 04:44:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-aff998d7-6155-4bb9-be72-081f2723dff3 tempest-VolumesTransfersV355Test-507484450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17ccfed7-8593-4578-9707-c8b4a0b8d19d" returned: 0 in 0.270s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:44:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-aff998d7-6155-4bb9-be72-081f2723dff3 tempest-VolumesTransfersV355Test-507484450 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:44:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-aff998d7-6155-4bb9-be72-081f2723dff3 tempest-VolumesTransfersV355Test-507484450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:44:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-087fc862-e3ef-445c-96df-9089020e3f84 tempest-VolumesGetTest-667192801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.305s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:44:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-087fc862-e3ef-445c-96df-9089020e3f84 tempest-VolumesGetTest-667192801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:44:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1503823078',display_name='tempest-VolumesGetTest-Volume-1650900494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72b2db6a-14e4-4f43-a496-8f4d8fbd925e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4be18a68d5524857b2b7b1bf2e849c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:44:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:44:13Z,use_quota=True,user_id='885fd20bf9004603a4c318af0014813d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:44:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-087fc862-e3ef-445c-96df-9089020e3f84 tempest-VolumesGetTest-667192801 None] Creating volume 72b2db6a-14e4-4f43-a496-8f4d8fbd925e {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:44:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-087fc862-e3ef-445c-96df-9089020e3f84 tempest-VolumesGetTest-667192801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:44:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-087fc862-e3ef-445c-96df-9089020e3f84 tempest-VolumesGetTest-667192801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:44:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-087fc862-e3ef-445c-96df-9089020e3f84 tempest-VolumesGetTest-667192801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:44:13 devstack sudo[103972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-499eda1c-589a-4063-9f23-453e0c821c80 Aug 11 04:44:13 devstack sudo[103972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:44:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-087fc862-e3ef-445c-96df-9089020e3f84 tempest-VolumesGetTest-667192801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:44:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-087fc862-e3ef-445c-96df-9089020e3f84 tempest-VolumesGetTest-667192801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:44:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-087fc862-e3ef-445c-96df-9089020e3f84 tempest-VolumesGetTest-667192801 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:44:13 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-087fc862-e3ef-445c-96df-9089020e3f84 tempest-VolumesGetTest-667192801 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:44:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-087fc862-e3ef-445c-96df-9089020e3f84 tempest-VolumesGetTest-667192801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-72b2db6a-14e4-4f43-a496-8f4d8fbd925e 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:44:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-aff998d7-6155-4bb9-be72-081f2723dff3 tempest-VolumesTransfersV355Test-507484450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (837defcc-d951-4f78-8dd4-d63a48e7bba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17ccfed7-8593-4578-9707-c8b4a0b8d19d', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:44:13 devstack sudo[103974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-72b2db6a-14e4-4f43-a496-8f4d8fbd925e 1073741824 Aug 11 04:44:13 devstack sudo[103974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:44:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-aff998d7-6155-4bb9-be72-081f2723dff3 tempest-VolumesTransfersV355Test-507484450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afd4d0cc-94ce-4853-a3e2-15a9eef361f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:44:13 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-aff998d7-6155-4bb9-be72-081f2723dff3 tempest-VolumesTransfersV355Test-507484450 None] Volume volume-17ccfed7-8593-4578-9707-c8b4a0b8d19d (17ccfed7-8593-4578-9707-c8b4a0b8d19d): created successfully Aug 11 04:44:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-aff998d7-6155-4bb9-be72-081f2723dff3 tempest-VolumesTransfersV355Test-507484450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afd4d0cc-94ce-4853-a3e2-15a9eef361f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:44:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-aff998d7-6155-4bb9-be72-081f2723dff3 tempest-VolumesTransfersV355Test-507484450 None] Flow 'volume_create_manager' (6cc0882b-727f-439f-a3dd-59125a81bd7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:44:13 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-aff998d7-6155-4bb9-be72-081f2723dff3 tempest-VolumesTransfersV355Test-507484450 None] Created volume successfully. Aug 11 04:44:13 devstack sudo[103972]: pam_unix(sudo:session): session closed for user root Aug 11 04:44:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2a9d91ff-24a8-4298-95e6-32e5328be756 tempest-ServerActionsTestOtherA-1583977559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-499eda1c-589a-4063-9f23-453e0c821c80" returned: 0 in 0.275s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:44:13 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2a9d91ff-24a8-4298-95e6-32e5328be756 tempest-ServerActionsTestOtherA-1583977559 None] Lock "cinder-quobyte-499eda1c-589a-4063-9f23-453e0c821c80" released by "delete_volume" :: held 0.814s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:44:13 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-2a9d91ff-24a8-4298-95e6-32e5328be756 tempest-ServerActionsTestOtherA-1583977559 None] Created reservations ['915d46c1-56cf-4098-9b96-5dd601c5c1c2', '98f263e1-2cd6-48ad-aead-5eef0bab9857', '33a7e708-2e66-443f-87fd-a45c0cd88029', '56679f61-48ee-472c-9538-3ef0124a3b23'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:44:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2a9d91ff-24a8-4298-95e6-32e5328be756 tempest-ServerActionsTestOtherA-1583977559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:44:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2a9d91ff-24a8-4298-95e6-32e5328be756 tempest-ServerActionsTestOtherA-1583977559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:44:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2a9d91ff-24a8-4298-95e6-32e5328be756 tempest-ServerActionsTestOtherA-1583977559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:44:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2a9d91ff-24a8-4298-95e6-32e5328be756 tempest-ServerActionsTestOtherA-1583977559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:44:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2a9d91ff-24a8-4298-95e6-32e5328be756 tempest-ServerActionsTestOtherA-1583977559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:44:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2a9d91ff-24a8-4298-95e6-32e5328be756 tempest-ServerActionsTestOtherA-1583977559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:44:13 devstack sudo[103981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:44:13 devstack sudo[103981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:44:13 devstack sudo[103974]: pam_unix(sudo:session): session closed for user root Aug 11 04:44:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-087fc862-e3ef-445c-96df-9089020e3f84 tempest-VolumesGetTest-667192801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-72b2db6a-14e4-4f43-a496-8f4d8fbd925e 1073741824" returned: 0 in 0.562s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:44:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-087fc862-e3ef-445c-96df-9089020e3f84 tempest-VolumesGetTest-667192801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-72b2db6a-14e4-4f43-a496-8f4d8fbd925e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:44:13 devstack sudo[103984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-72b2db6a-14e4-4f43-a496-8f4d8fbd925e Aug 11 04:44:13 devstack sudo[103984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:44:13 devstack sudo[103981]: pam_unix(sudo:session): session closed for user root Aug 11 04:44:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2a9d91ff-24a8-4298-95e6-32e5328be756 tempest-ServerActionsTestOtherA-1583977559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.421s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:44:13 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-2a9d91ff-24a8-4298-95e6-32e5328be756 tempest-ServerActionsTestOtherA-1583977559 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:44:13 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-2a9d91ff-24a8-4298-95e6-32e5328be756 tempest-ServerActionsTestOtherA-1583977559 None] Deleted volume successfully. Aug 11 04:44:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2a9d91ff-24a8-4298-95e6-32e5328be756 tempest-ServerActionsTestOtherA-1583977559 None] Lock "cinder-499eda1c-589a-4063-9f23-453e0c821c80-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:44:14 devstack sudo[103984]: pam_unix(sudo:session): session closed for user root Aug 11 04:44:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-087fc862-e3ef-445c-96df-9089020e3f84 tempest-VolumesGetTest-667192801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-72b2db6a-14e4-4f43-a496-8f4d8fbd925e" returned: 0 in 0.528s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:44:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-087fc862-e3ef-445c-96df-9089020e3f84 tempest-VolumesGetTest-667192801 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:44:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-087fc862-e3ef-445c-96df-9089020e3f84 tempest-VolumesGetTest-667192801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:44:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-087fc862-e3ef-445c-96df-9089020e3f84 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21113157-e854-4019-bf64-a29966584290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72b2db6a-14e4-4f43-a496-8f4d8fbd925e', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:44:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-087fc862-e3ef-445c-96df-9089020e3f84 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43bf6d8d-680d-46bc-ae7d-6191f78b9c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:44:14 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-087fc862-e3ef-445c-96df-9089020e3f84 tempest-VolumesGetTest-667192801 None] Volume volume-72b2db6a-14e4-4f43-a496-8f4d8fbd925e (72b2db6a-14e4-4f43-a496-8f4d8fbd925e): created successfully Aug 11 04:44:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-087fc862-e3ef-445c-96df-9089020e3f84 tempest-VolumesGetTest-667192801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43bf6d8d-680d-46bc-ae7d-6191f78b9c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:44:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-087fc862-e3ef-445c-96df-9089020e3f84 tempest-VolumesGetTest-667192801 None] Flow 'volume_create_manager' (5a064f7f-d6aa-4592-a324-1bc516fd97b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:44:14 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-087fc862-e3ef-445c-96df-9089020e3f84 tempest-VolumesGetTest-667192801 None] Created volume successfully. Aug 11 04:44:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c810d397-ca60-40e7-8a6c-1b15be282301 tempest-VolumesGetTest-667192801 None] Acquiring lock "cinder-72b2db6a-14e4-4f43-a496-8f4d8fbd925e-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:44:15 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c810d397-ca60-40e7-8a6c-1b15be282301 tempest-VolumesGetTest-667192801 None] Lock "cinder-72b2db6a-14e4-4f43-a496-8f4d8fbd925e-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:44:15 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c810d397-ca60-40e7-8a6c-1b15be282301 tempest-VolumesGetTest-667192801 None] Acquiring lock "cinder-quobyte-72b2db6a-14e4-4f43-a496-8f4d8fbd925e" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:44:15 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c810d397-ca60-40e7-8a6c-1b15be282301 tempest-VolumesGetTest-667192801 None] Lock "cinder-quobyte-72b2db6a-14e4-4f43-a496-8f4d8fbd925e" acquired by "delete_volume" :: waited 0.030s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:44:15 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76ce097-b973-4f48-a515-64e5c4326019]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:44:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c810d397-ca60-40e7-8a6c-1b15be282301 tempest-VolumesGetTest-667192801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-72b2db6a-14e4-4f43-a496-8f4d8fbd925e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:44:15 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-b49e2120-56be-43df-9d1f-7b406e080e18 tempest-VolumesTransfersV355Test-1270610774 None] Transfer volume completed successfully. Aug 11 04:44:15 devstack sudo[104013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-72b2db6a-14e4-4f43-a496-8f4d8fbd925e Aug 11 04:44:15 devstack sudo[104013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:44:15 devstack sudo[104013]: pam_unix(sudo:session): session closed for user root Aug 11 04:44:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c810d397-ca60-40e7-8a6c-1b15be282301 tempest-VolumesGetTest-667192801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-72b2db6a-14e4-4f43-a496-8f4d8fbd925e" returned: 0 in 0.582s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:44:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c810d397-ca60-40e7-8a6c-1b15be282301 tempest-VolumesGetTest-667192801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-72b2db6a-14e4-4f43-a496-8f4d8fbd925e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:44:15 devstack sudo[104018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-72b2db6a-14e4-4f43-a496-8f4d8fbd925e Aug 11 04:44:15 devstack sudo[104018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:44:16 devstack sudo[104018]: pam_unix(sudo:session): session closed for user root Aug 11 04:44:16 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-709c82b9-c4be-424f-bc01-5896472642c2 tempest-VolumesTransfersV355Test-444086052 None] Acquiring lock "cinder-17ccfed7-8593-4578-9707-c8b4a0b8d19d-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:44:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c810d397-ca60-40e7-8a6c-1b15be282301 tempest-VolumesGetTest-667192801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-72b2db6a-14e4-4f43-a496-8f4d8fbd925e" returned: 0 in 0.506s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:44:16 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c810d397-ca60-40e7-8a6c-1b15be282301 tempest-VolumesGetTest-667192801 None] Lock "cinder-quobyte-72b2db6a-14e4-4f43-a496-8f4d8fbd925e" released by "delete_volume" :: held 1.167s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:44:16 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-709c82b9-c4be-424f-bc01-5896472642c2 tempest-VolumesTransfersV355Test-444086052 None] Lock "cinder-17ccfed7-8593-4578-9707-c8b4a0b8d19d-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:44:16 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-709c82b9-c4be-424f-bc01-5896472642c2 tempest-VolumesTransfersV355Test-444086052 None] Acquiring lock "cinder-quobyte-17ccfed7-8593-4578-9707-c8b4a0b8d19d" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:44:16 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-709c82b9-c4be-424f-bc01-5896472642c2 tempest-VolumesTransfersV355Test-444086052 None] Lock "cinder-quobyte-17ccfed7-8593-4578-9707-c8b4a0b8d19d" acquired by "delete_volume" :: waited 0.026s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:44:16 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-c810d397-ca60-40e7-8a6c-1b15be282301 tempest-VolumesGetTest-667192801 None] Created reservations ['3df285fc-a882-4368-8951-39f7e14d3f75', 'eea24e54-dc8d-425c-8f4c-0bef904f8999', '03836768-951d-4478-b163-068db07f7172', '38fea76a-4df7-4da2-a66a-92a2b0f6c48f'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:44:16 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6036f6b-c5fb-4565-a04a-96a94fecadcf]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:44:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-709c82b9-c4be-424f-bc01-5896472642c2 tempest-VolumesTransfersV355Test-444086052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17ccfed7-8593-4578-9707-c8b4a0b8d19d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:44:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c810d397-ca60-40e7-8a6c-1b15be282301 tempest-VolumesGetTest-667192801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:44:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c810d397-ca60-40e7-8a6c-1b15be282301 tempest-VolumesGetTest-667192801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:44:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c810d397-ca60-40e7-8a6c-1b15be282301 tempest-VolumesGetTest-667192801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:44:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c810d397-ca60-40e7-8a6c-1b15be282301 tempest-VolumesGetTest-667192801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:44:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c810d397-ca60-40e7-8a6c-1b15be282301 tempest-VolumesGetTest-667192801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:44:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c810d397-ca60-40e7-8a6c-1b15be282301 tempest-VolumesGetTest-667192801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:44:16 devstack sudo[104023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17ccfed7-8593-4578-9707-c8b4a0b8d19d Aug 11 04:44:16 devstack sudo[104024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:44:16 devstack sudo[104023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:44:16 devstack sudo[104024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:44:16 devstack sudo[104024]: pam_unix(sudo:session): session closed for user root Aug 11 04:44:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c810d397-ca60-40e7-8a6c-1b15be282301 tempest-VolumesGetTest-667192801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.307s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:44:16 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-c810d397-ca60-40e7-8a6c-1b15be282301 tempest-VolumesGetTest-667192801 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:44:16 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-c810d397-ca60-40e7-8a6c-1b15be282301 tempest-VolumesGetTest-667192801 None] Deleted volume successfully. Aug 11 04:44:16 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c810d397-ca60-40e7-8a6c-1b15be282301 tempest-VolumesGetTest-667192801 None] Lock "cinder-72b2db6a-14e4-4f43-a496-8f4d8fbd925e-delete_volume" released by "delete_volume" :: held 1.920s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:44:17 devstack sudo[104023]: pam_unix(sudo:session): session closed for user root Aug 11 04:44:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-709c82b9-c4be-424f-bc01-5896472642c2 tempest-VolumesTransfersV355Test-444086052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17ccfed7-8593-4578-9707-c8b4a0b8d19d" returned: 0 in 0.527s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:44:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-709c82b9-c4be-424f-bc01-5896472642c2 tempest-VolumesTransfersV355Test-444086052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17ccfed7-8593-4578-9707-c8b4a0b8d19d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:44:17 devstack sudo[104031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17ccfed7-8593-4578-9707-c8b4a0b8d19d Aug 11 04:44:17 devstack sudo[104031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:44:17 devstack sudo[104031]: pam_unix(sudo:session): session closed for user root Aug 11 04:44:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-709c82b9-c4be-424f-bc01-5896472642c2 tempest-VolumesTransfersV355Test-444086052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17ccfed7-8593-4578-9707-c8b4a0b8d19d" returned: 0 in 0.307s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:44:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-709c82b9-c4be-424f-bc01-5896472642c2 tempest-VolumesTransfersV355Test-444086052 None] Lock "cinder-quobyte-17ccfed7-8593-4578-9707-c8b4a0b8d19d" released by "delete_volume" :: held 0.892s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:44:17 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-709c82b9-c4be-424f-bc01-5896472642c2 tempest-VolumesTransfersV355Test-444086052 None] Created reservations ['7e33d0be-ff76-4493-b056-7fe1d11f06c4', 'd3def1be-04b9-4dfb-8368-73a8fe785592', 'b94fea37-1b80-4de3-87d6-801d6e2726cc', '1413a561-5282-45a1-940c-5c4bc53201b5'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:44:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-52127f86-8c28-4d31-b0b9-61910333a2db tempest-VolumesGetTest-667192801 None] Acquiring lock "cinder-1ce81a25-f4aa-4e60-8fb1-2e22ecb8cd23-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:44:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-52127f86-8c28-4d31-b0b9-61910333a2db tempest-VolumesGetTest-667192801 None] Lock "cinder-1ce81a25-f4aa-4e60-8fb1-2e22ecb8cd23-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:44:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-709c82b9-c4be-424f-bc01-5896472642c2 tempest-VolumesTransfersV355Test-444086052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:44:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-709c82b9-c4be-424f-bc01-5896472642c2 tempest-VolumesTransfersV355Test-444086052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:44:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-709c82b9-c4be-424f-bc01-5896472642c2 tempest-VolumesTransfersV355Test-444086052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:44:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-709c82b9-c4be-424f-bc01-5896472642c2 tempest-VolumesTransfersV355Test-444086052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:44:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-709c82b9-c4be-424f-bc01-5896472642c2 tempest-VolumesTransfersV355Test-444086052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:44:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-709c82b9-c4be-424f-bc01-5896472642c2 tempest-VolumesTransfersV355Test-444086052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:44:17 devstack sudo[104034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:44:17 devstack sudo[104034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:44:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-52127f86-8c28-4d31-b0b9-61910333a2db tempest-VolumesGetTest-667192801 None] Acquiring lock "cinder-quobyte-1ce81a25-f4aa-4e60-8fb1-2e22ecb8cd23" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:44:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-52127f86-8c28-4d31-b0b9-61910333a2db tempest-VolumesGetTest-667192801 None] Lock "cinder-quobyte-1ce81a25-f4aa-4e60-8fb1-2e22ecb8cd23" acquired by "delete_volume" :: waited 0.025s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:44:17 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a9877d-e37c-4ca7-b921-27254e12f4a6]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:44:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-52127f86-8c28-4d31-b0b9-61910333a2db tempest-VolumesGetTest-667192801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1ce81a25-f4aa-4e60-8fb1-2e22ecb8cd23 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:44:17 devstack sudo[104036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1ce81a25-f4aa-4e60-8fb1-2e22ecb8cd23 Aug 11 04:44:17 devstack sudo[104036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:44:17 devstack sudo[104034]: pam_unix(sudo:session): session closed for user root Aug 11 04:44:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-709c82b9-c4be-424f-bc01-5896472642c2 tempest-VolumesTransfersV355Test-444086052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.262s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:44:17 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-709c82b9-c4be-424f-bc01-5896472642c2 tempest-VolumesTransfersV355Test-444086052 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:44:17 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-709c82b9-c4be-424f-bc01-5896472642c2 tempest-VolumesTransfersV355Test-444086052 None] Deleted volume successfully. Aug 11 04:44:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-709c82b9-c4be-424f-bc01-5896472642c2 tempest-VolumesTransfersV355Test-444086052 None] Lock "cinder-17ccfed7-8593-4578-9707-c8b4a0b8d19d-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:44:18 devstack sudo[104036]: pam_unix(sudo:session): session closed for user root Aug 11 04:44:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-52127f86-8c28-4d31-b0b9-61910333a2db tempest-VolumesGetTest-667192801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1ce81a25-f4aa-4e60-8fb1-2e22ecb8cd23" returned: 0 in 0.471s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:44:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-52127f86-8c28-4d31-b0b9-61910333a2db tempest-VolumesGetTest-667192801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1ce81a25-f4aa-4e60-8fb1-2e22ecb8cd23 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:44:18 devstack sudo[104042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1ce81a25-f4aa-4e60-8fb1-2e22ecb8cd23 Aug 11 04:44:18 devstack sudo[104042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:44:18 devstack sudo[104042]: pam_unix(sudo:session): session closed for user root Aug 11 04:44:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-52127f86-8c28-4d31-b0b9-61910333a2db tempest-VolumesGetTest-667192801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1ce81a25-f4aa-4e60-8fb1-2e22ecb8cd23" returned: 0 in 0.275s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:44:18 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-52127f86-8c28-4d31-b0b9-61910333a2db tempest-VolumesGetTest-667192801 None] Lock "cinder-quobyte-1ce81a25-f4aa-4e60-8fb1-2e22ecb8cd23" released by "delete_volume" :: held 0.808s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:44:18 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-52127f86-8c28-4d31-b0b9-61910333a2db tempest-VolumesGetTest-667192801 None] Created reservations ['7a934b42-7be7-48b2-be92-642e9ff85980', 'e5a26832-4291-477b-a5c1-7356381aea64', '699acdd8-0917-4d66-9304-08d76d89f680', '945dbf76-0907-42f4-bded-eb06346c72a5'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:44:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-52127f86-8c28-4d31-b0b9-61910333a2db tempest-VolumesGetTest-667192801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:44:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-52127f86-8c28-4d31-b0b9-61910333a2db tempest-VolumesGetTest-667192801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:44:18 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-52127f86-8c28-4d31-b0b9-61910333a2db tempest-VolumesGetTest-667192801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:44:18 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-52127f86-8c28-4d31-b0b9-61910333a2db tempest-VolumesGetTest-667192801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:44:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-52127f86-8c28-4d31-b0b9-61910333a2db tempest-VolumesGetTest-667192801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:44:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-52127f86-8c28-4d31-b0b9-61910333a2db tempest-VolumesGetTest-667192801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:44:18 devstack sudo[104045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:44:18 devstack sudo[104045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:44:18 devstack sudo[104045]: pam_unix(sudo:session): session closed for user root Aug 11 04:44:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-52127f86-8c28-4d31-b0b9-61910333a2db tempest-VolumesGetTest-667192801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.329s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:44:18 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-52127f86-8c28-4d31-b0b9-61910333a2db tempest-VolumesGetTest-667192801 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:44:18 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-52127f86-8c28-4d31-b0b9-61910333a2db tempest-VolumesGetTest-667192801 None] Deleted volume successfully. Aug 11 04:44:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-52127f86-8c28-4d31-b0b9-61910333a2db tempest-VolumesGetTest-667192801 None] Lock "cinder-1ce81a25-f4aa-4e60-8fb1-2e22ecb8cd23-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:44:19 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-3396ce37-b728-4907-84dd-ecfcf2c20bd5 tempest-VolumesTransfersV355Test-507484450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:44:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3396ce37-b728-4907-84dd-ecfcf2c20bd5 tempest-VolumesTransfersV355Test-507484450 None] Flow 'volume_create_manager' (be4381d0-ad92-4b43-bd26-5f061345c7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:44:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3396ce37-b728-4907-84dd-ecfcf2c20bd5 tempest-VolumesTransfersV355Test-507484450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45df5914-58d8-4fbd-bb63-555df412d485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:44:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3396ce37-b728-4907-84dd-ecfcf2c20bd5 tempest-VolumesTransfersV355Test-507484450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45df5914-58d8-4fbd-bb63-555df412d485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:44:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-899762830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8507ded-07f6-430d-994b-6e8311b17c19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eab2de3f0d746c8abfb626a0a5f3407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:44:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:44:19Z,use_quota=True,user_id='3056df6f95c24cb39dae343f0c009e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:44:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3396ce37-b728-4907-84dd-ecfcf2c20bd5 tempest-VolumesTransfersV355Test-507484450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d8d7baf-59ac-4269-b2dc-16ba9927548b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:44:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3396ce37-b728-4907-84dd-ecfcf2c20bd5 tempest-VolumesTransfersV355Test-507484450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d8d7baf-59ac-4269-b2dc-16ba9927548b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:44:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3396ce37-b728-4907-84dd-ecfcf2c20bd5 tempest-VolumesTransfersV355Test-507484450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42b28512-e9e7-4586-a78a-fc4d85c3d4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:44:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3396ce37-b728-4907-84dd-ecfcf2c20bd5 tempest-VolumesTransfersV355Test-507484450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42b28512-e9e7-4586-a78a-fc4d85c3d4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8507ded-07f6-430d-994b-6e8311b17c19', 'volume_name': 'volume-e8507ded-07f6-430d-994b-6e8311b17c19', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:44:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3396ce37-b728-4907-84dd-ecfcf2c20bd5 tempest-VolumesTransfersV355Test-507484450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b046b7d8-5f79-447d-a864-e8aff1f40bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:44:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3396ce37-b728-4907-84dd-ecfcf2c20bd5 tempest-VolumesTransfersV355Test-507484450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b046b7d8-5f79-447d-a864-e8aff1f40bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:44:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3396ce37-b728-4907-84dd-ecfcf2c20bd5 tempest-VolumesTransfersV355Test-507484450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fb6b7c0-262a-42e5-ad7a-16f67d53629a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:44:19 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-3396ce37-b728-4907-84dd-ecfcf2c20bd5 tempest-VolumesTransfersV355Test-507484450 None] Volume e8507ded-07f6-430d-994b-6e8311b17c19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8507ded-07f6-430d-994b-6e8311b17c19', 'volume_size': 1} Aug 11 04:44:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3396ce37-b728-4907-84dd-ecfcf2c20bd5 tempest-VolumesTransfersV355Test-507484450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:44:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3396ce37-b728-4907-84dd-ecfcf2c20bd5 tempest-VolumesTransfersV355Test-507484450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:44:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3396ce37-b728-4907-84dd-ecfcf2c20bd5 tempest-VolumesTransfersV355Test-507484450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:44:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-899762830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8507ded-07f6-430d-994b-6e8311b17c19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eab2de3f0d746c8abfb626a0a5f3407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:44:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:44:19Z,use_quota=True,user_id='3056df6f95c24cb39dae343f0c009e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:44:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-3396ce37-b728-4907-84dd-ecfcf2c20bd5 tempest-VolumesTransfersV355Test-507484450 None] Creating volume e8507ded-07f6-430d-994b-6e8311b17c19 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:44:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3396ce37-b728-4907-84dd-ecfcf2c20bd5 tempest-VolumesTransfersV355Test-507484450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:44:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3396ce37-b728-4907-84dd-ecfcf2c20bd5 tempest-VolumesTransfersV355Test-507484450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:44:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3396ce37-b728-4907-84dd-ecfcf2c20bd5 tempest-VolumesTransfersV355Test-507484450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:44:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3396ce37-b728-4907-84dd-ecfcf2c20bd5 tempest-VolumesTransfersV355Test-507484450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:44:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3396ce37-b728-4907-84dd-ecfcf2c20bd5 tempest-VolumesTransfersV355Test-507484450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:44:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3396ce37-b728-4907-84dd-ecfcf2c20bd5 tempest-VolumesTransfersV355Test-507484450 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:44:19 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-3396ce37-b728-4907-84dd-ecfcf2c20bd5 tempest-VolumesTransfersV355Test-507484450 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:44:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3396ce37-b728-4907-84dd-ecfcf2c20bd5 tempest-VolumesTransfersV355Test-507484450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e8507ded-07f6-430d-994b-6e8311b17c19 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:44:19 devstack sudo[104048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e8507ded-07f6-430d-994b-6e8311b17c19 1073741824 Aug 11 04:44:19 devstack sudo[104048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:44:20 devstack sudo[104048]: pam_unix(sudo:session): session closed for user root Aug 11 04:44:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3396ce37-b728-4907-84dd-ecfcf2c20bd5 tempest-VolumesTransfersV355Test-507484450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e8507ded-07f6-430d-994b-6e8311b17c19 1073741824" returned: 0 in 0.573s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:44:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3396ce37-b728-4907-84dd-ecfcf2c20bd5 tempest-VolumesTransfersV355Test-507484450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e8507ded-07f6-430d-994b-6e8311b17c19 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:44:20 devstack sudo[104054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e8507ded-07f6-430d-994b-6e8311b17c19 Aug 11 04:44:20 devstack sudo[104054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:44:20 devstack sudo[104054]: pam_unix(sudo:session): session closed for user root Aug 11 04:44:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3396ce37-b728-4907-84dd-ecfcf2c20bd5 tempest-VolumesTransfersV355Test-507484450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e8507ded-07f6-430d-994b-6e8311b17c19" returned: 0 in 0.309s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:44:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3396ce37-b728-4907-84dd-ecfcf2c20bd5 tempest-VolumesTransfersV355Test-507484450 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:44:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3396ce37-b728-4907-84dd-ecfcf2c20bd5 tempest-VolumesTransfersV355Test-507484450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:44:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3396ce37-b728-4907-84dd-ecfcf2c20bd5 tempest-VolumesTransfersV355Test-507484450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fb6b7c0-262a-42e5-ad7a-16f67d53629a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8507ded-07f6-430d-994b-6e8311b17c19', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:44:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3396ce37-b728-4907-84dd-ecfcf2c20bd5 tempest-VolumesTransfersV355Test-507484450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b99a00c5-e208-4bb0-9792-02062ff6321d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:44:20 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-3396ce37-b728-4907-84dd-ecfcf2c20bd5 tempest-VolumesTransfersV355Test-507484450 None] Volume volume-e8507ded-07f6-430d-994b-6e8311b17c19 (e8507ded-07f6-430d-994b-6e8311b17c19): created successfully Aug 11 04:44:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3396ce37-b728-4907-84dd-ecfcf2c20bd5 tempest-VolumesTransfersV355Test-507484450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b99a00c5-e208-4bb0-9792-02062ff6321d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:44:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3396ce37-b728-4907-84dd-ecfcf2c20bd5 tempest-VolumesTransfersV355Test-507484450 None] Flow 'volume_create_manager' (be4381d0-ad92-4b43-bd26-5f061345c7d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:44:20 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-3396ce37-b728-4907-84dd-ecfcf2c20bd5 tempest-VolumesTransfersV355Test-507484450 None] Created volume successfully. Aug 11 04:44:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e62a5c01-1ed8-43d8-a634-0140d1aa577c tempest-VolumesTransfersV355Test-444086052 None] Acquiring lock "cinder-e8507ded-07f6-430d-994b-6e8311b17c19-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:44:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e62a5c01-1ed8-43d8-a634-0140d1aa577c tempest-VolumesTransfersV355Test-444086052 None] Lock "cinder-e8507ded-07f6-430d-994b-6e8311b17c19-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:44:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e62a5c01-1ed8-43d8-a634-0140d1aa577c tempest-VolumesTransfersV355Test-444086052 None] Acquiring lock "cinder-quobyte-e8507ded-07f6-430d-994b-6e8311b17c19" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:44:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e62a5c01-1ed8-43d8-a634-0140d1aa577c tempest-VolumesTransfersV355Test-444086052 None] Lock "cinder-quobyte-e8507ded-07f6-430d-994b-6e8311b17c19" acquired by "delete_volume" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:44:21 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a82ff3-9e47-445d-950c-8ad241ccde08]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:44:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e62a5c01-1ed8-43d8-a634-0140d1aa577c tempest-VolumesTransfersV355Test-444086052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e8507ded-07f6-430d-994b-6e8311b17c19 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:44:22 devstack sudo[104058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e8507ded-07f6-430d-994b-6e8311b17c19 Aug 11 04:44:22 devstack sudo[104058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:44:22 devstack sudo[104058]: pam_unix(sudo:session): session closed for user root Aug 11 04:44:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e62a5c01-1ed8-43d8-a634-0140d1aa577c tempest-VolumesTransfersV355Test-444086052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e8507ded-07f6-430d-994b-6e8311b17c19" returned: 0 in 0.449s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:44:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e62a5c01-1ed8-43d8-a634-0140d1aa577c tempest-VolumesTransfersV355Test-444086052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e8507ded-07f6-430d-994b-6e8311b17c19 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:44:22 devstack sudo[104064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e8507ded-07f6-430d-994b-6e8311b17c19 Aug 11 04:44:22 devstack sudo[104064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:44:22 devstack sudo[104064]: pam_unix(sudo:session): session closed for user root Aug 11 04:44:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e62a5c01-1ed8-43d8-a634-0140d1aa577c tempest-VolumesTransfersV355Test-444086052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e8507ded-07f6-430d-994b-6e8311b17c19" returned: 0 in 0.294s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:44:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e62a5c01-1ed8-43d8-a634-0140d1aa577c tempest-VolumesTransfersV355Test-444086052 None] Lock "cinder-quobyte-e8507ded-07f6-430d-994b-6e8311b17c19" released by "delete_volume" :: held 0.802s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:44:22 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=171,cinder:UPDATE=197,cinder:DELETE=18,cinder:INSERT=54 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:44:22 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-e62a5c01-1ed8-43d8-a634-0140d1aa577c tempest-VolumesTransfersV355Test-444086052 None] Created reservations ['2d268db4-2ea1-47bc-ac3b-7fd8e0eea8af', '27ebbf0c-57fd-4d71-8321-182879fa4741', '6452a2b8-5839-4028-9a81-19df90f05122', '4f993c13-e65a-4f0e-a5d6-bd4926042dfe'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:44:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e62a5c01-1ed8-43d8-a634-0140d1aa577c tempest-VolumesTransfersV355Test-444086052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:44:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e62a5c01-1ed8-43d8-a634-0140d1aa577c tempest-VolumesTransfersV355Test-444086052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:44:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e62a5c01-1ed8-43d8-a634-0140d1aa577c tempest-VolumesTransfersV355Test-444086052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:44:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e62a5c01-1ed8-43d8-a634-0140d1aa577c tempest-VolumesTransfersV355Test-444086052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:44:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e62a5c01-1ed8-43d8-a634-0140d1aa577c tempest-VolumesTransfersV355Test-444086052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:44:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e62a5c01-1ed8-43d8-a634-0140d1aa577c tempest-VolumesTransfersV355Test-444086052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:44:22 devstack sudo[104068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:44:22 devstack sudo[104068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:44:23 devstack sudo[104068]: pam_unix(sudo:session): session closed for user root Aug 11 04:44:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e62a5c01-1ed8-43d8-a634-0140d1aa577c tempest-VolumesTransfersV355Test-444086052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.269s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:44:23 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-e62a5c01-1ed8-43d8-a634-0140d1aa577c tempest-VolumesTransfersV355Test-444086052 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:44:23 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-e62a5c01-1ed8-43d8-a634-0140d1aa577c tempest-VolumesTransfersV355Test-444086052 None] Deleted volume successfully. Aug 11 04:44:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e62a5c01-1ed8-43d8-a634-0140d1aa577c tempest-VolumesTransfersV355Test-444086052 None] Lock "cinder-e8507ded-07f6-430d-994b-6e8311b17c19-delete_volume" released by "delete_volume" :: held 1.345s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:44:32 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=125,cinder:UPDATE=201,cinder:DELETE=14,cinder:INSERT=54 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:44:33 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:UPDATE=6,cinder:SELECT=1,cinder:DELETE=1 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:44:56 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-a73a957c-44a1-4058-a2f6-7f1dd18f945c tempest-VolumesActionsTest-99843155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:44:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a73a957c-44a1-4058-a2f6-7f1dd18f945c tempest-VolumesActionsTest-99843155 None] Flow 'volume_create_manager' (6cb9629c-a74f-454c-8416-1a81e8504bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:44:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a73a957c-44a1-4058-a2f6-7f1dd18f945c tempest-VolumesActionsTest-99843155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39a1a736-7f28-4171-84d0-4766303842b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:44:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a73a957c-44a1-4058-a2f6-7f1dd18f945c tempest-VolumesActionsTest-99843155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39a1a736-7f28-4171-84d0-4766303842b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:44:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1345902295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=685ffaeb-bf6c-46be-8fdd-4e856d53622a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71dde17ed367434aa9fdc5ae5add0186',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:44:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:44:57Z,use_quota=True,user_id='2dc64214e0a7446db604e458fd19c05a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:44:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a73a957c-44a1-4058-a2f6-7f1dd18f945c tempest-VolumesActionsTest-99843155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bc467ac-ed69-48fe-84fe-826e19927cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:44:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a73a957c-44a1-4058-a2f6-7f1dd18f945c tempest-VolumesActionsTest-99843155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bc467ac-ed69-48fe-84fe-826e19927cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:44:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a73a957c-44a1-4058-a2f6-7f1dd18f945c tempest-VolumesActionsTest-99843155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e67185c0-e3b9-413f-a9d7-b26f1b18a30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:44:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a73a957c-44a1-4058-a2f6-7f1dd18f945c tempest-VolumesActionsTest-99843155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e67185c0-e3b9-413f-a9d7-b26f1b18a30b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '685ffaeb-bf6c-46be-8fdd-4e856d53622a', 'volume_name': 'volume-685ffaeb-bf6c-46be-8fdd-4e856d53622a', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:44:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a73a957c-44a1-4058-a2f6-7f1dd18f945c tempest-VolumesActionsTest-99843155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bbaee6d-ae10-4ef7-9566-36ea7a848caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:44:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a73a957c-44a1-4058-a2f6-7f1dd18f945c tempest-VolumesActionsTest-99843155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bbaee6d-ae10-4ef7-9566-36ea7a848caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:44:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a73a957c-44a1-4058-a2f6-7f1dd18f945c tempest-VolumesActionsTest-99843155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (236545dd-17c7-4b66-bb22-9a19d9078c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:44:57 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-a73a957c-44a1-4058-a2f6-7f1dd18f945c tempest-VolumesActionsTest-99843155 None] Volume 685ffaeb-bf6c-46be-8fdd-4e856d53622a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-685ffaeb-bf6c-46be-8fdd-4e856d53622a', 'volume_size': 1} Aug 11 04:44:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a73a957c-44a1-4058-a2f6-7f1dd18f945c tempest-VolumesActionsTest-99843155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:44:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a73a957c-44a1-4058-a2f6-7f1dd18f945c tempest-VolumesActionsTest-99843155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:44:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a73a957c-44a1-4058-a2f6-7f1dd18f945c tempest-VolumesActionsTest-99843155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:44:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1345902295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=685ffaeb-bf6c-46be-8fdd-4e856d53622a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71dde17ed367434aa9fdc5ae5add0186',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:44:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:44:57Z,use_quota=True,user_id='2dc64214e0a7446db604e458fd19c05a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:44:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-a73a957c-44a1-4058-a2f6-7f1dd18f945c tempest-VolumesActionsTest-99843155 None] Creating volume 685ffaeb-bf6c-46be-8fdd-4e856d53622a {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:44:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a73a957c-44a1-4058-a2f6-7f1dd18f945c tempest-VolumesActionsTest-99843155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:44:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a73a957c-44a1-4058-a2f6-7f1dd18f945c tempest-VolumesActionsTest-99843155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:44:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a73a957c-44a1-4058-a2f6-7f1dd18f945c tempest-VolumesActionsTest-99843155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:44:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a73a957c-44a1-4058-a2f6-7f1dd18f945c tempest-VolumesActionsTest-99843155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:44:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a73a957c-44a1-4058-a2f6-7f1dd18f945c tempest-VolumesActionsTest-99843155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:44:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a73a957c-44a1-4058-a2f6-7f1dd18f945c tempest-VolumesActionsTest-99843155 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:44:57 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-a73a957c-44a1-4058-a2f6-7f1dd18f945c tempest-VolumesActionsTest-99843155 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:44:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a73a957c-44a1-4058-a2f6-7f1dd18f945c tempest-VolumesActionsTest-99843155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-685ffaeb-bf6c-46be-8fdd-4e856d53622a 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:44:57 devstack sudo[104086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-685ffaeb-bf6c-46be-8fdd-4e856d53622a 1073741824 Aug 11 04:44:57 devstack sudo[104086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:44:57 devstack sudo[104086]: pam_unix(sudo:session): session closed for user root Aug 11 04:44:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a73a957c-44a1-4058-a2f6-7f1dd18f945c tempest-VolumesActionsTest-99843155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-685ffaeb-bf6c-46be-8fdd-4e856d53622a 1073741824" returned: 0 in 0.656s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:44:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a73a957c-44a1-4058-a2f6-7f1dd18f945c tempest-VolumesActionsTest-99843155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-685ffaeb-bf6c-46be-8fdd-4e856d53622a {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:44:57 devstack sudo[104095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-685ffaeb-bf6c-46be-8fdd-4e856d53622a Aug 11 04:44:57 devstack sudo[104095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:44:58 devstack sudo[104095]: pam_unix(sudo:session): session closed for user root Aug 11 04:44:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a73a957c-44a1-4058-a2f6-7f1dd18f945c tempest-VolumesActionsTest-99843155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-685ffaeb-bf6c-46be-8fdd-4e856d53622a" returned: 0 in 0.435s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:44:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a73a957c-44a1-4058-a2f6-7f1dd18f945c tempest-VolumesActionsTest-99843155 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:44:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a73a957c-44a1-4058-a2f6-7f1dd18f945c tempest-VolumesActionsTest-99843155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:44:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a73a957c-44a1-4058-a2f6-7f1dd18f945c tempest-VolumesActionsTest-99843155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (236545dd-17c7-4b66-bb22-9a19d9078c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-685ffaeb-bf6c-46be-8fdd-4e856d53622a', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:44:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a73a957c-44a1-4058-a2f6-7f1dd18f945c tempest-VolumesActionsTest-99843155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1c4b825-9fb6-4b6e-96a4-8ac9e357d84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:44:58 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-a73a957c-44a1-4058-a2f6-7f1dd18f945c tempest-VolumesActionsTest-99843155 None] Volume volume-685ffaeb-bf6c-46be-8fdd-4e856d53622a (685ffaeb-bf6c-46be-8fdd-4e856d53622a): created successfully Aug 11 04:44:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a73a957c-44a1-4058-a2f6-7f1dd18f945c tempest-VolumesActionsTest-99843155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1c4b825-9fb6-4b6e-96a4-8ac9e357d84f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:44:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a73a957c-44a1-4058-a2f6-7f1dd18f945c tempest-VolumesActionsTest-99843155 None] Flow 'volume_create_manager' (6cb9629c-a74f-454c-8416-1a81e8504bb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:44:58 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-a73a957c-44a1-4058-a2f6-7f1dd18f945c tempest-VolumesActionsTest-99843155 None] Created volume successfully. Aug 11 04:44:58 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 04:44:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:44:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:44:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:44:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:44:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:44:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:44:58 devstack sudo[104099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:44:58 devstack sudo[104099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:44:58 devstack sudo[104099]: pam_unix(sudo:session): session closed for user root Aug 11 04:44:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.373s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:44:58 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:44:58 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running periodic task VolumeManager._thread_info {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 04:44:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] thread count: 28 {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 11 04:44:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] thread info: [<_MainThread(MainThread, started 133315846115456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 11 04:44:59 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:44:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] Flow 'volume_create_manager' (6c4565ef-17b7-4f7c-885c-75bc9bf331cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:44:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdaa1397-7ba7-40b1-a8d8-e96a07284f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:44:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdaa1397-7ba7-40b1-a8d8-e96a07284f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:44:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-691855698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1743ec6c-d666-424a-83b2-91752b9f4caa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07eee8cdcf284026920a39554d3cc52d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:45:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:45:00Z,use_quota=True,user_id='6670c58e182f437ab39e05b64eeac13e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:44:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (845605ac-4e6e-4b20-a17a-501cdb14b843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:44:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (845605ac-4e6e-4b20-a17a-501cdb14b843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:44:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (981a3660-d0c3-4fef-bdbb-59c153b7cacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:44:59 devstack cinder-volume[94472]: DEBUG cinder.image.glance [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] Creating Keystone auth plugin from conf {{(pid=94472) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 11 04:45:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (981a3660-d0c3-4fef-bdbb-59c153b7cacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1743ec6c-d666-424a-83b2-91752b9f4caa', 'volume_name': 'volume-1743ec6c-d666-424a-83b2-91752b9f4caa', 'volume_size': 1, 'image_id': '935df48c-f244-44af-83c6-4799aff908b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/935df48c-f244-44af-83c6-4799aff908b2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f74f87914afa4c849e1ab3e938cfb579', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '935df48c-f244-44af-83c6-4799aff908b2', 'created_at': datetime.datetime(2026, 8, 11, 2, 32, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 2, 32, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/935df48c-f244-44af-83c6-4799aff908b2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:45:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8c47c4e-9b26-4186-be87-d41941932318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:45:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8c47c4e-9b26-4186-be87-d41941932318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:45:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (777f7c8e-2ef8-40a9-aa2d-d6cdf770a028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:45:00 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] Volume 1743ec6c-d666-424a-83b2-91752b9f4caa: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1743ec6c-d666-424a-83b2-91752b9f4caa', 'volume_size': 1, 'image_id': '935df48c-f244-44af-83c6-4799aff908b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/935df48c-f244-44af-83c6-4799aff908b2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f74f87914afa4c849e1ab3e938cfb579', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '935df48c-f244-44af-83c6-4799aff908b2', 'created_at': datetime.datetime(2026, 8, 11, 2, 32, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 2, 32, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/935df48c-f244-44af-83c6-4799aff908b2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 11 04:45:00 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] Trying to clone 1743ec6c-d666-424a-83b2-91752b9f4caa from image 935df48c-f244-44af-83c6-4799aff908b2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/935df48c-f244-44af-83c6-4799aff908b2', 'metadata': {}}]). {{(pid=94472) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 11 04:45:00 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_47r4ec3zdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 11 04:45:00 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] Image download 20.69 MB at 20.69 MB/s Aug 11 04:45:00 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87ce0f4-081d-4a41-9dda-5b8b9de4533b]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:45:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_47r4ec3zdevstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:45:01 devstack sudo[104119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_47r4ec3zdevstack@QuobyteHD Aug 11 04:45:01 devstack sudo[104119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:45:01 devstack sudo[104119]: pam_unix(sudo:session): session closed for user root Aug 11 04:45:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_47r4ec3zdevstack@QuobyteHD" returned: 0 in 0.419s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:45:01 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] Temporary image 935df48c-f244-44af-83c6-4799aff908b2 is fetched for user 6670c58e182f437ab39e05b64eeac13e. {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 11 04:45:01 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[b636e663-2d71-451a-a988-e20868b385b2]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:45:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_47r4ec3zdevstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:45:01 devstack sudo[104124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_47r4ec3zdevstack@QuobyteHD Aug 11 04:45:01 devstack sudo[104124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:45:01 devstack sudo[104124]: pam_unix(sudo:session): session closed for user root Aug 11 04:45:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_47r4ec3zdevstack@QuobyteHD" returned: 0 in 0.378s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:45:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:45:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:45:01 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:44:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-691855698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1743ec6c-d666-424a-83b2-91752b9f4caa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07eee8cdcf284026920a39554d3cc52d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:45:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:45:00Z,use_quota=True,user_id='6670c58e182f437ab39e05b64eeac13e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:45:01 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] Creating volume 1743ec6c-d666-424a-83b2-91752b9f4caa {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:45:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:45:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:45:01 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:45:01 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:45:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:45:01 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:45:01 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:45:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1743ec6c-d666-424a-83b2-91752b9f4caa 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:45:01 devstack sudo[104132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1743ec6c-d666-424a-83b2-91752b9f4caa 1073741824 Aug 11 04:45:01 devstack sudo[104132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:45:02 devstack sudo[104132]: pam_unix(sudo:session): session closed for user root Aug 11 04:45:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1743ec6c-d666-424a-83b2-91752b9f4caa 1073741824" returned: 0 in 0.564s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:45:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1743ec6c-d666-424a-83b2-91752b9f4caa {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:45:02 devstack sudo[104139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1743ec6c-d666-424a-83b2-91752b9f4caa Aug 11 04:45:02 devstack sudo[104139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:45:02 devstack sudo[104139]: pam_unix(sudo:session): session closed for user root Aug 11 04:45:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1743ec6c-d666-424a-83b2-91752b9f4caa" returned: 0 in 0.390s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:45:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:45:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:45:02 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] Attempting download of 935df48c-f244-44af-83c6-4799aff908b2 ((None, [{'url': 'file:///opt/stack/data/glance/images/935df48c-f244-44af-83c6-4799aff908b2', 'metadata': {}}])) to volume 1743ec6c-d666-424a-83b2-91752b9f4caa. {{(pid=94472) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 11 04:45:02 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0db91c-14c1-48c7-9364-4ccbb60b8c0f]: (4, 'raw') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:45:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_935df48c-f244-44af-83c6-4799aff908b2_4dpfa50w {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:45:03 devstack sudo[104146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_935df48c-f244-44af-83c6-4799aff908b2_4dpfa50w Aug 11 04:45:03 devstack sudo[104146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:45:03 devstack sudo[104146]: pam_unix(sudo:session): session closed for user root Aug 11 04:45:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_935df48c-f244-44af-83c6-4799aff908b2_4dpfa50w" returned: 0 in 0.824s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:45:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_935df48c-f244-44af-83c6-4799aff908b2_4dpfa50w {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:45:04 devstack sudo[104188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_935df48c-f244-44af-83c6-4799aff908b2_4dpfa50w Aug 11 04:45:04 devstack sudo[104188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:45:04 devstack sudo[104188]: pam_unix(sudo:session): session closed for user root Aug 11 04:45:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_935df48c-f244-44af-83c6-4799aff908b2_4dpfa50w" returned: 1 in 0.661s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:45:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_935df48c-f244-44af-83c6-4799aff908b2_4dpfa50w' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 11 04:45:04 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a97a5ec-79e4-4116-898e-1a3162abc7ae]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:45:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_47r4ec3zdevstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:45:04 devstack sudo[104213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_47r4ec3zdevstack@QuobyteHD Aug 11 04:45:04 devstack sudo[104213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:45:05 devstack sudo[104213]: pam_unix(sudo:session): session closed for user root Aug 11 04:45:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_47r4ec3zdevstack@QuobyteHD" returned: 0 in 0.701s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:45:05 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] 935df48c-f244-44af-83c6-4799aff908b2 was qcow2, converting to qcow2 {{(pid=94472) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 11 04:45:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_47r4ec3zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1743ec6c-d666-424a-83b2-91752b9f4caa {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:45:05 devstack sudo[104241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_47r4ec3zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1743ec6c-d666-424a-83b2-91752b9f4caa Aug 11 04:45:05 devstack sudo[104241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:45:08 devstack sudo[104241]: pam_unix(sudo:session): session closed for user root Aug 11 04:45:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_47r4ec3zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1743ec6c-d666-424a-83b2-91752b9f4caa" returned: 0 in 3.435s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:45:08 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_47r4ec3zdevstack@QuobyteHD, size 112.00 MB, duration 3.44 sec, destination /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1743ec6c-d666-424a-83b2-91752b9f4caa {{(pid=94472) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 11 04:45:08 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] Converted 112.00 MB image at 32.59 MB/s Aug 11 04:45:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1743ec6c-d666-424a-83b2-91752b9f4caa 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:45:08 devstack sudo[104279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1743ec6c-d666-424a-83b2-91752b9f4caa 1G Aug 11 04:45:08 devstack sudo[104279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:45:09 devstack sudo[104279]: pam_unix(sudo:session): session closed for user root Aug 11 04:45:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1743ec6c-d666-424a-83b2-91752b9f4caa 1G" returned: 0 in 0.721s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:45:09 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] Downloaded image 935df48c-f244-44af-83c6-4799aff908b2 ((None, [{'url': 'file:///opt/stack/data/glance/images/935df48c-f244-44af-83c6-4799aff908b2', 'metadata': {}}])) to volume 1743ec6c-d666-424a-83b2-91752b9f4caa successfully. {{(pid=94472) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 11 04:45:09 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] Temporary image 935df48c-f244-44af-83c6-4799aff908b2 for user 6670c58e182f437ab39e05b64eeac13e is deleted. {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 11 04:45:09 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] Marking volume 1743ec6c-d666-424a-83b2-91752b9f4caa as bootable. {{(pid=94472) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 11 04:45:09 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] Copying metadata from image 935df48c-f244-44af-83c6-4799aff908b2 to 1743ec6c-d666-424a-83b2-91752b9f4caa. {{(pid=94472) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 11 04:45:09 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] Creating volume glance metadata for volume 1743ec6c-d666-424a-83b2-91752b9f4caa backed by image 935df48c-f244-44af-83c6-4799aff908b2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '935df48c-f244-44af-83c6-4799aff908b2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94472) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 11 04:45:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (777f7c8e-2ef8-40a9-aa2d-d6cdf770a028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1743ec6c-d666-424a-83b2-91752b9f4caa', 'volume_size': 1, 'image_id': '935df48c-f244-44af-83c6-4799aff908b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/935df48c-f244-44af-83c6-4799aff908b2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f74f87914afa4c849e1ab3e938cfb579', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '935df48c-f244-44af-83c6-4799aff908b2', 'created_at': datetime.datetime(2026, 8, 11, 2, 32, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 2, 32, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/935df48c-f244-44af-83c6-4799aff908b2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:45:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (823589b1-1805-4060-a7a8-e9be8706b7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:45:09 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] Volume volume-1743ec6c-d666-424a-83b2-91752b9f4caa (1743ec6c-d666-424a-83b2-91752b9f4caa): created successfully Aug 11 04:45:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (823589b1-1805-4060-a7a8-e9be8706b7ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:45:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] Flow 'volume_create_manager' (6c4565ef-17b7-4f7c-885c-75bc9bf331cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:45:09 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-02024318-3013-4f41-a0c4-3ae17d209815 tempest-TestShelveInstance-639944802 None] Created volume successfully. Aug 11 04:45:14 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-36248dc3-a5cb-40d8-bf34-617c7e2e111e tempest-TestInstancesWithCinderVolumes-171766842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:45:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-36248dc3-a5cb-40d8-bf34-617c7e2e111e tempest-TestInstancesWithCinderVolumes-171766842 None] Flow 'volume_create_manager' (7c34724f-cb4d-4201-b8c3-0151f591bb5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:45:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-36248dc3-a5cb-40d8-bf34-617c7e2e111e tempest-TestInstancesWithCinderVolumes-171766842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6edffe69-c96a-476e-8da0-f3d032903f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:45:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-36248dc3-a5cb-40d8-bf34-617c7e2e111e tempest-TestInstancesWithCinderVolumes-171766842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6edffe69-c96a-476e-8da0-f3d032903f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1950218370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b4d620d-a5c9-4c49-a35b-810a9e072719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='278d1a33dba5463d9b9199e0794d582c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:45:14Z,use_quota=True,user_id='bc6e4da384af4110acb2f74b0a01bc4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1afb5119-7a66-4a92-8ab0-13c4a82997b7),volume_type_id=1afb5119-7a66-4a92-8ab0-13c4a82997b7)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:45:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-36248dc3-a5cb-40d8-bf34-617c7e2e111e tempest-TestInstancesWithCinderVolumes-171766842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c13f2a6b-d8c5-44aa-911d-df90381c7e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:45:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-36248dc3-a5cb-40d8-bf34-617c7e2e111e tempest-TestInstancesWithCinderVolumes-171766842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c13f2a6b-d8c5-44aa-911d-df90381c7e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:45:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-36248dc3-a5cb-40d8-bf34-617c7e2e111e tempest-TestInstancesWithCinderVolumes-171766842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (991e8863-37fc-4663-9569-a13a01df8839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:45:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-36248dc3-a5cb-40d8-bf34-617c7e2e111e tempest-TestInstancesWithCinderVolumes-171766842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (991e8863-37fc-4663-9569-a13a01df8839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b4d620d-a5c9-4c49-a35b-810a9e072719', 'volume_name': 'volume-7b4d620d-a5c9-4c49-a35b-810a9e072719', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:45:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-36248dc3-a5cb-40d8-bf34-617c7e2e111e tempest-TestInstancesWithCinderVolumes-171766842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd28b061-3c3c-435f-9de2-b6ab4997f228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:45:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-36248dc3-a5cb-40d8-bf34-617c7e2e111e tempest-TestInstancesWithCinderVolumes-171766842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd28b061-3c3c-435f-9de2-b6ab4997f228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:45:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-36248dc3-a5cb-40d8-bf34-617c7e2e111e tempest-TestInstancesWithCinderVolumes-171766842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a273baa-b174-4337-a8cf-cef147b2756a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:45:14 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-36248dc3-a5cb-40d8-bf34-617c7e2e111e tempest-TestInstancesWithCinderVolumes-171766842 None] Volume 7b4d620d-a5c9-4c49-a35b-810a9e072719: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b4d620d-a5c9-4c49-a35b-810a9e072719', 'volume_size': 1} Aug 11 04:45:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-36248dc3-a5cb-40d8-bf34-617c7e2e111e tempest-TestInstancesWithCinderVolumes-171766842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:45:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-36248dc3-a5cb-40d8-bf34-617c7e2e111e tempest-TestInstancesWithCinderVolumes-171766842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:45:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-36248dc3-a5cb-40d8-bf34-617c7e2e111e tempest-TestInstancesWithCinderVolumes-171766842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1950218370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b4d620d-a5c9-4c49-a35b-810a9e072719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='278d1a33dba5463d9b9199e0794d582c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:45:14Z,use_quota=True,user_id='bc6e4da384af4110acb2f74b0a01bc4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1afb5119-7a66-4a92-8ab0-13c4a82997b7),volume_type_id=1afb5119-7a66-4a92-8ab0-13c4a82997b7)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:45:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-36248dc3-a5cb-40d8-bf34-617c7e2e111e tempest-TestInstancesWithCinderVolumes-171766842 None] Creating volume 7b4d620d-a5c9-4c49-a35b-810a9e072719 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:45:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-36248dc3-a5cb-40d8-bf34-617c7e2e111e tempest-TestInstancesWithCinderVolumes-171766842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:45:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-36248dc3-a5cb-40d8-bf34-617c7e2e111e tempest-TestInstancesWithCinderVolumes-171766842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:45:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-36248dc3-a5cb-40d8-bf34-617c7e2e111e tempest-TestInstancesWithCinderVolumes-171766842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:45:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-36248dc3-a5cb-40d8-bf34-617c7e2e111e tempest-TestInstancesWithCinderVolumes-171766842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:45:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-36248dc3-a5cb-40d8-bf34-617c7e2e111e tempest-TestInstancesWithCinderVolumes-171766842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:45:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-36248dc3-a5cb-40d8-bf34-617c7e2e111e tempest-TestInstancesWithCinderVolumes-171766842 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:45:14 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-36248dc3-a5cb-40d8-bf34-617c7e2e111e tempest-TestInstancesWithCinderVolumes-171766842 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:45:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-36248dc3-a5cb-40d8-bf34-617c7e2e111e tempest-TestInstancesWithCinderVolumes-171766842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7b4d620d-a5c9-4c49-a35b-810a9e072719 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:45:14 devstack sudo[104401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7b4d620d-a5c9-4c49-a35b-810a9e072719 1073741824 Aug 11 04:45:14 devstack sudo[104401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:45:16 devstack sudo[104401]: pam_unix(sudo:session): session closed for user root Aug 11 04:45:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-36248dc3-a5cb-40d8-bf34-617c7e2e111e tempest-TestInstancesWithCinderVolumes-171766842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7b4d620d-a5c9-4c49-a35b-810a9e072719 1073741824" returned: 0 in 1.584s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:45:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-36248dc3-a5cb-40d8-bf34-617c7e2e111e tempest-TestInstancesWithCinderVolumes-171766842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7b4d620d-a5c9-4c49-a35b-810a9e072719 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:45:16 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-d23f173a-1aec-43d7-9422-d3ad7dac2e83 tempest-TestInstancesWithCinderVolumes-171766842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:45:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d23f173a-1aec-43d7-9422-d3ad7dac2e83 tempest-TestInstancesWithCinderVolumes-171766842 None] Flow 'volume_create_manager' (d7071a77-1452-4f54-b490-131b0b1bc5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:45:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d23f173a-1aec-43d7-9422-d3ad7dac2e83 tempest-TestInstancesWithCinderVolumes-171766842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d4b9a9c-1848-4bc8-b94c-0323b9530b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:45:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d23f173a-1aec-43d7-9422-d3ad7dac2e83 tempest-TestInstancesWithCinderVolumes-171766842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d4b9a9c-1848-4bc8-b94c-0323b9530b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:45:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2123512327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d5592f5-3dd2-4a3b-8a51-7a649ee689dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='278d1a33dba5463d9b9199e0794d582c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:45:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:45:16Z,use_quota=True,user_id='bc6e4da384af4110acb2f74b0a01bc4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b2603e3-4640-48f7-84e1-c45ba63eee92),volume_type_id=4b2603e3-4640-48f7-84e1-c45ba63eee92)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:45:16 devstack sudo[104435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7b4d620d-a5c9-4c49-a35b-810a9e072719 Aug 11 04:45:16 devstack sudo[104435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:45:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d23f173a-1aec-43d7-9422-d3ad7dac2e83 tempest-TestInstancesWithCinderVolumes-171766842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abf03c44-8ad5-4cbe-967f-3f36d6cf0610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:45:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d23f173a-1aec-43d7-9422-d3ad7dac2e83 tempest-TestInstancesWithCinderVolumes-171766842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abf03c44-8ad5-4cbe-967f-3f36d6cf0610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:45:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d23f173a-1aec-43d7-9422-d3ad7dac2e83 tempest-TestInstancesWithCinderVolumes-171766842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfb3f51e-b73e-4b41-a68a-853c67f14757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:45:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d23f173a-1aec-43d7-9422-d3ad7dac2e83 tempest-TestInstancesWithCinderVolumes-171766842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfb3f51e-b73e-4b41-a68a-853c67f14757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d5592f5-3dd2-4a3b-8a51-7a649ee689dd', 'volume_name': 'volume-9d5592f5-3dd2-4a3b-8a51-7a649ee689dd', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:45:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d23f173a-1aec-43d7-9422-d3ad7dac2e83 tempest-TestInstancesWithCinderVolumes-171766842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70b92e8b-2851-4efb-87c0-59edfa9505aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:45:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d23f173a-1aec-43d7-9422-d3ad7dac2e83 tempest-TestInstancesWithCinderVolumes-171766842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70b92e8b-2851-4efb-87c0-59edfa9505aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:45:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d23f173a-1aec-43d7-9422-d3ad7dac2e83 tempest-TestInstancesWithCinderVolumes-171766842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7c33127-e656-4b24-96de-1b01fe9c5cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:45:16 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-d23f173a-1aec-43d7-9422-d3ad7dac2e83 tempest-TestInstancesWithCinderVolumes-171766842 None] Volume 9d5592f5-3dd2-4a3b-8a51-7a649ee689dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d5592f5-3dd2-4a3b-8a51-7a649ee689dd', 'volume_size': 1} Aug 11 04:45:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d23f173a-1aec-43d7-9422-d3ad7dac2e83 tempest-TestInstancesWithCinderVolumes-171766842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:45:17 devstack sudo[104435]: pam_unix(sudo:session): session closed for user root Aug 11 04:45:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-36248dc3-a5cb-40d8-bf34-617c7e2e111e tempest-TestInstancesWithCinderVolumes-171766842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7b4d620d-a5c9-4c49-a35b-810a9e072719" returned: 0 in 0.907s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:45:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-36248dc3-a5cb-40d8-bf34-617c7e2e111e tempest-TestInstancesWithCinderVolumes-171766842 None] <== create_volume: return (2660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:45:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-36248dc3-a5cb-40d8-bf34-617c7e2e111e tempest-TestInstancesWithCinderVolumes-171766842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.673s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:45:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d23f173a-1aec-43d7-9422-d3ad7dac2e83 tempest-TestInstancesWithCinderVolumes-171766842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.644s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:45:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d23f173a-1aec-43d7-9422-d3ad7dac2e83 tempest-TestInstancesWithCinderVolumes-171766842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:45:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2123512327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d5592f5-3dd2-4a3b-8a51-7a649ee689dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='278d1a33dba5463d9b9199e0794d582c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:45:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:45:16Z,use_quota=True,user_id='bc6e4da384af4110acb2f74b0a01bc4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b2603e3-4640-48f7-84e1-c45ba63eee92),volume_type_id=4b2603e3-4640-48f7-84e1-c45ba63eee92)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:45:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-d23f173a-1aec-43d7-9422-d3ad7dac2e83 tempest-TestInstancesWithCinderVolumes-171766842 None] Creating volume 9d5592f5-3dd2-4a3b-8a51-7a649ee689dd {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:45:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d23f173a-1aec-43d7-9422-d3ad7dac2e83 tempest-TestInstancesWithCinderVolumes-171766842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:45:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d23f173a-1aec-43d7-9422-d3ad7dac2e83 tempest-TestInstancesWithCinderVolumes-171766842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:45:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d23f173a-1aec-43d7-9422-d3ad7dac2e83 tempest-TestInstancesWithCinderVolumes-171766842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:45:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d23f173a-1aec-43d7-9422-d3ad7dac2e83 tempest-TestInstancesWithCinderVolumes-171766842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:45:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d23f173a-1aec-43d7-9422-d3ad7dac2e83 tempest-TestInstancesWithCinderVolumes-171766842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:45:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d23f173a-1aec-43d7-9422-d3ad7dac2e83 tempest-TestInstancesWithCinderVolumes-171766842 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:45:17 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-d23f173a-1aec-43d7-9422-d3ad7dac2e83 tempest-TestInstancesWithCinderVolumes-171766842 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:45:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d23f173a-1aec-43d7-9422-d3ad7dac2e83 tempest-TestInstancesWithCinderVolumes-171766842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9d5592f5-3dd2-4a3b-8a51-7a649ee689dd 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:45:17 devstack sudo[104447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9d5592f5-3dd2-4a3b-8a51-7a649ee689dd 1073741824 Aug 11 04:45:17 devstack sudo[104447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:45:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-36248dc3-a5cb-40d8-bf34-617c7e2e111e tempest-TestInstancesWithCinderVolumes-171766842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a273baa-b174-4337-a8cf-cef147b2756a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b4d620d-a5c9-4c49-a35b-810a9e072719', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:45:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-36248dc3-a5cb-40d8-bf34-617c7e2e111e tempest-TestInstancesWithCinderVolumes-171766842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3be60dd-3b99-4eea-8c0f-8fea6128f34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:45:17 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-36248dc3-a5cb-40d8-bf34-617c7e2e111e tempest-TestInstancesWithCinderVolumes-171766842 None] Volume volume-7b4d620d-a5c9-4c49-a35b-810a9e072719 (7b4d620d-a5c9-4c49-a35b-810a9e072719): created successfully Aug 11 04:45:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-36248dc3-a5cb-40d8-bf34-617c7e2e111e tempest-TestInstancesWithCinderVolumes-171766842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3be60dd-3b99-4eea-8c0f-8fea6128f34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:45:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-36248dc3-a5cb-40d8-bf34-617c7e2e111e tempest-TestInstancesWithCinderVolumes-171766842 None] Flow 'volume_create_manager' (7c34724f-cb4d-4201-b8c3-0151f591bb5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:45:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-ef1bb845-1f73-472b-9989-36315fadec50 req-f3616964-b75b-48cb-b037-a44e99c6de5b tempest-TestShelveInstance-639944802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:45:18 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-36248dc3-a5cb-40d8-bf34-617c7e2e111e tempest-TestInstancesWithCinderVolumes-171766842 None] Created volume successfully. Aug 11 04:45:18 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:45:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] Flow 'volume_create_manager' (accd5aec-2053-4ecf-bf89-cc3d336f41fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:45:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b31ed4e-dcbf-49b7-81fe-fb0f827fd992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:45:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b31ed4e-dcbf-49b7-81fe-fb0f827fd992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:45:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1914247103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf842bbf-a991-4e46-83c2-944c8386df63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='278d1a33dba5463d9b9199e0794d582c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:45:19Z,use_quota=True,user_id='bc6e4da384af4110acb2f74b0a01bc4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcc13e96-2c90-4cae-8079-46bd6939810a),volume_type_id=fcc13e96-2c90-4cae-8079-46bd6939810a)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:45:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18339fd7-7df6-498c-b922-bdbfb3b51643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:45:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18339fd7-7df6-498c-b922-bdbfb3b51643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:45:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7eae4d9-0335-4be9-9bb4-1a972b684cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:45:18 devstack cinder-volume[94472]: DEBUG cinder.image.glance [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] Creating Keystone auth plugin from conf {{(pid=94472) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 11 04:45:18 devstack sudo[104447]: pam_unix(sudo:session): session closed for user root Aug 11 04:45:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d23f173a-1aec-43d7-9422-d3ad7dac2e83 tempest-TestInstancesWithCinderVolumes-171766842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9d5592f5-3dd2-4a3b-8a51-7a649ee689dd 1073741824" returned: 0 in 1.320s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:45:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d23f173a-1aec-43d7-9422-d3ad7dac2e83 tempest-TestInstancesWithCinderVolumes-171766842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9d5592f5-3dd2-4a3b-8a51-7a649ee689dd {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:45:19 devstack sudo[104455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9d5592f5-3dd2-4a3b-8a51-7a649ee689dd Aug 11 04:45:19 devstack sudo[104455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:45:19 devstack sudo[104455]: pam_unix(sudo:session): session closed for user root Aug 11 04:45:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d23f173a-1aec-43d7-9422-d3ad7dac2e83 tempest-TestInstancesWithCinderVolumes-171766842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9d5592f5-3dd2-4a3b-8a51-7a649ee689dd" returned: 0 in 0.593s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:45:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d23f173a-1aec-43d7-9422-d3ad7dac2e83 tempest-TestInstancesWithCinderVolumes-171766842 None] <== create_volume: return (2039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:45:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d23f173a-1aec-43d7-9422-d3ad7dac2e83 tempest-TestInstancesWithCinderVolumes-171766842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.064s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:45:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-ef1bb845-1f73-472b-9989-36315fadec50 req-f3616964-b75b-48cb-b037-a44e99c6de5b tempest-TestShelveInstance-639944802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.608s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:45:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d23f173a-1aec-43d7-9422-d3ad7dac2e83 tempest-TestInstancesWithCinderVolumes-171766842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7c33127-e656-4b24-96de-1b01fe9c5cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d5592f5-3dd2-4a3b-8a51-7a649ee689dd', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:45:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d23f173a-1aec-43d7-9422-d3ad7dac2e83 tempest-TestInstancesWithCinderVolumes-171766842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31191dde-8415-416f-b39c-e2419e3a48b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:45:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7eae4d9-0335-4be9-9bb4-1a972b684cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bf842bbf-a991-4e46-83c2-944c8386df63', 'volume_name': 'volume-bf842bbf-a991-4e46-83c2-944c8386df63', 'volume_size': 1, 'image_id': 'd6c15f42-314b-4ee0-9899-7df09c1baa6e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d6c15f42-314b-4ee0-9899-7df09c1baa6e', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--610509642', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '278d1a33dba5463d9b9199e0794d582c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd6c15f42-314b-4ee0-9899-7df09c1baa6e', 'created_at': datetime.datetime(2026, 8, 11, 2, 45, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 2, 45, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d6c15f42-314b-4ee0-9899-7df09c1baa6e/file', 'properties': {}}, 'image_service': }' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:45:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3a1f6b1-212f-44c9-a874-e1e55a727cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:45:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3a1f6b1-212f-44c9-a874-e1e55a727cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:45:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee6cdb8a-d57b-4621-80eb-b54bd74e0eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:45:19 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] Volume bf842bbf-a991-4e46-83c2-944c8386df63: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bf842bbf-a991-4e46-83c2-944c8386df63', 'volume_size': 1, 'image_id': 'd6c15f42-314b-4ee0-9899-7df09c1baa6e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d6c15f42-314b-4ee0-9899-7df09c1baa6e', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--610509642', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '278d1a33dba5463d9b9199e0794d582c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd6c15f42-314b-4ee0-9899-7df09c1baa6e', 'created_at': datetime.datetime(2026, 8, 11, 2, 45, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 2, 45, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d6c15f42-314b-4ee0-9899-7df09c1baa6e/file', 'properties': {}}, 'image_service': } Aug 11 04:45:19 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] Trying to clone bf842bbf-a991-4e46-83c2-944c8386df63 from image d6c15f42-314b-4ee0-9899-7df09c1baa6e at location (None, [{'url': 'file:///opt/stack/data/glance/images/d6c15f42-314b-4ee0-9899-7df09c1baa6e', 'metadata': {}}]). {{(pid=94472) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 11 04:45:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-ef1bb845-1f73-472b-9989-36315fadec50 req-f3616964-b75b-48cb-b037-a44e99c6de5b tempest-TestShelveInstance-639944802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.108s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:45:19 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-d23f173a-1aec-43d7-9422-d3ad7dac2e83 tempest-TestInstancesWithCinderVolumes-171766842 None] Volume volume-9d5592f5-3dd2-4a3b-8a51-7a649ee689dd (9d5592f5-3dd2-4a3b-8a51-7a649ee689dd): created successfully Aug 11 04:45:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d23f173a-1aec-43d7-9422-d3ad7dac2e83 tempest-TestInstancesWithCinderVolumes-171766842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31191dde-8415-416f-b39c-e2419e3a48b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:45:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d23f173a-1aec-43d7-9422-d3ad7dac2e83 tempest-TestInstancesWithCinderVolumes-171766842 None] Flow 'volume_create_manager' (d7071a77-1452-4f54-b490-131b0b1bc5e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:45:19 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-d23f173a-1aec-43d7-9422-d3ad7dac2e83 tempest-TestInstancesWithCinderVolumes-171766842 None] Created volume successfully. Aug 11 04:45:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-ef1bb845-1f73-472b-9989-36315fadec50 req-f3616964-b75b-48cb-b037-a44e99c6de5b tempest-TestShelveInstance-639944802 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd', 'name': 'volume-1743ec6c-d666-424a-83b2-91752b9f4caa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '78d4a0d1-41a1-44cb-acff-2ef11a7a7722', 'enforce_multipath': True} {{(pid=94472) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 11 04:45:20 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-ef1bb845-1f73-472b-9989-36315fadec50 req-f3616964-b75b-48cb-b037-a44e99c6de5b tempest-TestShelveInstance-639944802 None] attachment_update completed successfully. Aug 11 04:45:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-960f78e9-5215-4ce7-9686-01cdabcda3c8 tempest-VolumesActionsTest-99843155 None] Acquiring lock "cinder-685ffaeb-bf6c-46be-8fdd-4e856d53622a" by "attach_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:45:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-960f78e9-5215-4ce7-9686-01cdabcda3c8 tempest-VolumesActionsTest-99843155 None] Lock "cinder-685ffaeb-bf6c-46be-8fdd-4e856d53622a" acquired by "attach_volume" :: waited 0.043s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:45:22 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-960f78e9-5215-4ce7-9686-01cdabcda3c8 tempest-VolumesActionsTest-99843155 None] Attaching volume 685ffaeb-bf6c-46be-8fdd-4e856d53622a to instance 3f6dc6a8-f6fe-4e21-b33f-6ea3d34ed4c0 at mountpoint /dev/vdb on host None. Aug 11 04:45:22 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-960f78e9-5215-4ce7-9686-01cdabcda3c8 tempest-VolumesActionsTest-99843155 None] Attach volume completed successfully. Aug 11 04:45:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-960f78e9-5215-4ce7-9686-01cdabcda3c8 tempest-VolumesActionsTest-99843155 None] Lock "cinder-685ffaeb-bf6c-46be-8fdd-4e856d53622a" released by "attach_volume" :: held 0.311s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:45:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-20bd2c1a-1722-4542-bd3f-fc3b8d159bf0 tempest-VolumesActionsTest-99843155 None] Acquiring lock "cinder-685ffaeb-bf6c-46be-8fdd-4e856d53622a-detach_volume" by "detach_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:45:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-20bd2c1a-1722-4542-bd3f-fc3b8d159bf0 tempest-VolumesActionsTest-99843155 None] Lock "cinder-685ffaeb-bf6c-46be-8fdd-4e856d53622a-detach_volume" acquired by "detach_volume" :: waited 0.036s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:45:23 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-20bd2c1a-1722-4542-bd3f-fc3b8d159bf0 tempest-VolumesActionsTest-99843155 None] Detaching volume 685ffaeb-bf6c-46be-8fdd-4e856d53622a from instance 3f6dc6a8-f6fe-4e21-b33f-6ea3d34ed4c0. Aug 11 04:45:23 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-20bd2c1a-1722-4542-bd3f-fc3b8d159bf0 tempest-VolumesActionsTest-99843155 None] Detach volume completed successfully. Aug 11 04:45:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-20bd2c1a-1722-4542-bd3f-fc3b8d159bf0 tempest-VolumesActionsTest-99843155 None] Lock "cinder-685ffaeb-bf6c-46be-8fdd-4e856d53622a-detach_volume" released by "detach_volume" :: held 0.163s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:45:29 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d6c15f42-314b-4ee0-9899-7df09c1baa6e_0xj6gzqqdevstack@QuobyteHD, size 20.69 MB, duration 9.45 sec {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 11 04:45:29 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] Image download 20.69 MB at 2.19 MB/s Aug 11 04:45:29 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1736cf3-2fa9-4fef-b3fd-2b122d1e4256]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:45:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d6c15f42-314b-4ee0-9899-7df09c1baa6e_0xj6gzqqdevstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:45:29 devstack sudo[105041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d6c15f42-314b-4ee0-9899-7df09c1baa6e_0xj6gzqqdevstack@QuobyteHD Aug 11 04:45:29 devstack sudo[105041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:45:30 devstack sudo[105041]: pam_unix(sudo:session): session closed for user root Aug 11 04:45:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d6c15f42-314b-4ee0-9899-7df09c1baa6e_0xj6gzqqdevstack@QuobyteHD" returned: 0 in 0.872s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:45:30 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] Temporary image d6c15f42-314b-4ee0-9899-7df09c1baa6e is fetched for user bc6e4da384af4110acb2f74b0a01bc4c. {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 11 04:45:30 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[641a288f-2667-41ce-99af-ea4ad57f8157]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:45:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d6c15f42-314b-4ee0-9899-7df09c1baa6e_0xj6gzqqdevstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:45:30 devstack sudo[105068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d6c15f42-314b-4ee0-9899-7df09c1baa6e_0xj6gzqqdevstack@QuobyteHD Aug 11 04:45:30 devstack sudo[105068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:45:31 devstack sudo[105068]: pam_unix(sudo:session): session closed for user root Aug 11 04:45:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d6c15f42-314b-4ee0-9899-7df09c1baa6e_0xj6gzqqdevstack@QuobyteHD" returned: 0 in 0.738s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:45:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:45:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:45:31 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:45:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1914247103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf842bbf-a991-4e46-83c2-944c8386df63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='278d1a33dba5463d9b9199e0794d582c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:45:19Z,use_quota=True,user_id='bc6e4da384af4110acb2f74b0a01bc4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcc13e96-2c90-4cae-8079-46bd6939810a),volume_type_id=fcc13e96-2c90-4cae-8079-46bd6939810a)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:45:31 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] Creating volume bf842bbf-a991-4e46-83c2-944c8386df63 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:45:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:45:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:45:31 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:45:31 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:45:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:45:31 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:45:31 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:45:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-bf842bbf-a991-4e46-83c2-944c8386df63 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:45:31 devstack sudo[105074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-bf842bbf-a991-4e46-83c2-944c8386df63 1073741824 Aug 11 04:45:31 devstack sudo[105074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:45:31 devstack sudo[105074]: pam_unix(sudo:session): session closed for user root Aug 11 04:45:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-bf842bbf-a991-4e46-83c2-944c8386df63 1073741824" returned: 0 in 0.733s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:45:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-bf842bbf-a991-4e46-83c2-944c8386df63 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:45:31 devstack sudo[105085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-bf842bbf-a991-4e46-83c2-944c8386df63 Aug 11 04:45:31 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:45:32 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root Aug 11 04:45:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-bf842bbf-a991-4e46-83c2-944c8386df63" returned: 0 in 0.639s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:45:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:45:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.459s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:45:32 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] Attempting download of d6c15f42-314b-4ee0-9899-7df09c1baa6e ((None, [{'url': 'file:///opt/stack/data/glance/images/d6c15f42-314b-4ee0-9899-7df09c1baa6e', 'metadata': {}}])) to volume bf842bbf-a991-4e46-83c2-944c8386df63. {{(pid=94472) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 11 04:45:32 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0992b90-8ae3-429d-972c-5920f38883f6]: (4, 'raw') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:45:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d6c15f42-314b-4ee0-9899-7df09c1baa6e_t7irx4g6 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:45:32 devstack sudo[105088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d6c15f42-314b-4ee0-9899-7df09c1baa6e_t7irx4g6 Aug 11 04:45:32 devstack sudo[105088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:45:33 devstack sudo[105088]: pam_unix(sudo:session): session closed for user root Aug 11 04:45:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d6c15f42-314b-4ee0-9899-7df09c1baa6e_t7irx4g6" returned: 0 in 0.499s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:45:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d6c15f42-314b-4ee0-9899-7df09c1baa6e_t7irx4g6 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:45:33 devstack sudo[105094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d6c15f42-314b-4ee0-9899-7df09c1baa6e_t7irx4g6 Aug 11 04:45:33 devstack sudo[105094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:45:33 devstack sudo[105094]: pam_unix(sudo:session): session closed for user root Aug 11 04:45:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d6c15f42-314b-4ee0-9899-7df09c1baa6e_t7irx4g6" returned: 1 in 0.720s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:45:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d6c15f42-314b-4ee0-9899-7df09c1baa6e_t7irx4g6' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 11 04:45:33 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e412a75-3982-4e76-8c3c-26e05032dda2]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:45:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d6c15f42-314b-4ee0-9899-7df09c1baa6e_0xj6gzqqdevstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:45:34 devstack sudo[105098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d6c15f42-314b-4ee0-9899-7df09c1baa6e_0xj6gzqqdevstack@QuobyteHD Aug 11 04:45:34 devstack sudo[105098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:45:34 devstack sudo[105098]: pam_unix(sudo:session): session closed for user root Aug 11 04:45:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d6c15f42-314b-4ee0-9899-7df09c1baa6e_0xj6gzqqdevstack@QuobyteHD" returned: 0 in 1.007s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:45:35 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] d6c15f42-314b-4ee0-9899-7df09c1baa6e was qcow2, converting to qcow2 {{(pid=94472) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 11 04:45:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d6c15f42-314b-4ee0-9899-7df09c1baa6e_0xj6gzqqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-bf842bbf-a991-4e46-83c2-944c8386df63 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:45:35 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e28c7e1-d2a9-4370-9b62-46a605c1acc0 tempest-ServersNegativeTestJSON-331919477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:45:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7e28c7e1-d2a9-4370-9b62-46a605c1acc0 tempest-ServersNegativeTestJSON-331919477 None] Flow 'volume_create_manager' (0beee463-f7c0-40a0-b514-cf3e6bec6375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:45:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7e28c7e1-d2a9-4370-9b62-46a605c1acc0 tempest-ServersNegativeTestJSON-331919477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (037beb11-3a6a-4336-9fd4-b66278dbcd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:45:35 devstack sudo[105105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d6c15f42-314b-4ee0-9899-7df09c1baa6e_0xj6gzqqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-bf842bbf-a991-4e46-83c2-944c8386df63 Aug 11 04:45:35 devstack sudo[105105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:45:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7e28c7e1-d2a9-4370-9b62-46a605c1acc0 tempest-ServersNegativeTestJSON-331919477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (037beb11-3a6a-4336-9fd4-b66278dbcd98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1034623817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8510f341-e091-4906-9388-e5e7cb9f4347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b179ff1c5d744fcb46787ffb00c0053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:45:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:45:35Z,use_quota=True,user_id='26d71f9c2c9c41faa761e4f90d0aa854',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:45:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7e28c7e1-d2a9-4370-9b62-46a605c1acc0 tempest-ServersNegativeTestJSON-331919477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (938fa34b-3125-4968-bd08-fe09c93e42ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:45:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7e28c7e1-d2a9-4370-9b62-46a605c1acc0 tempest-ServersNegativeTestJSON-331919477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (938fa34b-3125-4968-bd08-fe09c93e42ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:45:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7e28c7e1-d2a9-4370-9b62-46a605c1acc0 tempest-ServersNegativeTestJSON-331919477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e433ef5e-05dd-40ea-ac0a-79c951663f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:45:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7e28c7e1-d2a9-4370-9b62-46a605c1acc0 tempest-ServersNegativeTestJSON-331919477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e433ef5e-05dd-40ea-ac0a-79c951663f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8510f341-e091-4906-9388-e5e7cb9f4347', 'volume_name': 'volume-8510f341-e091-4906-9388-e5e7cb9f4347', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:45:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7e28c7e1-d2a9-4370-9b62-46a605c1acc0 tempest-ServersNegativeTestJSON-331919477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f33fa79-518d-4803-a8b0-fefecc1faee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:45:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7e28c7e1-d2a9-4370-9b62-46a605c1acc0 tempest-ServersNegativeTestJSON-331919477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f33fa79-518d-4803-a8b0-fefecc1faee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:45:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7e28c7e1-d2a9-4370-9b62-46a605c1acc0 tempest-ServersNegativeTestJSON-331919477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f3445dd-ef70-4fe5-86a1-32beba897a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:45:35 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-7e28c7e1-d2a9-4370-9b62-46a605c1acc0 tempest-ServersNegativeTestJSON-331919477 None] Volume 8510f341-e091-4906-9388-e5e7cb9f4347: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8510f341-e091-4906-9388-e5e7cb9f4347', 'volume_size': 1} Aug 11 04:45:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7e28c7e1-d2a9-4370-9b62-46a605c1acc0 tempest-ServersNegativeTestJSON-331919477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:45:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7e28c7e1-d2a9-4370-9b62-46a605c1acc0 tempest-ServersNegativeTestJSON-331919477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:45:35 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7e28c7e1-d2a9-4370-9b62-46a605c1acc0 tempest-ServersNegativeTestJSON-331919477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1034623817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8510f341-e091-4906-9388-e5e7cb9f4347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b179ff1c5d744fcb46787ffb00c0053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:45:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:45:35Z,use_quota=True,user_id='26d71f9c2c9c41faa761e4f90d0aa854',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:45:35 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-7e28c7e1-d2a9-4370-9b62-46a605c1acc0 tempest-ServersNegativeTestJSON-331919477 None] Creating volume 8510f341-e091-4906-9388-e5e7cb9f4347 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:45:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7e28c7e1-d2a9-4370-9b62-46a605c1acc0 tempest-ServersNegativeTestJSON-331919477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:45:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7e28c7e1-d2a9-4370-9b62-46a605c1acc0 tempest-ServersNegativeTestJSON-331919477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:45:35 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7e28c7e1-d2a9-4370-9b62-46a605c1acc0 tempest-ServersNegativeTestJSON-331919477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:45:35 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7e28c7e1-d2a9-4370-9b62-46a605c1acc0 tempest-ServersNegativeTestJSON-331919477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:45:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7e28c7e1-d2a9-4370-9b62-46a605c1acc0 tempest-ServersNegativeTestJSON-331919477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:45:35 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7e28c7e1-d2a9-4370-9b62-46a605c1acc0 tempest-ServersNegativeTestJSON-331919477 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:45:35 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-7e28c7e1-d2a9-4370-9b62-46a605c1acc0 tempest-ServersNegativeTestJSON-331919477 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:45:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7e28c7e1-d2a9-4370-9b62-46a605c1acc0 tempest-ServersNegativeTestJSON-331919477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8510f341-e091-4906-9388-e5e7cb9f4347 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:45:35 devstack sudo[105113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8510f341-e091-4906-9388-e5e7cb9f4347 1073741824 Aug 11 04:45:35 devstack sudo[105113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:45:36 devstack sudo[105113]: pam_unix(sudo:session): session closed for user root Aug 11 04:45:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7e28c7e1-d2a9-4370-9b62-46a605c1acc0 tempest-ServersNegativeTestJSON-331919477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8510f341-e091-4906-9388-e5e7cb9f4347 1073741824" returned: 0 in 0.957s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:45:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7e28c7e1-d2a9-4370-9b62-46a605c1acc0 tempest-ServersNegativeTestJSON-331919477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8510f341-e091-4906-9388-e5e7cb9f4347 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:45:36 devstack sudo[105132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8510f341-e091-4906-9388-e5e7cb9f4347 Aug 11 04:45:36 devstack sudo[105132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:45:36 devstack sudo[105132]: pam_unix(sudo:session): session closed for user root Aug 11 04:45:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7e28c7e1-d2a9-4370-9b62-46a605c1acc0 tempest-ServersNegativeTestJSON-331919477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8510f341-e091-4906-9388-e5e7cb9f4347" returned: 0 in 0.458s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:45:36 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7e28c7e1-d2a9-4370-9b62-46a605c1acc0 tempest-ServersNegativeTestJSON-331919477 None] <== create_volume: return (1495ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:45:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7e28c7e1-d2a9-4370-9b62-46a605c1acc0 tempest-ServersNegativeTestJSON-331919477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.504s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:45:36 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7e28c7e1-d2a9-4370-9b62-46a605c1acc0 tempest-ServersNegativeTestJSON-331919477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f3445dd-ef70-4fe5-86a1-32beba897a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8510f341-e091-4906-9388-e5e7cb9f4347', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:45:36 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7e28c7e1-d2a9-4370-9b62-46a605c1acc0 tempest-ServersNegativeTestJSON-331919477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (841ba3bd-2516-406b-95e0-e34361aa396f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:45:36 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-7e28c7e1-d2a9-4370-9b62-46a605c1acc0 tempest-ServersNegativeTestJSON-331919477 None] Volume volume-8510f341-e091-4906-9388-e5e7cb9f4347 (8510f341-e091-4906-9388-e5e7cb9f4347): created successfully Aug 11 04:45:36 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7e28c7e1-d2a9-4370-9b62-46a605c1acc0 tempest-ServersNegativeTestJSON-331919477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (841ba3bd-2516-406b-95e0-e34361aa396f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:45:36 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7e28c7e1-d2a9-4370-9b62-46a605c1acc0 tempest-ServersNegativeTestJSON-331919477 None] Flow 'volume_create_manager' (0beee463-f7c0-40a0-b514-cf3e6bec6375) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:45:36 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-7e28c7e1-d2a9-4370-9b62-46a605c1acc0 tempest-ServersNegativeTestJSON-331919477 None] Created volume successfully. Aug 11 04:45:38 devstack sudo[105105]: pam_unix(sudo:session): session closed for user root Aug 11 04:45:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d6c15f42-314b-4ee0-9899-7df09c1baa6e_0xj6gzqqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-bf842bbf-a991-4e46-83c2-944c8386df63" returned: 0 in 3.086s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:45:38 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d6c15f42-314b-4ee0-9899-7df09c1baa6e_0xj6gzqqdevstack@QuobyteHD, size 112.00 MB, duration 3.09 sec, destination /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-bf842bbf-a991-4e46-83c2-944c8386df63 {{(pid=94472) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 11 04:45:38 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] Converted 112.00 MB image at 36.27 MB/s Aug 11 04:45:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-bf842bbf-a991-4e46-83c2-944c8386df63 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:45:38 devstack sudo[105138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-bf842bbf-a991-4e46-83c2-944c8386df63 1G Aug 11 04:45:38 devstack sudo[105138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:45:38 devstack sudo[105138]: pam_unix(sudo:session): session closed for user root Aug 11 04:45:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-bf842bbf-a991-4e46-83c2-944c8386df63 1G" returned: 0 in 0.475s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:45:38 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] Downloaded image d6c15f42-314b-4ee0-9899-7df09c1baa6e ((None, [{'url': 'file:///opt/stack/data/glance/images/d6c15f42-314b-4ee0-9899-7df09c1baa6e', 'metadata': {}}])) to volume bf842bbf-a991-4e46-83c2-944c8386df63 successfully. {{(pid=94472) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 11 04:45:38 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] Temporary image d6c15f42-314b-4ee0-9899-7df09c1baa6e for user bc6e4da384af4110acb2f74b0a01bc4c is deleted. {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 11 04:45:38 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] Marking volume bf842bbf-a991-4e46-83c2-944c8386df63 as bootable. {{(pid=94472) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 11 04:45:38 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] Copying metadata from image d6c15f42-314b-4ee0-9899-7df09c1baa6e to bf842bbf-a991-4e46-83c2-944c8386df63. {{(pid=94472) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 11 04:45:38 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] Creating volume glance metadata for volume bf842bbf-a991-4e46-83c2-944c8386df63 backed by image d6c15f42-314b-4ee0-9899-7df09c1baa6e with: {'image_id': 'd6c15f42-314b-4ee0-9899-7df09c1baa6e', 'image_name': 'tempest-scenario-img--610509642', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94472) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 11 04:45:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee6cdb8a-d57b-4621-80eb-b54bd74e0eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf842bbf-a991-4e46-83c2-944c8386df63', 'volume_size': 1, 'image_id': 'd6c15f42-314b-4ee0-9899-7df09c1baa6e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d6c15f42-314b-4ee0-9899-7df09c1baa6e', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--610509642', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '278d1a33dba5463d9b9199e0794d582c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd6c15f42-314b-4ee0-9899-7df09c1baa6e', 'created_at': datetime.datetime(2026, 8, 11, 2, 45, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 2, 45, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d6c15f42-314b-4ee0-9899-7df09c1baa6e/file', 'properties': {}}, 'image_service': }' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:45:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86e0ea4b-e823-47b2-89ce-c1a27339ad5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:45:38 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] Volume volume-bf842bbf-a991-4e46-83c2-944c8386df63 (bf842bbf-a991-4e46-83c2-944c8386df63): created successfully Aug 11 04:45:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86e0ea4b-e823-47b2-89ce-c1a27339ad5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:45:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] Flow 'volume_create_manager' (accd5aec-2053-4ecf-bf89-cc3d336f41fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:45:38 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-663b1457-8573-40e9-ac8a-13123dcb97df tempest-TestInstancesWithCinderVolumes-171766842 None] Created volume successfully. Aug 11 04:45:39 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-e694679c-0585-4d66-b76d-b264958a2c4e tempest-ServersNegativeTestJSON-331919477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:45:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e694679c-0585-4d66-b76d-b264958a2c4e tempest-ServersNegativeTestJSON-331919477 None] Flow 'volume_create_manager' (eebc0826-6998-48cb-8203-f20b5784dab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:45:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e694679c-0585-4d66-b76d-b264958a2c4e tempest-ServersNegativeTestJSON-331919477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebd07cfe-dd1e-4846-9ae9-10d20072d0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:45:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e694679c-0585-4d66-b76d-b264958a2c4e tempest-ServersNegativeTestJSON-331919477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebd07cfe-dd1e-4846-9ae9-10d20072d0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:45:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-588299232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4613e46-6575-4f6b-abb2-f1c81c25cd07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b179ff1c5d744fcb46787ffb00c0053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:45:40Z,use_quota=True,user_id='26d71f9c2c9c41faa761e4f90d0aa854',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:45:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e694679c-0585-4d66-b76d-b264958a2c4e tempest-ServersNegativeTestJSON-331919477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c5e63eb-559e-45ae-958a-792aa0ac80b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:45:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e694679c-0585-4d66-b76d-b264958a2c4e tempest-ServersNegativeTestJSON-331919477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c5e63eb-559e-45ae-958a-792aa0ac80b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:45:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e694679c-0585-4d66-b76d-b264958a2c4e tempest-ServersNegativeTestJSON-331919477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (185722d0-26d3-4ac9-a32d-f652f56b8142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:45:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e694679c-0585-4d66-b76d-b264958a2c4e tempest-ServersNegativeTestJSON-331919477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (185722d0-26d3-4ac9-a32d-f652f56b8142) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4613e46-6575-4f6b-abb2-f1c81c25cd07', 'volume_name': 'volume-f4613e46-6575-4f6b-abb2-f1c81c25cd07', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:45:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e694679c-0585-4d66-b76d-b264958a2c4e tempest-ServersNegativeTestJSON-331919477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c952878-f56f-4406-94a9-0c46a3df6201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:45:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e694679c-0585-4d66-b76d-b264958a2c4e tempest-ServersNegativeTestJSON-331919477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c952878-f56f-4406-94a9-0c46a3df6201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:45:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e694679c-0585-4d66-b76d-b264958a2c4e tempest-ServersNegativeTestJSON-331919477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92d155cb-67aa-4eae-91a6-d88693e1fa8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:45:39 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-e694679c-0585-4d66-b76d-b264958a2c4e tempest-ServersNegativeTestJSON-331919477 None] Volume f4613e46-6575-4f6b-abb2-f1c81c25cd07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4613e46-6575-4f6b-abb2-f1c81c25cd07', 'volume_size': 1} Aug 11 04:45:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e694679c-0585-4d66-b76d-b264958a2c4e tempest-ServersNegativeTestJSON-331919477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:45:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e694679c-0585-4d66-b76d-b264958a2c4e tempest-ServersNegativeTestJSON-331919477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:45:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e694679c-0585-4d66-b76d-b264958a2c4e tempest-ServersNegativeTestJSON-331919477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:45:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-588299232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4613e46-6575-4f6b-abb2-f1c81c25cd07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b179ff1c5d744fcb46787ffb00c0053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:45:40Z,use_quota=True,user_id='26d71f9c2c9c41faa761e4f90d0aa854',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:45:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-e694679c-0585-4d66-b76d-b264958a2c4e tempest-ServersNegativeTestJSON-331919477 None] Creating volume f4613e46-6575-4f6b-abb2-f1c81c25cd07 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:45:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e694679c-0585-4d66-b76d-b264958a2c4e tempest-ServersNegativeTestJSON-331919477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:45:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e694679c-0585-4d66-b76d-b264958a2c4e tempest-ServersNegativeTestJSON-331919477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:45:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e694679c-0585-4d66-b76d-b264958a2c4e tempest-ServersNegativeTestJSON-331919477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:45:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e694679c-0585-4d66-b76d-b264958a2c4e tempest-ServersNegativeTestJSON-331919477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:45:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e694679c-0585-4d66-b76d-b264958a2c4e tempest-ServersNegativeTestJSON-331919477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:45:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e694679c-0585-4d66-b76d-b264958a2c4e tempest-ServersNegativeTestJSON-331919477 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:45:39 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-e694679c-0585-4d66-b76d-b264958a2c4e tempest-ServersNegativeTestJSON-331919477 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:45:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e694679c-0585-4d66-b76d-b264958a2c4e tempest-ServersNegativeTestJSON-331919477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f4613e46-6575-4f6b-abb2-f1c81c25cd07 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:45:40 devstack sudo[105177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f4613e46-6575-4f6b-abb2-f1c81c25cd07 1073741824 Aug 11 04:45:40 devstack sudo[105177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:45:41 devstack sudo[105177]: pam_unix(sudo:session): session closed for user root Aug 11 04:45:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e694679c-0585-4d66-b76d-b264958a2c4e tempest-ServersNegativeTestJSON-331919477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f4613e46-6575-4f6b-abb2-f1c81c25cd07 1073741824" returned: 0 in 1.058s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:45:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e694679c-0585-4d66-b76d-b264958a2c4e tempest-ServersNegativeTestJSON-331919477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f4613e46-6575-4f6b-abb2-f1c81c25cd07 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:45:41 devstack sudo[105210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f4613e46-6575-4f6b-abb2-f1c81c25cd07 Aug 11 04:45:41 devstack sudo[105210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:45:41 devstack sudo[105210]: pam_unix(sudo:session): session closed for user root Aug 11 04:45:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e694679c-0585-4d66-b76d-b264958a2c4e tempest-ServersNegativeTestJSON-331919477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f4613e46-6575-4f6b-abb2-f1c81c25cd07" returned: 0 in 0.383s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:45:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e694679c-0585-4d66-b76d-b264958a2c4e tempest-ServersNegativeTestJSON-331919477 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:45:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e694679c-0585-4d66-b76d-b264958a2c4e tempest-ServersNegativeTestJSON-331919477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:45:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e694679c-0585-4d66-b76d-b264958a2c4e tempest-ServersNegativeTestJSON-331919477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92d155cb-67aa-4eae-91a6-d88693e1fa8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4613e46-6575-4f6b-abb2-f1c81c25cd07', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:45:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e694679c-0585-4d66-b76d-b264958a2c4e tempest-ServersNegativeTestJSON-331919477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e2e15a7-a1b7-4ec6-947c-26bf09d12144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:45:41 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-e694679c-0585-4d66-b76d-b264958a2c4e tempest-ServersNegativeTestJSON-331919477 None] Volume volume-f4613e46-6575-4f6b-abb2-f1c81c25cd07 (f4613e46-6575-4f6b-abb2-f1c81c25cd07): created successfully Aug 11 04:45:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e694679c-0585-4d66-b76d-b264958a2c4e tempest-ServersNegativeTestJSON-331919477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e2e15a7-a1b7-4ec6-947c-26bf09d12144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:45:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e694679c-0585-4d66-b76d-b264958a2c4e tempest-ServersNegativeTestJSON-331919477 None] Flow 'volume_create_manager' (eebc0826-6998-48cb-8203-f20b5784dab5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:45:41 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-e694679c-0585-4d66-b76d-b264958a2c4e tempest-ServersNegativeTestJSON-331919477 None] Created volume successfully. Aug 11 04:45:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-703cfd39-9479-47b0-92f2-a54541a302a8 tempest-ServersNegativeTestJSON-331919477 None] Acquiring lock "cinder-f4613e46-6575-4f6b-abb2-f1c81c25cd07-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:45:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-703cfd39-9479-47b0-92f2-a54541a302a8 tempest-ServersNegativeTestJSON-331919477 None] Lock "cinder-f4613e46-6575-4f6b-abb2-f1c81c25cd07-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:45:43 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:UPDATE=28,cinder:SELECT=40,cinder:DELETE=5,cinder:INSERT=18 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:45:43 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=42,cinder:INSERT=13,cinder:UPDATE=31,cinder:DELETE=2 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:45:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-703cfd39-9479-47b0-92f2-a54541a302a8 tempest-ServersNegativeTestJSON-331919477 None] Acquiring lock "cinder-quobyte-f4613e46-6575-4f6b-abb2-f1c81c25cd07" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:45:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-703cfd39-9479-47b0-92f2-a54541a302a8 tempest-ServersNegativeTestJSON-331919477 None] Lock "cinder-quobyte-f4613e46-6575-4f6b-abb2-f1c81c25cd07" acquired by "delete_volume" :: waited 0.028s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:45:43 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4cbc214-4cbd-4f78-8511-9c10881c4ff9]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:45:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-703cfd39-9479-47b0-92f2-a54541a302a8 tempest-ServersNegativeTestJSON-331919477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f4613e46-6575-4f6b-abb2-f1c81c25cd07 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:45:44 devstack sudo[105245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f4613e46-6575-4f6b-abb2-f1c81c25cd07 Aug 11 04:45:44 devstack sudo[105245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:45:44 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e9cbfc7a-3536-49bd-bde3-596faf1bd485 tempest-VolumesActionsTest-99843155 None] Acquiring lock "cinder-685ffaeb-bf6c-46be-8fdd-4e856d53622a" by "attach_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:45:44 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e9cbfc7a-3536-49bd-bde3-596faf1bd485 tempest-VolumesActionsTest-99843155 None] Lock "cinder-685ffaeb-bf6c-46be-8fdd-4e856d53622a" acquired by "attach_volume" :: waited 0.104s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:45:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-6c1584a8-c659-4582-9a1d-d1eabe35074d req-072bcf72-5955-4407-8adc-184b8cba2df1 tempest-TestInstancesWithCinderVolumes-171766842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:45:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-6c1584a8-c659-4582-9a1d-d1eabe35074d req-072bcf72-5955-4407-8adc-184b8cba2df1 tempest-TestInstancesWithCinderVolumes-171766842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:45:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-6c1584a8-c659-4582-9a1d-d1eabe35074d req-072bcf72-5955-4407-8adc-184b8cba2df1 tempest-TestInstancesWithCinderVolumes-171766842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:45:44 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-e9cbfc7a-3536-49bd-bde3-596faf1bd485 tempest-VolumesActionsTest-99843155 None] Attaching volume 685ffaeb-bf6c-46be-8fdd-4e856d53622a to instance e82796c1-2689-45e7-8f73-71e0c5a21273 at mountpoint /dev/vdb on host None. Aug 11 04:45:44 devstack sudo[105245]: pam_unix(sudo:session): session closed for user root Aug 11 04:45:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-6c1584a8-c659-4582-9a1d-d1eabe35074d req-072bcf72-5955-4407-8adc-184b8cba2df1 tempest-TestInstancesWithCinderVolumes-171766842 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd', 'name': 'volume-bf842bbf-a991-4e46-83c2-944c8386df63', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '11ad9e28-1a36-4b46-b88c-b3e26f08484d', 'enforce_multipath': True} {{(pid=94472) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 11 04:45:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-703cfd39-9479-47b0-92f2-a54541a302a8 tempest-ServersNegativeTestJSON-331919477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f4613e46-6575-4f6b-abb2-f1c81c25cd07" returned: 0 in 0.842s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:45:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-703cfd39-9479-47b0-92f2-a54541a302a8 tempest-ServersNegativeTestJSON-331919477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f4613e46-6575-4f6b-abb2-f1c81c25cd07 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:45:44 devstack sudo[105282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f4613e46-6575-4f6b-abb2-f1c81c25cd07 Aug 11 04:45:44 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:45:44 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-e9cbfc7a-3536-49bd-bde3-596faf1bd485 tempest-VolumesActionsTest-99843155 None] Attach volume completed successfully. Aug 11 04:45:44 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e9cbfc7a-3536-49bd-bde3-596faf1bd485 tempest-VolumesActionsTest-99843155 None] Lock "cinder-685ffaeb-bf6c-46be-8fdd-4e856d53622a" released by "attach_volume" :: held 0.329s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:45:44 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-6c1584a8-c659-4582-9a1d-d1eabe35074d req-072bcf72-5955-4407-8adc-184b8cba2df1 tempest-TestInstancesWithCinderVolumes-171766842 None] attachment_update completed successfully. Aug 11 04:45:45 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root Aug 11 04:45:45 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b4dea246-6ebb-4830-8655-d134f4f307a5 tempest-VolumesActionsTest-99843155 None] Acquiring lock "cinder-685ffaeb-bf6c-46be-8fdd-4e856d53622a-detach_volume" by "detach_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:45:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-703cfd39-9479-47b0-92f2-a54541a302a8 tempest-ServersNegativeTestJSON-331919477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f4613e46-6575-4f6b-abb2-f1c81c25cd07" returned: 0 in 0.695s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:45:45 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b4dea246-6ebb-4830-8655-d134f4f307a5 tempest-VolumesActionsTest-99843155 None] Lock "cinder-685ffaeb-bf6c-46be-8fdd-4e856d53622a-detach_volume" acquired by "detach_volume" :: waited 0.082s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:45:45 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-b4dea246-6ebb-4830-8655-d134f4f307a5 tempest-VolumesActionsTest-99843155 None] Detaching volume 685ffaeb-bf6c-46be-8fdd-4e856d53622a from instance e82796c1-2689-45e7-8f73-71e0c5a21273. Aug 11 04:45:45 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-703cfd39-9479-47b0-92f2-a54541a302a8 tempest-ServersNegativeTestJSON-331919477 None] Lock "cinder-quobyte-f4613e46-6575-4f6b-abb2-f1c81c25cd07" released by "delete_volume" :: held 1.670s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:45:45 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-b4dea246-6ebb-4830-8655-d134f4f307a5 tempest-VolumesActionsTest-99843155 None] Detach volume completed successfully. Aug 11 04:45:45 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b4dea246-6ebb-4830-8655-d134f4f307a5 tempest-VolumesActionsTest-99843155 None] Lock "cinder-685ffaeb-bf6c-46be-8fdd-4e856d53622a-detach_volume" released by "detach_volume" :: held 0.198s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:45:45 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-703cfd39-9479-47b0-92f2-a54541a302a8 tempest-ServersNegativeTestJSON-331919477 None] Created reservations ['d414f3fa-7670-453d-8e67-b5eb49ed9071', 'f3a96b18-c103-4b2c-a232-c601ff8a45c7', '947d4236-3dcc-4422-8bee-f21e51c8acc2', '72ac9747-953b-4f91-b281-68af7347e2ad'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:45:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-703cfd39-9479-47b0-92f2-a54541a302a8 tempest-ServersNegativeTestJSON-331919477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:45:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-703cfd39-9479-47b0-92f2-a54541a302a8 tempest-ServersNegativeTestJSON-331919477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:45:45 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-703cfd39-9479-47b0-92f2-a54541a302a8 tempest-ServersNegativeTestJSON-331919477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:45:45 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-703cfd39-9479-47b0-92f2-a54541a302a8 tempest-ServersNegativeTestJSON-331919477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:45:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-703cfd39-9479-47b0-92f2-a54541a302a8 tempest-ServersNegativeTestJSON-331919477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:45:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-703cfd39-9479-47b0-92f2-a54541a302a8 tempest-ServersNegativeTestJSON-331919477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:45:46 devstack sudo[105285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:45:46 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:45:46 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fccc865b-ca20-4767-931b-85e0cfc7ba3b tempest-ServersNegativeTestJSON-331919477 None] Acquiring lock "cinder-8510f341-e091-4906-9388-e5e7cb9f4347-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:45:46 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fccc865b-ca20-4767-931b-85e0cfc7ba3b tempest-ServersNegativeTestJSON-331919477 None] Lock "cinder-8510f341-e091-4906-9388-e5e7cb9f4347-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:45:46 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fccc865b-ca20-4767-931b-85e0cfc7ba3b tempest-ServersNegativeTestJSON-331919477 None] Acquiring lock "cinder-quobyte-8510f341-e091-4906-9388-e5e7cb9f4347" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:45:46 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fccc865b-ca20-4767-931b-85e0cfc7ba3b tempest-ServersNegativeTestJSON-331919477 None] Lock "cinder-quobyte-8510f341-e091-4906-9388-e5e7cb9f4347" acquired by "delete_volume" :: waited 0.042s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:45:46 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[62410810-f0b8-428c-99d1-4faa24e0ace3]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:45:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fccc865b-ca20-4767-931b-85e0cfc7ba3b tempest-ServersNegativeTestJSON-331919477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8510f341-e091-4906-9388-e5e7cb9f4347 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:45:46 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root Aug 11 04:45:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-703cfd39-9479-47b0-92f2-a54541a302a8 tempest-ServersNegativeTestJSON-331919477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.724s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:45:46 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-703cfd39-9479-47b0-92f2-a54541a302a8 tempest-ServersNegativeTestJSON-331919477 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:45:46 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-703cfd39-9479-47b0-92f2-a54541a302a8 tempest-ServersNegativeTestJSON-331919477 None] Deleted volume successfully. Aug 11 04:45:46 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-703cfd39-9479-47b0-92f2-a54541a302a8 tempest-ServersNegativeTestJSON-331919477 None] Lock "cinder-f4613e46-6575-4f6b-abb2-f1c81c25cd07-delete_volume" released by "delete_volume" :: held 3.031s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:45:46 devstack sudo[105290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8510f341-e091-4906-9388-e5e7cb9f4347 Aug 11 04:45:46 devstack sudo[105290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:45:47 devstack sudo[105290]: pam_unix(sudo:session): session closed for user root Aug 11 04:45:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fccc865b-ca20-4767-931b-85e0cfc7ba3b tempest-ServersNegativeTestJSON-331919477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8510f341-e091-4906-9388-e5e7cb9f4347" returned: 0 in 0.621s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:45:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fccc865b-ca20-4767-931b-85e0cfc7ba3b tempest-ServersNegativeTestJSON-331919477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8510f341-e091-4906-9388-e5e7cb9f4347 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:45:47 devstack sudo[105314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8510f341-e091-4906-9388-e5e7cb9f4347 Aug 11 04:45:47 devstack sudo[105314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:45:47 devstack sudo[105314]: pam_unix(sudo:session): session closed for user root Aug 11 04:45:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fccc865b-ca20-4767-931b-85e0cfc7ba3b tempest-ServersNegativeTestJSON-331919477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8510f341-e091-4906-9388-e5e7cb9f4347" returned: 0 in 0.368s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:45:47 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fccc865b-ca20-4767-931b-85e0cfc7ba3b tempest-ServersNegativeTestJSON-331919477 None] Lock "cinder-quobyte-8510f341-e091-4906-9388-e5e7cb9f4347" released by "delete_volume" :: held 1.094s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:45:47 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-fccc865b-ca20-4767-931b-85e0cfc7ba3b tempest-ServersNegativeTestJSON-331919477 None] Created reservations ['b7f5ef5a-ae98-40c3-a868-bd6923bb91d4', '432ec630-17d6-46cf-aea6-70bb21d73307', 'b349fb58-deda-4aa5-a39c-c3bc529b50a7', '32b172f8-ff7d-4747-8dad-c31177e78aeb'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:45:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fccc865b-ca20-4767-931b-85e0cfc7ba3b tempest-ServersNegativeTestJSON-331919477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:45:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fccc865b-ca20-4767-931b-85e0cfc7ba3b tempest-ServersNegativeTestJSON-331919477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:45:47 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-fccc865b-ca20-4767-931b-85e0cfc7ba3b tempest-ServersNegativeTestJSON-331919477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:45:47 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-fccc865b-ca20-4767-931b-85e0cfc7ba3b tempest-ServersNegativeTestJSON-331919477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:45:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fccc865b-ca20-4767-931b-85e0cfc7ba3b tempest-ServersNegativeTestJSON-331919477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:45:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fccc865b-ca20-4767-931b-85e0cfc7ba3b tempest-ServersNegativeTestJSON-331919477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:45:47 devstack sudo[105324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:45:47 devstack sudo[105324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:45:48 devstack sudo[105324]: pam_unix(sudo:session): session closed for user root Aug 11 04:45:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fccc865b-ca20-4767-931b-85e0cfc7ba3b tempest-ServersNegativeTestJSON-331919477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.343s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:45:48 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-fccc865b-ca20-4767-931b-85e0cfc7ba3b tempest-ServersNegativeTestJSON-331919477 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:45:48 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-fccc865b-ca20-4767-931b-85e0cfc7ba3b tempest-ServersNegativeTestJSON-331919477 None] Deleted volume successfully. Aug 11 04:45:48 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fccc865b-ca20-4767-931b-85e0cfc7ba3b tempest-ServersNegativeTestJSON-331919477 None] Lock "cinder-8510f341-e091-4906-9388-e5e7cb9f4347-delete_volume" released by "delete_volume" :: held 1.901s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:45:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-eccb8486-2ffe-4a65-8fd2-3eaab6f65ab0 tempest-VolumesActionsTest-99843155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:45:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-eccb8486-2ffe-4a65-8fd2-3eaab6f65ab0 tempest-VolumesActionsTest-99843155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:45:52 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[568d2014-2475-4f86-94cd-6f33ee2e4d60]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:45:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-eccb8486-2ffe-4a65-8fd2-3eaab6f65ab0 tempest-VolumesActionsTest-99843155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-685ffaeb-bf6c-46be-8fdd-4e856d53622a {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:45:52 devstack sudo[105447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-685ffaeb-bf6c-46be-8fdd-4e856d53622a Aug 11 04:45:52 devstack sudo[105447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:45:52 devstack sudo[105447]: pam_unix(sudo:session): session closed for user root Aug 11 04:45:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-eccb8486-2ffe-4a65-8fd2-3eaab6f65ab0 tempest-VolumesActionsTest-99843155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-685ffaeb-bf6c-46be-8fdd-4e856d53622a" returned: 0 in 0.445s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:45:53 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[af27ee6c-583e-4859-bb70-c931e1d55a58]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:45:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-eccb8486-2ffe-4a65-8fd2-3eaab6f65ab0 tempest-VolumesActionsTest-99843155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-685ffaeb-bf6c-46be-8fdd-4e856d53622a {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:45:53 devstack sudo[105455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-685ffaeb-bf6c-46be-8fdd-4e856d53622a Aug 11 04:45:53 devstack sudo[105455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:45:53 devstack sudo[105455]: pam_unix(sudo:session): session closed for user root Aug 11 04:45:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-eccb8486-2ffe-4a65-8fd2-3eaab6f65ab0 tempest-VolumesActionsTest-99843155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-685ffaeb-bf6c-46be-8fdd-4e856d53622a" returned: 0 in 0.449s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:45:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-eccb8486-2ffe-4a65-8fd2-3eaab6f65ab0 tempest-VolumesActionsTest-99843155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-685ffaeb-bf6c-46be-8fdd-4e856d53622a /opt/stack/data/cinder/conversion/685ffaeb-bf6c-46be-8fdd-4e856d53622a.temp_image.29fdb345-4c51-4d4b-ab35-118a2e5a1c53agkuxmd9.img {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:45:53 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-685ffaeb-bf6c-46be-8fdd-4e856d53622a /opt/stack/data/cinder/conversion/685ffaeb-bf6c-46be-8fdd-4e856d53622a.temp_image.29fdb345-4c51-4d4b-ab35-118a2e5a1c53agkuxmd9.img Aug 11 04:45:53 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:45:58 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:INSERT=4,cinder:SELECT=22,cinder:UPDATE=16,cinder:DELETE=1 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:45:58 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 04:45:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:45:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:45:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:45:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:45:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:45:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:45:58 devstack sudo[105474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:45:58 devstack sudo[105474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:45:59 devstack sudo[105474]: pam_unix(sudo:session): session closed for user root Aug 11 04:45:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.581s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:45:59 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:45:59 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running periodic task VolumeManager._thread_info {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 04:45:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] thread count: 28 {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 11 04:45:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] thread info: [<_MainThread(MainThread, started 133315846115456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 11 04:46:00 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Aug 11 04:46:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-eccb8486-2ffe-4a65-8fd2-3eaab6f65ab0 tempest-VolumesActionsTest-99843155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-685ffaeb-bf6c-46be-8fdd-4e856d53622a /opt/stack/data/cinder/conversion/685ffaeb-bf6c-46be-8fdd-4e856d53622a.temp_image.29fdb345-4c51-4d4b-ab35-118a2e5a1c53agkuxmd9.img" returned: 0 in 7.245s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:46:00 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[33241f8e-fba2-4bcd-8d57-53ab86b0bf22]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:46:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-eccb8486-2ffe-4a65-8fd2-3eaab6f65ab0 tempest-VolumesActionsTest-99843155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-685ffaeb-bf6c-46be-8fdd-4e856d53622a {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:46:00 devstack sudo[105479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-685ffaeb-bf6c-46be-8fdd-4e856d53622a Aug 11 04:46:00 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:46:01 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root Aug 11 04:46:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-eccb8486-2ffe-4a65-8fd2-3eaab6f65ab0 tempest-VolumesActionsTest-99843155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-685ffaeb-bf6c-46be-8fdd-4e856d53622a" returned: 0 in 0.696s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:46:01 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-eccb8486-2ffe-4a65-8fd2-3eaab6f65ab0 tempest-VolumesActionsTest-99843155 None] Image conversion details: src /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-685ffaeb-bf6c-46be-8fdd-4e856d53622a, size 1024.00 MB, duration 7.25 sec, destination /opt/stack/data/cinder/conversion/685ffaeb-bf6c-46be-8fdd-4e856d53622a.temp_image.29fdb345-4c51-4d4b-ab35-118a2e5a1c53agkuxmd9.img {{(pid=94472) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 11 04:46:01 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-eccb8486-2ffe-4a65-8fd2-3eaab6f65ab0 tempest-VolumesActionsTest-99843155 None] Converted 1024.00 MB image at 141.30 MB/s Aug 11 04:46:01 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-eccb8486-2ffe-4a65-8fd2-3eaab6f65ab0 tempest-VolumesActionsTest-99843155 None] 29fdb345-4c51-4d4b-ab35-118a2e5a1c53 was raw, no need to convert to raw {{(pid=94472) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 11 04:46:11 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=1 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:46:11 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=25,cinder:INSERT=6,cinder:UPDATE=24,cinder:DELETE=1 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:46:13 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-e3bfee52-bf2b-455d-b64c-c611fd906451 req-8f509ccd-3970-49a2-ba9b-ec3ef4ef5252 tempest-TestShelveInstance-639944802 None] Terminate volume connection completed successfully. Aug 11 04:46:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-e3bfee52-bf2b-455d-b64c-c611fd906451 req-8f509ccd-3970-49a2-ba9b-ec3ef4ef5252 tempest-TestShelveInstance-639944802 None] Deleting attachment 78d4a0d1-41a1-44cb-acff-2ef11a7a7722. {{(pid=94472) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 11 04:46:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-20ee6672-06d8-4fbc-b262-f8e8c08f11b6 req-7e1b85ac-8fb9-4705-8a2d-5af61d31cdf5 tempest-TestShelveInstance-639944802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:46:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-9c1268ec-12a7-49f6-bf06-cac8d03b4ea4 req-5490d089-0bc6-499a-bae5-969ff3dbcad9 tempest-TestInstancesWithCinderVolumes-171766842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:46:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-eccb8486-2ffe-4a65-8fd2-3eaab6f65ab0 tempest-VolumesActionsTest-99843155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 37.307s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:46:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-eccb8486-2ffe-4a65-8fd2-3eaab6f65ab0 tempest-VolumesActionsTest-99843155 None] Uploaded volume to glance image-id: 29fdb345-4c51-4d4b-ab35-118a2e5a1c53. {{(pid=94472) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 11 04:46:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-20ee6672-06d8-4fbc-b262-f8e8c08f11b6 req-7e1b85ac-8fb9-4705-8a2d-5af61d31cdf5 tempest-TestShelveInstance-639944802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 13.059s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:46:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-20ee6672-06d8-4fbc-b262-f8e8c08f11b6 req-7e1b85ac-8fb9-4705-8a2d-5af61d31cdf5 tempest-TestShelveInstance-639944802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:46:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-9c1268ec-12a7-49f6-bf06-cac8d03b4ea4 req-5490d089-0bc6-499a-bae5-969ff3dbcad9 tempest-TestInstancesWithCinderVolumes-171766842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.666s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:46:29 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-eccb8486-2ffe-4a65-8fd2-3eaab6f65ab0 tempest-VolumesActionsTest-99843155 None] Copy volume to image completed successfully. Aug 11 04:46:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-9c1268ec-12a7-49f6-bf06-cac8d03b4ea4 req-5490d089-0bc6-499a-bae5-969ff3dbcad9 tempest-TestInstancesWithCinderVolumes-171766842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:46:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-20ee6672-06d8-4fbc-b262-f8e8c08f11b6 req-7e1b85ac-8fb9-4705-8a2d-5af61d31cdf5 tempest-TestShelveInstance-639944802 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd', 'name': 'volume-1743ec6c-d666-424a-83b2-91752b9f4caa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd3f7b4dc-dcb5-44c5-a738-bf7ccd68a6ea', 'enforce_multipath': True} {{(pid=94472) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 11 04:46:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-9c1268ec-12a7-49f6-bf06-cac8d03b4ea4 req-5490d089-0bc6-499a-bae5-969ff3dbcad9 tempest-TestInstancesWithCinderVolumes-171766842 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd', 'name': 'volume-7b4d620d-a5c9-4c49-a35b-810a9e072719', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3f7f6274-dd03-4b86-ba3b-a81f12639a49', 'enforce_multipath': True} {{(pid=94472) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 11 04:46:29 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-20ee6672-06d8-4fbc-b262-f8e8c08f11b6 req-7e1b85ac-8fb9-4705-8a2d-5af61d31cdf5 tempest-TestShelveInstance-639944802 None] attachment_update completed successfully. Aug 11 04:46:29 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-9c1268ec-12a7-49f6-bf06-cac8d03b4ea4 req-5490d089-0bc6-499a-bae5-969ff3dbcad9 tempest-TestInstancesWithCinderVolumes-171766842 None] attachment_update completed successfully. Aug 11 04:46:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-20cc9284-b21a-4964-952c-f13e9cd9c38a tempest-VolumesActionsTest-99843155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:46:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-20cc9284-b21a-4964-952c-f13e9cd9c38a tempest-VolumesActionsTest-99843155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:46:31 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e91ce41-4dcd-4459-a7db-7370cd7d9d2d]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:46:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-20cc9284-b21a-4964-952c-f13e9cd9c38a tempest-VolumesActionsTest-99843155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-685ffaeb-bf6c-46be-8fdd-4e856d53622a {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:46:32 devstack sudo[105681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-685ffaeb-bf6c-46be-8fdd-4e856d53622a Aug 11 04:46:32 devstack sudo[105681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:46:32 devstack sudo[105681]: pam_unix(sudo:session): session closed for user root Aug 11 04:46:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-20cc9284-b21a-4964-952c-f13e9cd9c38a tempest-VolumesActionsTest-99843155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-685ffaeb-bf6c-46be-8fdd-4e856d53622a" returned: 0 in 0.778s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:46:32 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b8ccd1-d8ee-479f-938c-f99746fa43ec]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:46:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-20cc9284-b21a-4964-952c-f13e9cd9c38a tempest-VolumesActionsTest-99843155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-685ffaeb-bf6c-46be-8fdd-4e856d53622a {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:46:32 devstack sudo[105710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-685ffaeb-bf6c-46be-8fdd-4e856d53622a Aug 11 04:46:32 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:46:33 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root Aug 11 04:46:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-20cc9284-b21a-4964-952c-f13e9cd9c38a tempest-VolumesActionsTest-99843155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-685ffaeb-bf6c-46be-8fdd-4e856d53622a" returned: 0 in 0.581s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:46:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-20cc9284-b21a-4964-952c-f13e9cd9c38a tempest-VolumesActionsTest-99843155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-685ffaeb-bf6c-46be-8fdd-4e856d53622a /opt/stack/data/cinder/conversion/685ffaeb-bf6c-46be-8fdd-4e856d53622a.temp_image.538ab1c9-4d13-42fc-8cbf-8afe92bc90e2_o7spqpz.img {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:46:33 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-685ffaeb-bf6c-46be-8fdd-4e856d53622a /opt/stack/data/cinder/conversion/685ffaeb-bf6c-46be-8fdd-4e856d53622a.temp_image.538ab1c9-4d13-42fc-8cbf-8afe92bc90e2_o7spqpz.img Aug 11 04:46:33 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:46:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-a8c8c1d3-2c2a-449f-802b-19e9bd5f7e4a req-7a4871f9-e7f7-4298-bd30-8f163b2533f1 tempest-TestInstancesWithCinderVolumes-171766842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:46:40 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Aug 11 04:46:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-20cc9284-b21a-4964-952c-f13e9cd9c38a tempest-VolumesActionsTest-99843155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-685ffaeb-bf6c-46be-8fdd-4e856d53622a /opt/stack/data/cinder/conversion/685ffaeb-bf6c-46be-8fdd-4e856d53622a.temp_image.538ab1c9-4d13-42fc-8cbf-8afe92bc90e2_o7spqpz.img" returned: 0 in 7.486s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:46:40 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f39b3d0-2187-43ca-95df-997c320794fc]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:46:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-20cc9284-b21a-4964-952c-f13e9cd9c38a tempest-VolumesActionsTest-99843155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-685ffaeb-bf6c-46be-8fdd-4e856d53622a {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:46:40 devstack sudo[105824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-685ffaeb-bf6c-46be-8fdd-4e856d53622a Aug 11 04:46:40 devstack sudo[105824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:46:41 devstack sudo[105824]: pam_unix(sudo:session): session closed for user root Aug 11 04:46:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-20cc9284-b21a-4964-952c-f13e9cd9c38a tempest-VolumesActionsTest-99843155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-685ffaeb-bf6c-46be-8fdd-4e856d53622a" returned: 0 in 0.892s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:46:41 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-20cc9284-b21a-4964-952c-f13e9cd9c38a tempest-VolumesActionsTest-99843155 None] Image conversion details: src /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-685ffaeb-bf6c-46be-8fdd-4e856d53622a, size 1024.00 MB, duration 7.49 sec, destination /opt/stack/data/cinder/conversion/685ffaeb-bf6c-46be-8fdd-4e856d53622a.temp_image.538ab1c9-4d13-42fc-8cbf-8afe92bc90e2_o7spqpz.img {{(pid=94472) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 11 04:46:41 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-20cc9284-b21a-4964-952c-f13e9cd9c38a tempest-VolumesActionsTest-99843155 None] Converted 1024.00 MB image at 136.76 MB/s Aug 11 04:46:41 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-20cc9284-b21a-4964-952c-f13e9cd9c38a tempest-VolumesActionsTest-99843155 None] 538ab1c9-4d13-42fc-8cbf-8afe92bc90e2 was raw, converting to qcow2 {{(pid=94472) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Aug 11 04:46:41 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[33097b53-0a61-4071-9cec-e7ca1e9c8a46]: (4, 'raw') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:46:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-20cc9284-b21a-4964-952c-f13e9cd9c38a tempest-VolumesActionsTest-99843155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/685ffaeb-bf6c-46be-8fdd-4e856d53622a.temp_image.538ab1c9-4d13-42fc-8cbf-8afe92bc90e2_o7spqpz.img {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:46:41 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/685ffaeb-bf6c-46be-8fdd-4e856d53622a.temp_image.538ab1c9-4d13-42fc-8cbf-8afe92bc90e2_o7spqpz.img Aug 11 04:46:41 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:46:42 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Aug 11 04:46:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-20cc9284-b21a-4964-952c-f13e9cd9c38a tempest-VolumesActionsTest-99843155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/685ffaeb-bf6c-46be-8fdd-4e856d53622a.temp_image.538ab1c9-4d13-42fc-8cbf-8afe92bc90e2_o7spqpz.img" returned: 0 in 0.517s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:46:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-20cc9284-b21a-4964-952c-f13e9cd9c38a tempest-VolumesActionsTest-99843155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/685ffaeb-bf6c-46be-8fdd-4e856d53622a.temp_image.538ab1c9-4d13-42fc-8cbf-8afe92bc90e2_o7spqpz.img {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:46:42 devstack sudo[105850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/685ffaeb-bf6c-46be-8fdd-4e856d53622a.temp_image.538ab1c9-4d13-42fc-8cbf-8afe92bc90e2_o7spqpz.img Aug 11 04:46:42 devstack sudo[105850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:46:42 devstack sudo[105850]: pam_unix(sudo:session): session closed for user root Aug 11 04:46:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-20cc9284-b21a-4964-952c-f13e9cd9c38a tempest-VolumesActionsTest-99843155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/685ffaeb-bf6c-46be-8fdd-4e856d53622a.temp_image.538ab1c9-4d13-42fc-8cbf-8afe92bc90e2_o7spqpz.img" returned: 1 in 0.597s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:46:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-20cc9284-b21a-4964-952c-f13e9cd9c38a tempest-VolumesActionsTest-99843155 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/685ffaeb-bf6c-46be-8fdd-4e856d53622a.temp_image.538ab1c9-4d13-42fc-8cbf-8afe92bc90e2_o7spqpz.img' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 11 04:46:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-20cc9284-b21a-4964-952c-f13e9cd9c38a tempest-VolumesActionsTest-99843155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/685ffaeb-bf6c-46be-8fdd-4e856d53622a.temp_image.538ab1c9-4d13-42fc-8cbf-8afe92bc90e2_o7spqpz.img /opt/stack/data/cinder/conversion/vol_upload_wa7pfh2a {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:46:42 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/685ffaeb-bf6c-46be-8fdd-4e856d53622a.temp_image.538ab1c9-4d13-42fc-8cbf-8afe92bc90e2_o7spqpz.img /opt/stack/data/cinder/conversion/vol_upload_wa7pfh2a Aug 11 04:46:42 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:46:43 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Aug 11 04:46:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-20cc9284-b21a-4964-952c-f13e9cd9c38a tempest-VolumesActionsTest-99843155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/685ffaeb-bf6c-46be-8fdd-4e856d53622a.temp_image.538ab1c9-4d13-42fc-8cbf-8afe92bc90e2_o7spqpz.img /opt/stack/data/cinder/conversion/vol_upload_wa7pfh2a" returned: 0 in 0.414s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:46:43 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-20cc9284-b21a-4964-952c-f13e9cd9c38a tempest-VolumesActionsTest-99843155 None] Image conversion details: src /opt/stack/data/cinder/conversion/685ffaeb-bf6c-46be-8fdd-4e856d53622a.temp_image.538ab1c9-4d13-42fc-8cbf-8afe92bc90e2_o7spqpz.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_wa7pfh2a {{(pid=94472) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 11 04:46:43 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-20cc9284-b21a-4964-952c-f13e9cd9c38a tempest-VolumesActionsTest-99843155 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 11 04:46:43 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e65ceb5-6f1b-4e21-9df5-225bfe009a18]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:46:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-20cc9284-b21a-4964-952c-f13e9cd9c38a tempest-VolumesActionsTest-99843155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_wa7pfh2a {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:46:43 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_wa7pfh2a Aug 11 04:46:43 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:46:43 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Aug 11 04:46:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-20cc9284-b21a-4964-952c-f13e9cd9c38a tempest-VolumesActionsTest-99843155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_wa7pfh2a" returned: 0 in 0.342s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:46:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-20cc9284-b21a-4964-952c-f13e9cd9c38a tempest-VolumesActionsTest-99843155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.509s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:46:45 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-20cc9284-b21a-4964-952c-f13e9cd9c38a tempest-VolumesActionsTest-99843155 None] Uploaded volume to glance image-id: 538ab1c9-4d13-42fc-8cbf-8afe92bc90e2. {{(pid=94472) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 11 04:46:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-a8c8c1d3-2c2a-449f-802b-19e9bd5f7e4a req-7a4871f9-e7f7-4298-bd30-8f163b2533f1 tempest-TestInstancesWithCinderVolumes-171766842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 11.839s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:46:45 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-20cc9284-b21a-4964-952c-f13e9cd9c38a tempest-VolumesActionsTest-99843155 None] Copy volume to image completed successfully. Aug 11 04:46:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-a8c8c1d3-2c2a-449f-802b-19e9bd5f7e4a req-7a4871f9-e7f7-4298-bd30-8f163b2533f1 tempest-TestInstancesWithCinderVolumes-171766842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:46:45 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-a8c8c1d3-2c2a-449f-802b-19e9bd5f7e4a req-7a4871f9-e7f7-4298-bd30-8f163b2533f1 tempest-TestInstancesWithCinderVolumes-171766842 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd', 'name': 'volume-9d5592f5-3dd2-4a3b-8a51-7a649ee689dd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ee725d2a-de20-44e1-8b38-2ec3d1ad881a', 'enforce_multipath': True} {{(pid=94472) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 11 04:46:45 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-a8c8c1d3-2c2a-449f-802b-19e9bd5f7e4a req-7a4871f9-e7f7-4298-bd30-8f163b2533f1 tempest-TestInstancesWithCinderVolumes-171766842 None] attachment_update completed successfully. Aug 11 04:46:46 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4d3236f7-b2ff-4d9c-bf25-5e40b0d4b5e7 tempest-VolumesActionsTest-99843155 None] Acquiring lock "cinder-685ffaeb-bf6c-46be-8fdd-4e856d53622a-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:46:46 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4d3236f7-b2ff-4d9c-bf25-5e40b0d4b5e7 tempest-VolumesActionsTest-99843155 None] Lock "cinder-685ffaeb-bf6c-46be-8fdd-4e856d53622a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:46:47 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4d3236f7-b2ff-4d9c-bf25-5e40b0d4b5e7 tempest-VolumesActionsTest-99843155 None] Acquiring lock "cinder-quobyte-685ffaeb-bf6c-46be-8fdd-4e856d53622a" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:46:47 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4d3236f7-b2ff-4d9c-bf25-5e40b0d4b5e7 tempest-VolumesActionsTest-99843155 None] Lock "cinder-quobyte-685ffaeb-bf6c-46be-8fdd-4e856d53622a" acquired by "delete_volume" :: waited 0.026s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:46:47 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a90637-448b-493f-abb5-48197818fdc5]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:46:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4d3236f7-b2ff-4d9c-bf25-5e40b0d4b5e7 tempest-VolumesActionsTest-99843155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-685ffaeb-bf6c-46be-8fdd-4e856d53622a {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:46:47 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-685ffaeb-bf6c-46be-8fdd-4e856d53622a Aug 11 04:46:47 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:46:47 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Aug 11 04:46:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4d3236f7-b2ff-4d9c-bf25-5e40b0d4b5e7 tempest-VolumesActionsTest-99843155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-685ffaeb-bf6c-46be-8fdd-4e856d53622a" returned: 0 in 0.479s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:46:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4d3236f7-b2ff-4d9c-bf25-5e40b0d4b5e7 tempest-VolumesActionsTest-99843155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-685ffaeb-bf6c-46be-8fdd-4e856d53622a {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:46:47 devstack sudo[105884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-685ffaeb-bf6c-46be-8fdd-4e856d53622a Aug 11 04:46:47 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:46:47 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root Aug 11 04:46:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4d3236f7-b2ff-4d9c-bf25-5e40b0d4b5e7 tempest-VolumesActionsTest-99843155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-685ffaeb-bf6c-46be-8fdd-4e856d53622a" returned: 0 in 0.281s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:46:47 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4d3236f7-b2ff-4d9c-bf25-5e40b0d4b5e7 tempest-VolumesActionsTest-99843155 None] Lock "cinder-quobyte-685ffaeb-bf6c-46be-8fdd-4e856d53622a" released by "delete_volume" :: held 0.811s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:46:47 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-4d3236f7-b2ff-4d9c-bf25-5e40b0d4b5e7 tempest-VolumesActionsTest-99843155 None] Created reservations ['2b1dc5fa-e791-4a62-9ecc-a4f77f7b12fd', '11e00d18-540c-4161-9e18-5e7dc9699020', 'cd03c02e-c6e5-4032-986c-258d0b88a37a', '8791677f-2def-4bd3-8ea8-4918593f22c6'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:46:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4d3236f7-b2ff-4d9c-bf25-5e40b0d4b5e7 tempest-VolumesActionsTest-99843155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:46:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4d3236f7-b2ff-4d9c-bf25-5e40b0d4b5e7 tempest-VolumesActionsTest-99843155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:46:48 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4d3236f7-b2ff-4d9c-bf25-5e40b0d4b5e7 tempest-VolumesActionsTest-99843155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:46:48 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4d3236f7-b2ff-4d9c-bf25-5e40b0d4b5e7 tempest-VolumesActionsTest-99843155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:46:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4d3236f7-b2ff-4d9c-bf25-5e40b0d4b5e7 tempest-VolumesActionsTest-99843155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:46:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4d3236f7-b2ff-4d9c-bf25-5e40b0d4b5e7 tempest-VolumesActionsTest-99843155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:46:48 devstack sudo[105893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:46:48 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:46:48 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root Aug 11 04:46:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4d3236f7-b2ff-4d9c-bf25-5e40b0d4b5e7 tempest-VolumesActionsTest-99843155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.428s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:46:48 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-4d3236f7-b2ff-4d9c-bf25-5e40b0d4b5e7 tempest-VolumesActionsTest-99843155 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:46:48 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-4d3236f7-b2ff-4d9c-bf25-5e40b0d4b5e7 tempest-VolumesActionsTest-99843155 None] Deleted volume successfully. Aug 11 04:46:48 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4d3236f7-b2ff-4d9c-bf25-5e40b0d4b5e7 tempest-VolumesActionsTest-99843155 None] Lock "cinder-685ffaeb-bf6c-46be-8fdd-4e856d53622a-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:46:52 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-31258d97-796d-4c5a-82ea-bca670a3a11b req-fe82ab41-8461-45f0-94a8-d6f12e8c1f95 tempest-TestInstancesWithCinderVolumes-171766842 None] Terminate volume connection completed successfully. Aug 11 04:46:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-31258d97-796d-4c5a-82ea-bca670a3a11b req-fe82ab41-8461-45f0-94a8-d6f12e8c1f95 tempest-TestInstancesWithCinderVolumes-171766842 None] Deleting attachment 3f7f6274-dd03-4b86-ba3b-a81f12639a49. {{(pid=94472) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 11 04:46:52 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8710c06f-e38c-48bc-825f-793bd95a9af4 tempest-TestInstancesWithCinderVolumes-171766842 None] Acquiring lock "cinder-7b4d620d-a5c9-4c49-a35b-810a9e072719-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:46:53 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8710c06f-e38c-48bc-825f-793bd95a9af4 tempest-TestInstancesWithCinderVolumes-171766842 None] Lock "cinder-7b4d620d-a5c9-4c49-a35b-810a9e072719-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:46:53 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8710c06f-e38c-48bc-825f-793bd95a9af4 tempest-TestInstancesWithCinderVolumes-171766842 None] Acquiring lock "cinder-quobyte-7b4d620d-a5c9-4c49-a35b-810a9e072719" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:46:53 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8710c06f-e38c-48bc-825f-793bd95a9af4 tempest-TestInstancesWithCinderVolumes-171766842 None] Lock "cinder-quobyte-7b4d620d-a5c9-4c49-a35b-810a9e072719" acquired by "delete_volume" :: waited 0.026s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:46:53 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6a2552-72ed-473d-93c4-63c39fa0ac06]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:46:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8710c06f-e38c-48bc-825f-793bd95a9af4 tempest-TestInstancesWithCinderVolumes-171766842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7b4d620d-a5c9-4c49-a35b-810a9e072719 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:46:53 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7b4d620d-a5c9-4c49-a35b-810a9e072719 Aug 11 04:46:53 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:46:53 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Aug 11 04:46:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8710c06f-e38c-48bc-825f-793bd95a9af4 tempest-TestInstancesWithCinderVolumes-171766842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7b4d620d-a5c9-4c49-a35b-810a9e072719" returned: 0 in 0.750s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:46:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8710c06f-e38c-48bc-825f-793bd95a9af4 tempest-TestInstancesWithCinderVolumes-171766842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7b4d620d-a5c9-4c49-a35b-810a9e072719 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:46:53 devstack sudo[105965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7b4d620d-a5c9-4c49-a35b-810a9e072719 Aug 11 04:46:53 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:46:54 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root Aug 11 04:46:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8710c06f-e38c-48bc-825f-793bd95a9af4 tempest-TestInstancesWithCinderVolumes-171766842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7b4d620d-a5c9-4c49-a35b-810a9e072719" returned: 0 in 0.387s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:46:54 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8710c06f-e38c-48bc-825f-793bd95a9af4 tempest-TestInstancesWithCinderVolumes-171766842 None] Lock "cinder-quobyte-7b4d620d-a5c9-4c49-a35b-810a9e072719" released by "delete_volume" :: held 1.204s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:46:54 devstack cinder-volume[94472]: WARNING cinder.quota [None req-8710c06f-e38c-48bc-825f-793bd95a9af4 tempest-TestInstancesWithCinderVolumes-171766842 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-765866242-139693162 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-765866242-139693162, it is now deprecated. Please use the default quota class for default quota. Aug 11 04:46:54 devstack cinder-volume[94472]: WARNING cinder.quota [None req-8710c06f-e38c-48bc-825f-793bd95a9af4 tempest-TestInstancesWithCinderVolumes-171766842 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-765866242-139693162 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-765866242-139693162, it is now deprecated. Please use the default quota class for default quota. Aug 11 04:46:54 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-8710c06f-e38c-48bc-825f-793bd95a9af4 tempest-TestInstancesWithCinderVolumes-171766842 None] Created reservations ['83172dc0-e7c2-470e-8c99-d03c42a3b836', 'b86d6849-37ca-4123-a73d-7c44eb28ccd9', '23729bd9-1b54-4b7f-bc97-b1499bbcee41', '764e2341-eeb2-492d-88e9-f711f3aca8d7'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:46:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8710c06f-e38c-48bc-825f-793bd95a9af4 tempest-TestInstancesWithCinderVolumes-171766842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:46:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8710c06f-e38c-48bc-825f-793bd95a9af4 tempest-TestInstancesWithCinderVolumes-171766842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:46:54 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-8710c06f-e38c-48bc-825f-793bd95a9af4 tempest-TestInstancesWithCinderVolumes-171766842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:46:54 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-8710c06f-e38c-48bc-825f-793bd95a9af4 tempest-TestInstancesWithCinderVolumes-171766842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:46:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8710c06f-e38c-48bc-825f-793bd95a9af4 tempest-TestInstancesWithCinderVolumes-171766842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:46:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8710c06f-e38c-48bc-825f-793bd95a9af4 tempest-TestInstancesWithCinderVolumes-171766842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:46:54 devstack sudo[105968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:46:54 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:46:54 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root Aug 11 04:46:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8710c06f-e38c-48bc-825f-793bd95a9af4 tempest-TestInstancesWithCinderVolumes-171766842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.284s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:46:54 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-8710c06f-e38c-48bc-825f-793bd95a9af4 tempest-TestInstancesWithCinderVolumes-171766842 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:46:54 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-8710c06f-e38c-48bc-825f-793bd95a9af4 tempest-TestInstancesWithCinderVolumes-171766842 None] Deleted volume successfully. Aug 11 04:46:54 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8710c06f-e38c-48bc-825f-793bd95a9af4 tempest-TestInstancesWithCinderVolumes-171766842 None] Lock "cinder-7b4d620d-a5c9-4c49-a35b-810a9e072719-delete_volume" released by "delete_volume" :: held 1.869s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:46:56 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-6570726c-0f1d-4539-b590-9418268156ef tempest-VolumesCloneTest-1663258509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:46:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6570726c-0f1d-4539-b590-9418268156ef tempest-VolumesCloneTest-1663258509 None] Flow 'volume_create_manager' (1312ff14-b15c-4dc2-bab6-73602ec2979a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:46:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6570726c-0f1d-4539-b590-9418268156ef tempest-VolumesCloneTest-1663258509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bd48781-7d93-453f-94bf-b3bb40bada8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:46:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6570726c-0f1d-4539-b590-9418268156ef tempest-VolumesCloneTest-1663258509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bd48781-7d93-453f-94bf-b3bb40bada8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:46:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-562593454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=857ee562-b83d-4e2f-ab5d-b58a99baefe1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff2b2731651d43049b1d88beb3552147',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:46:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:46:57Z,use_quota=True,user_id='c1add84b943e42d7a7ac3beb6c798572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:46:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6570726c-0f1d-4539-b590-9418268156ef tempest-VolumesCloneTest-1663258509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0723dda0-8227-4f62-8110-4710ee3af7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:46:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6570726c-0f1d-4539-b590-9418268156ef tempest-VolumesCloneTest-1663258509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0723dda0-8227-4f62-8110-4710ee3af7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:46:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6570726c-0f1d-4539-b590-9418268156ef tempest-VolumesCloneTest-1663258509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32ed8ca7-6789-4e45-9c17-9e0d30e5a653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:46:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6570726c-0f1d-4539-b590-9418268156ef tempest-VolumesCloneTest-1663258509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32ed8ca7-6789-4e45-9c17-9e0d30e5a653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '857ee562-b83d-4e2f-ab5d-b58a99baefe1', 'volume_name': 'volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:46:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6570726c-0f1d-4539-b590-9418268156ef tempest-VolumesCloneTest-1663258509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bf6b16a-91e6-4f4f-b0c3-bf7d82219ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:46:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6570726c-0f1d-4539-b590-9418268156ef tempest-VolumesCloneTest-1663258509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bf6b16a-91e6-4f4f-b0c3-bf7d82219ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:46:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6570726c-0f1d-4539-b590-9418268156ef tempest-VolumesCloneTest-1663258509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90b147ff-c301-4db8-86c0-1a032c78a4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:46:56 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-6570726c-0f1d-4539-b590-9418268156ef tempest-VolumesCloneTest-1663258509 None] Volume 857ee562-b83d-4e2f-ab5d-b58a99baefe1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1', 'volume_size': 1} Aug 11 04:46:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6570726c-0f1d-4539-b590-9418268156ef tempest-VolumesCloneTest-1663258509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:46:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6570726c-0f1d-4539-b590-9418268156ef tempest-VolumesCloneTest-1663258509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:46:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6570726c-0f1d-4539-b590-9418268156ef tempest-VolumesCloneTest-1663258509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:46:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-562593454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=857ee562-b83d-4e2f-ab5d-b58a99baefe1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff2b2731651d43049b1d88beb3552147',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:46:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:46:57Z,use_quota=True,user_id='c1add84b943e42d7a7ac3beb6c798572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:46:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-6570726c-0f1d-4539-b590-9418268156ef tempest-VolumesCloneTest-1663258509 None] Creating volume 857ee562-b83d-4e2f-ab5d-b58a99baefe1 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:46:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6570726c-0f1d-4539-b590-9418268156ef tempest-VolumesCloneTest-1663258509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:46:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6570726c-0f1d-4539-b590-9418268156ef tempest-VolumesCloneTest-1663258509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:46:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6570726c-0f1d-4539-b590-9418268156ef tempest-VolumesCloneTest-1663258509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:46:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6570726c-0f1d-4539-b590-9418268156ef tempest-VolumesCloneTest-1663258509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:46:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6570726c-0f1d-4539-b590-9418268156ef tempest-VolumesCloneTest-1663258509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:46:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6570726c-0f1d-4539-b590-9418268156ef tempest-VolumesCloneTest-1663258509 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:46:56 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-6570726c-0f1d-4539-b590-9418268156ef tempest-VolumesCloneTest-1663258509 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:46:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6570726c-0f1d-4539-b590-9418268156ef tempest-VolumesCloneTest-1663258509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:46:57 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1 1073741824 Aug 11 04:46:57 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:46:57 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Aug 11 04:46:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6570726c-0f1d-4539-b590-9418268156ef tempest-VolumesCloneTest-1663258509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1 1073741824" returned: 0 in 0.521s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:46:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6570726c-0f1d-4539-b590-9418268156ef tempest-VolumesCloneTest-1663258509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:46:57 devstack sudo[105998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1 Aug 11 04:46:57 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:46:57 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root Aug 11 04:46:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6570726c-0f1d-4539-b590-9418268156ef tempest-VolumesCloneTest-1663258509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1" returned: 0 in 0.313s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:46:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6570726c-0f1d-4539-b590-9418268156ef tempest-VolumesCloneTest-1663258509 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:46:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6570726c-0f1d-4539-b590-9418268156ef tempest-VolumesCloneTest-1663258509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:46:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6570726c-0f1d-4539-b590-9418268156ef tempest-VolumesCloneTest-1663258509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90b147ff-c301-4db8-86c0-1a032c78a4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:46:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6570726c-0f1d-4539-b590-9418268156ef tempest-VolumesCloneTest-1663258509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85714662-ecce-4897-9915-29970bffc6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:46:57 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-6570726c-0f1d-4539-b590-9418268156ef tempest-VolumesCloneTest-1663258509 None] Volume volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1 (857ee562-b83d-4e2f-ab5d-b58a99baefe1): created successfully Aug 11 04:46:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6570726c-0f1d-4539-b590-9418268156ef tempest-VolumesCloneTest-1663258509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85714662-ecce-4897-9915-29970bffc6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:46:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6570726c-0f1d-4539-b590-9418268156ef tempest-VolumesCloneTest-1663258509 None] Flow 'volume_create_manager' (1312ff14-b15c-4dc2-bab6-73602ec2979a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:46:57 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-6570726c-0f1d-4539-b590-9418268156ef tempest-VolumesCloneTest-1663258509 None] Created volume successfully. Aug 11 04:46:58 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-c24cacd0-7682-424e-a7fe-224824c35270 req-b31f144f-0f1b-4173-9bee-84fd0ea8133d tempest-TestInstancesWithCinderVolumes-171766842 None] Terminate volume connection completed successfully. Aug 11 04:46:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-c24cacd0-7682-424e-a7fe-224824c35270 req-b31f144f-0f1b-4173-9bee-84fd0ea8133d tempest-TestInstancesWithCinderVolumes-171766842 None] Deleting attachment ee725d2a-de20-44e1-8b38-2ec3d1ad881a. {{(pid=94472) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 11 04:46:58 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 04:46:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:46:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:46:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:46:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:46:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:46:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:46:58 devstack sudo[106007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:46:58 devstack sudo[106007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:46:58 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-00602ef8-ffd8-4db9-b59d-b943957fd9cc tempest-TestInstancesWithCinderVolumes-171766842 None] Acquiring lock "cinder-9d5592f5-3dd2-4a3b-8a51-7a649ee689dd-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:46:58 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-00602ef8-ffd8-4db9-b59d-b943957fd9cc tempest-TestInstancesWithCinderVolumes-171766842 None] Lock "cinder-9d5592f5-3dd2-4a3b-8a51-7a649ee689dd-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:46:58 devstack sudo[106007]: pam_unix(sudo:session): session closed for user root Aug 11 04:46:58 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-00602ef8-ffd8-4db9-b59d-b943957fd9cc tempest-TestInstancesWithCinderVolumes-171766842 None] Acquiring lock "cinder-quobyte-9d5592f5-3dd2-4a3b-8a51-7a649ee689dd" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:46:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.292s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:46:58 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:46:58 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running periodic task VolumeManager._thread_info {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 04:46:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] thread count: 28 {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 11 04:46:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] thread info: [<_MainThread(MainThread, started 133315846115456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 11 04:46:58 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-00602ef8-ffd8-4db9-b59d-b943957fd9cc tempest-TestInstancesWithCinderVolumes-171766842 None] Lock "cinder-quobyte-9d5592f5-3dd2-4a3b-8a51-7a649ee689dd" acquired by "delete_volume" :: waited 0.029s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:46:58 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2eaccb-336f-425d-b05b-0673c58cff49]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:46:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-00602ef8-ffd8-4db9-b59d-b943957fd9cc tempest-TestInstancesWithCinderVolumes-171766842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9d5592f5-3dd2-4a3b-8a51-7a649ee689dd {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:46:59 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9d5592f5-3dd2-4a3b-8a51-7a649ee689dd Aug 11 04:46:59 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:46:59 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Aug 11 04:46:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-00602ef8-ffd8-4db9-b59d-b943957fd9cc tempest-TestInstancesWithCinderVolumes-171766842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9d5592f5-3dd2-4a3b-8a51-7a649ee689dd" returned: 0 in 0.487s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:46:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-00602ef8-ffd8-4db9-b59d-b943957fd9cc tempest-TestInstancesWithCinderVolumes-171766842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9d5592f5-3dd2-4a3b-8a51-7a649ee689dd {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:46:59 devstack sudo[106015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9d5592f5-3dd2-4a3b-8a51-7a649ee689dd Aug 11 04:46:59 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:46:59 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:46:59 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root Aug 11 04:46:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] Flow 'volume_create_manager' (94014271-0dae-463a-9c90-488a2b5b4d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:46:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b67796c4-6942-46d5-aeb2-9d283674ac5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:46:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-00602ef8-ffd8-4db9-b59d-b943957fd9cc tempest-TestInstancesWithCinderVolumes-171766842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9d5592f5-3dd2-4a3b-8a51-7a649ee689dd" returned: 0 in 0.304s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:46:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b67796c4-6942-46d5-aeb2-9d283674ac5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-99279091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fadcbc3e-a27f-45d7-9c4c-0db6dd276616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff2b2731651d43049b1d88beb3552147',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:46:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=857ee562-b83d-4e2f-ab5d-b58a99baefe1,status='creating',terminated_at=None,updated_at=2026-08-11T02:47:00Z,use_quota=True,user_id='c1add84b943e42d7a7ac3beb6c798572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:46:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eced0756-f3b5-4204-8f8d-4c8a1747635d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:46:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eced0756-f3b5-4204-8f8d-4c8a1747635d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:46:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (713c720b-3073-49af-bdaf-549ffe8ecbed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:46:59 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-00602ef8-ffd8-4db9-b59d-b943957fd9cc tempest-TestInstancesWithCinderVolumes-171766842 None] Lock "cinder-quobyte-9d5592f5-3dd2-4a3b-8a51-7a649ee689dd" released by "delete_volume" :: held 0.875s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:46:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (713c720b-3073-49af-bdaf-549ffe8ecbed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'fadcbc3e-a27f-45d7-9c4c-0db6dd276616', 'volume_name': 'volume-fadcbc3e-a27f-45d7-9c4c-0db6dd276616', 'volume_size': 2, 'source_volid': '857ee562-b83d-4e2f-ab5d-b58a99baefe1', 'source_volstatus': 'available'}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:46:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (954d007a-aeb8-4613-b885-66a8aadb57c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:46:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (954d007a-aeb8-4613-b885-66a8aadb57c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:46:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9316443-9a40-4d7e-9d8e-2c28241ed560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:46:59 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] Volume fadcbc3e-a27f-45d7-9c4c-0db6dd276616: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-fadcbc3e-a27f-45d7-9c4c-0db6dd276616', 'volume_size': 2, 'source_volid': '857ee562-b83d-4e2f-ab5d-b58a99baefe1', 'source_volstatus': 'available'} Aug 11 04:46:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:46:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:46:59 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] Cloning volume 857ee562-b83d-4e2f-ab5d-b58a99baefe1 to volume fadcbc3e-a27f-45d7-9c4c-0db6dd276616 Aug 11 04:46:59 devstack cinder-volume[94472]: WARNING cinder.quota [None req-00602ef8-ffd8-4db9-b59d-b943957fd9cc tempest-TestInstancesWithCinderVolumes-171766842 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-752896863-1321272686 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-752896863-1321272686, it is now deprecated. Please use the default quota class for default quota. Aug 11 04:46:59 devstack cinder-volume[94472]: WARNING cinder.quota [None req-00602ef8-ffd8-4db9-b59d-b943957fd9cc tempest-TestInstancesWithCinderVolumes-171766842 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-752896863-1321272686 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-752896863-1321272686, it is now deprecated. Please use the default quota class for default quota. Aug 11 04:46:59 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] Creating offline snapshot 551a0cd2-5103-499b-8997-54b42343d0da of volume 857ee562-b83d-4e2f-ab5d-b58a99baefe1 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 04:46:59 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-00602ef8-ffd8-4db9-b59d-b943957fd9cc tempest-TestInstancesWithCinderVolumes-171766842 None] Created reservations ['54a09a46-db3c-46c7-b25b-5850a2aec8d4', '6a54ec3f-0282-45f1-94ea-73d314de3ba0', 'bd6f5eba-e7c5-40f8-857d-8e166381f92f', '3d30b5b2-9c93-4637-a1a2-53cc0f059931'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:46:59 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce6b623-3a5d-437c-b069-7633e770bc35]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:46:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:46:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-00602ef8-ffd8-4db9-b59d-b943957fd9cc tempest-TestInstancesWithCinderVolumes-171766842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:46:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-00602ef8-ffd8-4db9-b59d-b943957fd9cc tempest-TestInstancesWithCinderVolumes-171766842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:46:59 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-00602ef8-ffd8-4db9-b59d-b943957fd9cc tempest-TestInstancesWithCinderVolumes-171766842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:46:59 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-00602ef8-ffd8-4db9-b59d-b943957fd9cc tempest-TestInstancesWithCinderVolumes-171766842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:46:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-00602ef8-ffd8-4db9-b59d-b943957fd9cc tempest-TestInstancesWithCinderVolumes-171766842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:46:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-00602ef8-ffd8-4db9-b59d-b943957fd9cc tempest-TestInstancesWithCinderVolumes-171766842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:46:59 devstack sudo[106019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:46:59 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:46:59 devstack sudo[106018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1 Aug 11 04:46:59 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:00 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-00602ef8-ffd8-4db9-b59d-b943957fd9cc tempest-TestInstancesWithCinderVolumes-171766842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.266s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:00 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-00602ef8-ffd8-4db9-b59d-b943957fd9cc tempest-TestInstancesWithCinderVolumes-171766842 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:47:00 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-00602ef8-ffd8-4db9-b59d-b943957fd9cc tempest-TestInstancesWithCinderVolumes-171766842 None] Deleted volume successfully. Aug 11 04:47:00 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-00602ef8-ffd8-4db9-b59d-b943957fd9cc tempest-TestInstancesWithCinderVolumes-171766842 None] Lock "cinder-9d5592f5-3dd2-4a3b-8a51-7a649ee689dd-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:47:00 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1" returned: 0 in 0.457s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1.551a0cd2-5103-499b-8997-54b42343d0da 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:00 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1.551a0cd2-5103-499b-8997-54b42343d0da 1G Aug 11 04:47:00 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:00 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1.551a0cd2-5103-499b-8997-54b42343d0da 1G" returned: 0 in 0.529s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1.551a0cd2-5103-499b-8997-54b42343d0da {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:00 devstack sudo[106033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1.551a0cd2-5103-499b-8997-54b42343d0da Aug 11 04:47:00 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:01 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1.551a0cd2-5103-499b-8997-54b42343d0da" returned: 0 in 0.287s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:01 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1.551a0cd2-5103-499b-8997-54b42343d0da is being set with open permissions: ugo+rw Aug 11 04:47:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1.551a0cd2-5103-499b-8997-54b42343d0da {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:01 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1.551a0cd2-5103-499b-8997-54b42343d0da Aug 11 04:47:01 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:01 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1.551a0cd2-5103-499b-8997-54b42343d0da" returned: 0 in 0.282s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:01 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1.info Aug 11 04:47:01 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:01 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1.info" returned: 0 in 0.432s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:01 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1.info is being set with open permissions: ugo+rw Aug 11 04:47:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:01 devstack sudo[106052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1.info Aug 11 04:47:01 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:02 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1.info" returned: 0 in 0.390s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] Acquiring lock "cinder-quobyte-fadcbc3e-a27f-45d7-9c4c-0db6dd276616" by "_copy_volume_from_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:47:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] Lock "cinder-quobyte-fadcbc3e-a27f-45d7-9c4c-0db6dd276616" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:47:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] snapshot: 551a0cd2-5103-499b-8997-54b42343d0da, volume: fadcbc3e-a27f-45d7-9c4c-0db6dd276616, {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 11 04:47:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:47:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:47:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:47:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:47:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:47:02 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7dc26f-01f0-4275-a82d-a2aea2db49a5]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:47:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1.551a0cd2-5103-499b-8997-54b42343d0da {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:02 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1.551a0cd2-5103-499b-8997-54b42343d0da Aug 11 04:47:02 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:02 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-daf390e5-a6cf-4ef8-b3d8-c1666d1941e2 tempest-AttachVolumeShelveTestJSON-1872118428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:47:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-daf390e5-a6cf-4ef8-b3d8-c1666d1941e2 tempest-AttachVolumeShelveTestJSON-1872118428 None] Flow 'volume_create_manager' (e0e1bd45-50ac-4d22-9a59-7128280c86c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:47:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-daf390e5-a6cf-4ef8-b3d8-c1666d1941e2 tempest-AttachVolumeShelveTestJSON-1872118428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (255c1376-80f0-4528-8bac-57e6c1b65011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:47:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-daf390e5-a6cf-4ef8-b3d8-c1666d1941e2 tempest-AttachVolumeShelveTestJSON-1872118428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (255c1376-80f0-4528-8bac-57e6c1b65011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:47:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-464526052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55dfffba-d0af-445f-8b11-1155656bb341,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ad07cfe3ded4f0ab59486a77b6157ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:47:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:47:03Z,use_quota=True,user_id='037b18b4e1cc4de3859987db5b97feb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:47:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-daf390e5-a6cf-4ef8-b3d8-c1666d1941e2 tempest-AttachVolumeShelveTestJSON-1872118428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bf268b8-3d3f-4456-b0db-2f5b35bce423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:47:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-daf390e5-a6cf-4ef8-b3d8-c1666d1941e2 tempest-AttachVolumeShelveTestJSON-1872118428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bf268b8-3d3f-4456-b0db-2f5b35bce423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:47:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-daf390e5-a6cf-4ef8-b3d8-c1666d1941e2 tempest-AttachVolumeShelveTestJSON-1872118428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7ae46c8-3fd2-4670-967d-ae089bb1c998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:47:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-daf390e5-a6cf-4ef8-b3d8-c1666d1941e2 tempest-AttachVolumeShelveTestJSON-1872118428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7ae46c8-3fd2-4670-967d-ae089bb1c998) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55dfffba-d0af-445f-8b11-1155656bb341', 'volume_name': 'volume-55dfffba-d0af-445f-8b11-1155656bb341', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:47:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-daf390e5-a6cf-4ef8-b3d8-c1666d1941e2 tempest-AttachVolumeShelveTestJSON-1872118428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (426bcbd8-29d7-4a7c-b7e5-52d4cf86f3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:47:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-daf390e5-a6cf-4ef8-b3d8-c1666d1941e2 tempest-AttachVolumeShelveTestJSON-1872118428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (426bcbd8-29d7-4a7c-b7e5-52d4cf86f3a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:47:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-daf390e5-a6cf-4ef8-b3d8-c1666d1941e2 tempest-AttachVolumeShelveTestJSON-1872118428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3a873ce-021d-4c1a-8b1e-49f2a97543c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:47:02 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-daf390e5-a6cf-4ef8-b3d8-c1666d1941e2 tempest-AttachVolumeShelveTestJSON-1872118428 None] Volume 55dfffba-d0af-445f-8b11-1155656bb341: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55dfffba-d0af-445f-8b11-1155656bb341', 'volume_size': 1} Aug 11 04:47:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-daf390e5-a6cf-4ef8-b3d8-c1666d1941e2 tempest-AttachVolumeShelveTestJSON-1872118428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:47:02 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1.551a0cd2-5103-499b-8997-54b42343d0da" returned: 0 in 0.464s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:47:02 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[404513f6-d400-4bc0-8e6e-31c78c206bf7]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:47:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:03 devstack sudo[106080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1 Aug 11 04:47:03 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:03 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1" returned: 0 in 0.432s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:03 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] will copy from snapshot at /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1 {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 11 04:47:03 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] Creating direct copy from snapshot {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 11 04:47:03 devstack cinder-volume[94472]: DEBUG cinder.utils [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] Path /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-fadcbc3e-a27f-45d7-9c4c-0db6dd276616 not found in is_blk_device check {{(pid=94472) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 11 04:47:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-fadcbc3e-a27f-45d7-9c4c-0db6dd276616 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:03 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-fadcbc3e-a27f-45d7-9c4c-0db6dd276616 Aug 11 04:47:03 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:03 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-234ee626-b5c4-4c36-9fd7-a9e65781db96 req-17f4a7a1-dbad-4427-b3cf-41a7ccb174f0 tempest-TestInstancesWithCinderVolumes-171766842 None] Terminate volume connection completed successfully. Aug 11 04:47:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-234ee626-b5c4-4c36-9fd7-a9e65781db96 req-17f4a7a1-dbad-4427-b3cf-41a7ccb174f0 tempest-TestInstancesWithCinderVolumes-171766842 None] Deleting attachment 11ad9e28-1a36-4b46-b88c-b3e26f08484d. {{(pid=94472) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 11 04:47:04 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d41c0e13-efed-49bd-bc0b-51889b25f87b tempest-TestInstancesWithCinderVolumes-171766842 None] Acquiring lock "cinder-bf842bbf-a991-4e46-83c2-944c8386df63-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:47:04 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d41c0e13-efed-49bd-bc0b-51889b25f87b tempest-TestInstancesWithCinderVolumes-171766842 None] Lock "cinder-bf842bbf-a991-4e46-83c2-944c8386df63-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:47:04 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d41c0e13-efed-49bd-bc0b-51889b25f87b tempest-TestInstancesWithCinderVolumes-171766842 None] Acquiring lock "cinder-quobyte-bf842bbf-a991-4e46-83c2-944c8386df63" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:47:04 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d41c0e13-efed-49bd-bc0b-51889b25f87b tempest-TestInstancesWithCinderVolumes-171766842 None] Lock "cinder-quobyte-bf842bbf-a991-4e46-83c2-944c8386df63" acquired by "delete_volume" :: waited 0.031s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:47:04 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcbbf63-1ca0-47d5-b90d-ae97566697e7]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:47:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d41c0e13-efed-49bd-bc0b-51889b25f87b tempest-TestInstancesWithCinderVolumes-171766842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-bf842bbf-a991-4e46-83c2-944c8386df63 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:04 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-bf842bbf-a991-4e46-83c2-944c8386df63 Aug 11 04:47:04 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:05 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d41c0e13-efed-49bd-bc0b-51889b25f87b tempest-TestInstancesWithCinderVolumes-171766842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-bf842bbf-a991-4e46-83c2-944c8386df63" returned: 0 in 0.863s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d41c0e13-efed-49bd-bc0b-51889b25f87b tempest-TestInstancesWithCinderVolumes-171766842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-bf842bbf-a991-4e46-83c2-944c8386df63 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:05 devstack sudo[106106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-bf842bbf-a991-4e46-83c2-944c8386df63 Aug 11 04:47:05 devstack sudo[106106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:06 devstack sudo[106106]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d41c0e13-efed-49bd-bc0b-51889b25f87b tempest-TestInstancesWithCinderVolumes-171766842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-bf842bbf-a991-4e46-83c2-944c8386df63" returned: 0 in 0.870s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:06 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d41c0e13-efed-49bd-bc0b-51889b25f87b tempest-TestInstancesWithCinderVolumes-171766842 None] Lock "cinder-quobyte-bf842bbf-a991-4e46-83c2-944c8386df63" released by "delete_volume" :: held 1.851s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:47:06 devstack cinder-volume[94472]: WARNING cinder.quota [None req-d41c0e13-efed-49bd-bc0b-51889b25f87b tempest-TestInstancesWithCinderVolumes-171766842 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1291549728-439823356 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1291549728-439823356, it is now deprecated. Please use the default quota class for default quota. Aug 11 04:47:06 devstack cinder-volume[94472]: WARNING cinder.quota [None req-d41c0e13-efed-49bd-bc0b-51889b25f87b tempest-TestInstancesWithCinderVolumes-171766842 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1291549728-439823356 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1291549728-439823356, it is now deprecated. Please use the default quota class for default quota. Aug 11 04:47:06 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-d41c0e13-efed-49bd-bc0b-51889b25f87b tempest-TestInstancesWithCinderVolumes-171766842 None] Created reservations ['353b03ee-12f9-4956-91e3-dcdf84e2be78', '6a019428-feac-4f9d-845e-5912000eda4b', '9fa9dadd-03f5-4fec-8bff-75d7404cc72f', '9fa36818-2e0e-420a-94bb-8088c3a7b611'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:47:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d41c0e13-efed-49bd-bc0b-51889b25f87b tempest-TestInstancesWithCinderVolumes-171766842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:47:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d41c0e13-efed-49bd-bc0b-51889b25f87b tempest-TestInstancesWithCinderVolumes-171766842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:47:06 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d41c0e13-efed-49bd-bc0b-51889b25f87b tempest-TestInstancesWithCinderVolumes-171766842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:47:06 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d41c0e13-efed-49bd-bc0b-51889b25f87b tempest-TestInstancesWithCinderVolumes-171766842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:47:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d41c0e13-efed-49bd-bc0b-51889b25f87b tempest-TestInstancesWithCinderVolumes-171766842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:47:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d41c0e13-efed-49bd-bc0b-51889b25f87b tempest-TestInstancesWithCinderVolumes-171766842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:06 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:47:06 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:07 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d41c0e13-efed-49bd-bc0b-51889b25f87b tempest-TestInstancesWithCinderVolumes-171766842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.436s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:07 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-d41c0e13-efed-49bd-bc0b-51889b25f87b tempest-TestInstancesWithCinderVolumes-171766842 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:47:07 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-d41c0e13-efed-49bd-bc0b-51889b25f87b tempest-TestInstancesWithCinderVolumes-171766842 None] Deleted volume successfully. Aug 11 04:47:07 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d41c0e13-efed-49bd-bc0b-51889b25f87b tempest-TestInstancesWithCinderVolumes-171766842 None] Lock "cinder-bf842bbf-a991-4e46-83c2-944c8386df63-delete_volume" released by "delete_volume" :: held 2.960s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:47:08 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-fadcbc3e-a27f-45d7-9c4c-0db6dd276616" returned: 0 in 5.543s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:08 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] Image conversion details: src /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1, size 1024.00 MB, duration 5.54 sec, destination /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-fadcbc3e-a27f-45d7-9c4c-0db6dd276616 {{(pid=94472) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 11 04:47:08 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] Converted 1024.00 MB image at 184.71 MB/s Aug 11 04:47:08 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-fadcbc3e-a27f-45d7-9c4c-0db6dd276616 is being set with open permissions: ugo+rw Aug 11 04:47:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-fadcbc3e-a27f-45d7-9c4c-0db6dd276616 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:08 devstack sudo[106112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-fadcbc3e-a27f-45d7-9c4c-0db6dd276616 Aug 11 04:47:08 devstack sudo[106112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:09 devstack sudo[106112]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-fadcbc3e-a27f-45d7-9c4c-0db6dd276616" returned: 0 in 0.245s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:09 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] Lock "cinder-quobyte-fadcbc3e-a27f-45d7-9c4c-0db6dd276616" released by "_copy_volume_from_snapshot" :: held 6.815s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:47:09 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] Acquiring lock "cinder-quobyte-551a0cd2-5103-499b-8997-54b42343d0da" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:47:09 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] Lock "cinder-quobyte-551a0cd2-5103-499b-8997-54b42343d0da" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:47:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] Deleting offline snapshot 551a0cd2-5103-499b-8997-54b42343d0da of volume 857ee562-b83d-4e2f-ab5d-b58a99baefe1 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 04:47:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] snapshot_file for this snap is: volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1.551a0cd2-5103-499b-8997-54b42343d0da {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 04:47:09 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d069c9-f4e2-4b56-b70d-7c2dee9c58d9]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:47:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1.551a0cd2-5103-499b-8997-54b42343d0da {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:09 devstack sudo[106115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1.551a0cd2-5103-499b-8997-54b42343d0da Aug 11 04:47:09 devstack sudo[106115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:09 devstack sudo[106115]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1.551a0cd2-5103-499b-8997-54b42343d0da" returned: 0 in 0.403s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:47:09 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[8602d2a6-8557-435c-b746-8ff2d67986a4]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:47:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:09 devstack sudo[106120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1 Aug 11 04:47:09 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:10 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1" returned: 0 in 0.540s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1.551a0cd2-5103-499b-8997-54b42343d0da {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:10 devstack sudo[106126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1.551a0cd2-5103-499b-8997-54b42343d0da Aug 11 04:47:10 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:10 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1.551a0cd2-5103-499b-8997-54b42343d0da" returned: 0 in 0.379s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1.551a0cd2-5103-499b-8997-54b42343d0da {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:10 devstack sudo[106132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1.551a0cd2-5103-499b-8997-54b42343d0da Aug 11 04:47:10 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:10 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1.551a0cd2-5103-499b-8997-54b42343d0da" returned: 0 in 0.258s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] Lock "cinder-quobyte-551a0cd2-5103-499b-8997-54b42343d0da" released by "_delete_snapshot" :: held 1.674s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:47:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.112s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:47:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-daf390e5-a6cf-4ef8-b3d8-c1666d1941e2 tempest-AttachVolumeShelveTestJSON-1872118428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.194s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:47:10 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-daf390e5-a6cf-4ef8-b3d8-c1666d1941e2 tempest-AttachVolumeShelveTestJSON-1872118428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:47:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-464526052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55dfffba-d0af-445f-8b11-1155656bb341,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ad07cfe3ded4f0ab59486a77b6157ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:47:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:47:03Z,use_quota=True,user_id='037b18b4e1cc4de3859987db5b97feb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:47:10 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-daf390e5-a6cf-4ef8-b3d8-c1666d1941e2 tempest-AttachVolumeShelveTestJSON-1872118428 None] Creating volume 55dfffba-d0af-445f-8b11-1155656bb341 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:47:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-daf390e5-a6cf-4ef8-b3d8-c1666d1941e2 tempest-AttachVolumeShelveTestJSON-1872118428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:47:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-daf390e5-a6cf-4ef8-b3d8-c1666d1941e2 tempest-AttachVolumeShelveTestJSON-1872118428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:47:10 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-daf390e5-a6cf-4ef8-b3d8-c1666d1941e2 tempest-AttachVolumeShelveTestJSON-1872118428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:47:10 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-daf390e5-a6cf-4ef8-b3d8-c1666d1941e2 tempest-AttachVolumeShelveTestJSON-1872118428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:47:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-daf390e5-a6cf-4ef8-b3d8-c1666d1941e2 tempest-AttachVolumeShelveTestJSON-1872118428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:47:10 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-daf390e5-a6cf-4ef8-b3d8-c1666d1941e2 tempest-AttachVolumeShelveTestJSON-1872118428 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:47:10 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-daf390e5-a6cf-4ef8-b3d8-c1666d1941e2 tempest-AttachVolumeShelveTestJSON-1872118428 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:47:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-daf390e5-a6cf-4ef8-b3d8-c1666d1941e2 tempest-AttachVolumeShelveTestJSON-1872118428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-55dfffba-d0af-445f-8b11-1155656bb341 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:10 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-55dfffba-d0af-445f-8b11-1155656bb341 1073741824 Aug 11 04:47:10 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9316443-9a40-4d7e-9d8e-2c28241ed560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fadcbc3e-a27f-45d7-9c4c-0db6dd276616', 'volume_size': 2, 'source_volid': '857ee562-b83d-4e2f-ab5d-b58a99baefe1', 'source_volstatus': 'available'}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:47:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22843d28-996f-4dd9-9090-0bd571c82c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:47:10 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] Volume volume-fadcbc3e-a27f-45d7-9c4c-0db6dd276616 (fadcbc3e-a27f-45d7-9c4c-0db6dd276616): created successfully Aug 11 04:47:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22843d28-996f-4dd9-9090-0bd571c82c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:47:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] Flow 'volume_create_manager' (94014271-0dae-463a-9c90-488a2b5b4d26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:47:10 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-07d125dc-9463-473c-8ade-5c9e975cbec0 tempest-VolumesCloneTest-1663258509 None] Created volume successfully. Aug 11 04:47:11 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-daf390e5-a6cf-4ef8-b3d8-c1666d1941e2 tempest-AttachVolumeShelveTestJSON-1872118428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-55dfffba-d0af-445f-8b11-1155656bb341 1073741824" returned: 0 in 0.491s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-daf390e5-a6cf-4ef8-b3d8-c1666d1941e2 tempest-AttachVolumeShelveTestJSON-1872118428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-55dfffba-d0af-445f-8b11-1155656bb341 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:11 devstack sudo[106142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-55dfffba-d0af-445f-8b11-1155656bb341 Aug 11 04:47:11 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:11 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-daf390e5-a6cf-4ef8-b3d8-c1666d1941e2 tempest-AttachVolumeShelveTestJSON-1872118428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-55dfffba-d0af-445f-8b11-1155656bb341" returned: 0 in 0.261s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-daf390e5-a6cf-4ef8-b3d8-c1666d1941e2 tempest-AttachVolumeShelveTestJSON-1872118428 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:47:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-daf390e5-a6cf-4ef8-b3d8-c1666d1941e2 tempest-AttachVolumeShelveTestJSON-1872118428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:47:11 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=62,cinder:UPDATE=40,cinder:INSERT=11,cinder:DELETE=3 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:47:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-daf390e5-a6cf-4ef8-b3d8-c1666d1941e2 tempest-AttachVolumeShelveTestJSON-1872118428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3a873ce-021d-4c1a-8b1e-49f2a97543c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55dfffba-d0af-445f-8b11-1155656bb341', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:47:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-daf390e5-a6cf-4ef8-b3d8-c1666d1941e2 tempest-AttachVolumeShelveTestJSON-1872118428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54794632-5f1a-4cb3-a863-e989a7b7fc16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:47:11 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=49,cinder:UPDATE=56,cinder:INSERT=10,cinder:DELETE=3 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:47:11 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-daf390e5-a6cf-4ef8-b3d8-c1666d1941e2 tempest-AttachVolumeShelveTestJSON-1872118428 None] Volume volume-55dfffba-d0af-445f-8b11-1155656bb341 (55dfffba-d0af-445f-8b11-1155656bb341): created successfully Aug 11 04:47:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-daf390e5-a6cf-4ef8-b3d8-c1666d1941e2 tempest-AttachVolumeShelveTestJSON-1872118428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54794632-5f1a-4cb3-a863-e989a7b7fc16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:47:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-daf390e5-a6cf-4ef8-b3d8-c1666d1941e2 tempest-AttachVolumeShelveTestJSON-1872118428 None] Flow 'volume_create_manager' (e0e1bd45-50ac-4d22-9a59-7128280c86c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:47:11 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-daf390e5-a6cf-4ef8-b3d8-c1666d1941e2 tempest-AttachVolumeShelveTestJSON-1872118428 None] Created volume successfully. Aug 11 04:47:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5550d564-7a9a-4ef6-90b1-a2346b16a7f7 tempest-VolumesCloneTest-1663258509 None] Acquiring lock "cinder-fadcbc3e-a27f-45d7-9c4c-0db6dd276616-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:47:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5550d564-7a9a-4ef6-90b1-a2346b16a7f7 tempest-VolumesCloneTest-1663258509 None] Lock "cinder-fadcbc3e-a27f-45d7-9c4c-0db6dd276616-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:47:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5550d564-7a9a-4ef6-90b1-a2346b16a7f7 tempest-VolumesCloneTest-1663258509 None] Acquiring lock "cinder-quobyte-fadcbc3e-a27f-45d7-9c4c-0db6dd276616" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:47:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5550d564-7a9a-4ef6-90b1-a2346b16a7f7 tempest-VolumesCloneTest-1663258509 None] Lock "cinder-quobyte-fadcbc3e-a27f-45d7-9c4c-0db6dd276616" acquired by "delete_volume" :: waited 0.020s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:47:11 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ccebed0-ba69-480d-946e-564b9a16358d]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:47:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5550d564-7a9a-4ef6-90b1-a2346b16a7f7 tempest-VolumesCloneTest-1663258509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-fadcbc3e-a27f-45d7-9c4c-0db6dd276616 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:12 devstack sudo[106147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-fadcbc3e-a27f-45d7-9c4c-0db6dd276616 Aug 11 04:47:12 devstack sudo[106147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:12 devstack sudo[106147]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5550d564-7a9a-4ef6-90b1-a2346b16a7f7 tempest-VolumesCloneTest-1663258509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-fadcbc3e-a27f-45d7-9c4c-0db6dd276616" returned: 0 in 0.432s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5550d564-7a9a-4ef6-90b1-a2346b16a7f7 tempest-VolumesCloneTest-1663258509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-fadcbc3e-a27f-45d7-9c4c-0db6dd276616 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:12 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-fadcbc3e-a27f-45d7-9c4c-0db6dd276616 Aug 11 04:47:12 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:12 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5550d564-7a9a-4ef6-90b1-a2346b16a7f7 tempest-VolumesCloneTest-1663258509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-fadcbc3e-a27f-45d7-9c4c-0db6dd276616" returned: 0 in 0.274s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:12 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5550d564-7a9a-4ef6-90b1-a2346b16a7f7 tempest-VolumesCloneTest-1663258509 None] Lock "cinder-quobyte-fadcbc3e-a27f-45d7-9c4c-0db6dd276616" released by "delete_volume" :: held 0.754s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:47:12 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-5550d564-7a9a-4ef6-90b1-a2346b16a7f7 tempest-VolumesCloneTest-1663258509 None] Created reservations ['b8a6d462-3a3e-4541-b882-ad68045d1b62', '95c54445-3321-45a7-8c07-1f00eef4fdd5', '283577ca-0f64-411d-b3b1-50977914eeae', '9ed92c00-9f9a-489c-8b02-14cfa9a9a6a5'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:47:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5550d564-7a9a-4ef6-90b1-a2346b16a7f7 tempest-VolumesCloneTest-1663258509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:47:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5550d564-7a9a-4ef6-90b1-a2346b16a7f7 tempest-VolumesCloneTest-1663258509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:47:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-5550d564-7a9a-4ef6-90b1-a2346b16a7f7 tempest-VolumesCloneTest-1663258509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:47:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-5550d564-7a9a-4ef6-90b1-a2346b16a7f7 tempest-VolumesCloneTest-1663258509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:47:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5550d564-7a9a-4ef6-90b1-a2346b16a7f7 tempest-VolumesCloneTest-1663258509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:47:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5550d564-7a9a-4ef6-90b1-a2346b16a7f7 tempest-VolumesCloneTest-1663258509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:12 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:47:12 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:13 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a1f948b9-f5b6-48ae-9b77-b4198de5ca6b tempest-VolumesCloneTest-1663258509 None] Acquiring lock "cinder-857ee562-b83d-4e2f-ab5d-b58a99baefe1-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:47:13 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5550d564-7a9a-4ef6-90b1-a2346b16a7f7 tempest-VolumesCloneTest-1663258509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.355s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:13 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-5550d564-7a9a-4ef6-90b1-a2346b16a7f7 tempest-VolumesCloneTest-1663258509 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:47:13 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-5550d564-7a9a-4ef6-90b1-a2346b16a7f7 tempest-VolumesCloneTest-1663258509 None] Deleted volume successfully. Aug 11 04:47:13 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a1f948b9-f5b6-48ae-9b77-b4198de5ca6b tempest-VolumesCloneTest-1663258509 None] Lock "cinder-857ee562-b83d-4e2f-ab5d-b58a99baefe1-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:47:13 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5550d564-7a9a-4ef6-90b1-a2346b16a7f7 tempest-VolumesCloneTest-1663258509 None] Lock "cinder-fadcbc3e-a27f-45d7-9c4c-0db6dd276616-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:47:13 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a1f948b9-f5b6-48ae-9b77-b4198de5ca6b tempest-VolumesCloneTest-1663258509 None] Acquiring lock "cinder-quobyte-857ee562-b83d-4e2f-ab5d-b58a99baefe1" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:47:13 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a1f948b9-f5b6-48ae-9b77-b4198de5ca6b tempest-VolumesCloneTest-1663258509 None] Lock "cinder-quobyte-857ee562-b83d-4e2f-ab5d-b58a99baefe1" acquired by "delete_volume" :: waited 0.030s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:47:13 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[b980b000-7d9e-4b6c-8f8f-d9b8b149eee9]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:47:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a1f948b9-f5b6-48ae-9b77-b4198de5ca6b tempest-VolumesCloneTest-1663258509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:13 devstack sudo[106164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1 Aug 11 04:47:13 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:13 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a1f948b9-f5b6-48ae-9b77-b4198de5ca6b tempest-VolumesCloneTest-1663258509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1" returned: 0 in 0.386s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a1f948b9-f5b6-48ae-9b77-b4198de5ca6b tempest-VolumesCloneTest-1663258509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:13 devstack sudo[106169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1 Aug 11 04:47:13 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:14 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a1f948b9-f5b6-48ae-9b77-b4198de5ca6b tempest-VolumesCloneTest-1663258509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-857ee562-b83d-4e2f-ab5d-b58a99baefe1" returned: 0 in 0.338s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a1f948b9-f5b6-48ae-9b77-b4198de5ca6b tempest-VolumesCloneTest-1663258509 None] Lock "cinder-quobyte-857ee562-b83d-4e2f-ab5d-b58a99baefe1" released by "delete_volume" :: held 0.822s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:47:14 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-a1f948b9-f5b6-48ae-9b77-b4198de5ca6b tempest-VolumesCloneTest-1663258509 None] Created reservations ['86b258c9-2b86-4965-8d12-1a246d02165e', 'd5ce3fdf-42d9-4991-a980-ad24be33bd37', '5b22b40e-5595-4b0d-ba73-297a6874a4d2', '1e2daafd-ae5e-4bd1-9feb-b4475105d696'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:47:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a1f948b9-f5b6-48ae-9b77-b4198de5ca6b tempest-VolumesCloneTest-1663258509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:47:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a1f948b9-f5b6-48ae-9b77-b4198de5ca6b tempest-VolumesCloneTest-1663258509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:47:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a1f948b9-f5b6-48ae-9b77-b4198de5ca6b tempest-VolumesCloneTest-1663258509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:47:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a1f948b9-f5b6-48ae-9b77-b4198de5ca6b tempest-VolumesCloneTest-1663258509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:47:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a1f948b9-f5b6-48ae-9b77-b4198de5ca6b tempest-VolumesCloneTest-1663258509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:47:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a1f948b9-f5b6-48ae-9b77-b4198de5ca6b tempest-VolumesCloneTest-1663258509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:14 devstack sudo[106190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:47:14 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:14 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a1f948b9-f5b6-48ae-9b77-b4198de5ca6b tempest-VolumesCloneTest-1663258509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.363s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:14 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-a1f948b9-f5b6-48ae-9b77-b4198de5ca6b tempest-VolumesCloneTest-1663258509 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:47:14 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-a1f948b9-f5b6-48ae-9b77-b4198de5ca6b tempest-VolumesCloneTest-1663258509 None] Deleted volume successfully. Aug 11 04:47:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a1f948b9-f5b6-48ae-9b77-b4198de5ca6b tempest-VolumesCloneTest-1663258509 None] Lock "cinder-857ee562-b83d-4e2f-ab5d-b58a99baefe1-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:47:18 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:47:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] Flow 'volume_create_manager' (6c46d57f-6b69-429f-95f0-cfe88ed013d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:47:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21039656-5e16-43f4-82f5-163f503003f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:47:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21039656-5e16-43f4-82f5-163f503003f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1115285887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bca6b1c-87ee-471c-a664-6c841c7c6e12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4f98ad9755145c39306739906581785',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:47:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:47:18Z,use_quota=True,user_id='00744c5fd95d4fbc9bb4bcec7e2a48a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:47:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cae68b7-e493-4968-90e2-96fafa1c40dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:47:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cae68b7-e493-4968-90e2-96fafa1c40dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:47:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6acd0a0-9841-4513-91dd-4f54e76bc636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:47:18 devstack cinder-volume[94472]: DEBUG cinder.image.glance [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] Creating Keystone auth plugin from conf {{(pid=94472) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 11 04:47:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6acd0a0-9841-4513-91dd-4f54e76bc636) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5bca6b1c-87ee-471c-a664-6c841c7c6e12', 'volume_name': 'volume-5bca6b1c-87ee-471c-a664-6c841c7c6e12', 'volume_size': 1, 'image_id': '935df48c-f244-44af-83c6-4799aff908b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/935df48c-f244-44af-83c6-4799aff908b2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f74f87914afa4c849e1ab3e938cfb579', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '935df48c-f244-44af-83c6-4799aff908b2', 'created_at': datetime.datetime(2026, 8, 11, 2, 32, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 2, 32, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/935df48c-f244-44af-83c6-4799aff908b2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:47:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5c75562-3af2-4bd6-a33f-9213f8e9a541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:47:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5c75562-3af2-4bd6-a33f-9213f8e9a541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:47:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (686a3035-6926-42cc-9810-62482888d144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:47:18 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] Volume 5bca6b1c-87ee-471c-a664-6c841c7c6e12: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5bca6b1c-87ee-471c-a664-6c841c7c6e12', 'volume_size': 1, 'image_id': '935df48c-f244-44af-83c6-4799aff908b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/935df48c-f244-44af-83c6-4799aff908b2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f74f87914afa4c849e1ab3e938cfb579', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '935df48c-f244-44af-83c6-4799aff908b2', 'created_at': datetime.datetime(2026, 8, 11, 2, 32, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 2, 32, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/935df48c-f244-44af-83c6-4799aff908b2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 11 04:47:18 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] Trying to clone 5bca6b1c-87ee-471c-a664-6c841c7c6e12 from image 935df48c-f244-44af-83c6-4799aff908b2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/935df48c-f244-44af-83c6-4799aff908b2', 'metadata': {}}]). {{(pid=94472) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 11 04:47:19 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_jaw2y7uddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 11 04:47:19 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] Image download 20.69 MB at 20.69 MB/s Aug 11 04:47:19 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ce3207-40f3-4417-953c-403c1fc03e56]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:47:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_jaw2y7uddevstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:19 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_jaw2y7uddevstack@QuobyteHD Aug 11 04:47:19 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:19 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_jaw2y7uddevstack@QuobyteHD" returned: 0 in 0.417s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:19 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] Temporary image 935df48c-f244-44af-83c6-4799aff908b2 is fetched for user 00744c5fd95d4fbc9bb4bcec7e2a48a5. {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 11 04:47:19 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe11ca0-e237-4578-a5e4-deb5145fa51d]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:47:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_jaw2y7uddevstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:19 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_jaw2y7uddevstack@QuobyteHD Aug 11 04:47:19 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:20 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_jaw2y7uddevstack@QuobyteHD" returned: 0 in 0.428s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:47:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:47:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1115285887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bca6b1c-87ee-471c-a664-6c841c7c6e12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4f98ad9755145c39306739906581785',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:47:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:47:18Z,use_quota=True,user_id='00744c5fd95d4fbc9bb4bcec7e2a48a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:47:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] Creating volume 5bca6b1c-87ee-471c-a664-6c841c7c6e12 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:47:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:47:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:47:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:47:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:47:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:47:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:47:20 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:47:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bca6b1c-87ee-471c-a664-6c841c7c6e12 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:20 devstack sudo[106245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bca6b1c-87ee-471c-a664-6c841c7c6e12 1073741824 Aug 11 04:47:20 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:20 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bca6b1c-87ee-471c-a664-6c841c7c6e12 1073741824" returned: 0 in 0.645s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bca6b1c-87ee-471c-a664-6c841c7c6e12 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:20 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bca6b1c-87ee-471c-a664-6c841c7c6e12 Aug 11 04:47:20 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:21 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bca6b1c-87ee-471c-a664-6c841c7c6e12" returned: 0 in 0.395s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:21 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:47:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:47:21 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] Attempting download of 935df48c-f244-44af-83c6-4799aff908b2 ((None, [{'url': 'file:///opt/stack/data/glance/images/935df48c-f244-44af-83c6-4799aff908b2', 'metadata': {}}])) to volume 5bca6b1c-87ee-471c-a664-6c841c7c6e12. {{(pid=94472) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 11 04:47:21 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d53a3cf-922c-4cd6-b302-0497ae0bb494]: (4, 'raw') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:47:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_935df48c-f244-44af-83c6-4799aff908b2_hzf8riar {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:21 devstack sudo[106273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_935df48c-f244-44af-83c6-4799aff908b2_hzf8riar Aug 11 04:47:21 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:21 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_935df48c-f244-44af-83c6-4799aff908b2_hzf8riar" returned: 0 in 0.502s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_935df48c-f244-44af-83c6-4799aff908b2_hzf8riar {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:22 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_935df48c-f244-44af-83c6-4799aff908b2_hzf8riar Aug 11 04:47:22 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:22 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_935df48c-f244-44af-83c6-4799aff908b2_hzf8riar" returned: 1 in 0.527s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_935df48c-f244-44af-83c6-4799aff908b2_hzf8riar' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 11 04:47:22 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5ba524-6669-41eb-91e3-60600027672d]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:47:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_jaw2y7uddevstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:22 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_jaw2y7uddevstack@QuobyteHD Aug 11 04:47:22 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:23 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_jaw2y7uddevstack@QuobyteHD" returned: 0 in 0.666s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:23 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] 935df48c-f244-44af-83c6-4799aff908b2 was qcow2, converting to qcow2 {{(pid=94472) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 11 04:47:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_jaw2y7uddevstack@QuobyteHD /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bca6b1c-87ee-471c-a664-6c841c7c6e12 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:23 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_jaw2y7uddevstack@QuobyteHD /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bca6b1c-87ee-471c-a664-6c841c7c6e12 Aug 11 04:47:23 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-57872916-a941-4bc2-8089-ff4d5c5dfe03 req-e4919159-eb95-462c-8a47-2274b8abddf4 tempest-AttachVolumeShelveTestJSON-1872118428 None] No connector for attachment 67f794cd-9bec-4a71-be83-42aded30300b; skipping storage backend terminate_connection call. {{(pid=94472) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Aug 11 04:47:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-57872916-a941-4bc2-8089-ff4d5c5dfe03 req-e4919159-eb95-462c-8a47-2274b8abddf4 tempest-AttachVolumeShelveTestJSON-1872118428 None] Deleting attachment 67f794cd-9bec-4a71-be83-42aded30300b. {{(pid=94472) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 11 04:47:24 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-11f8ddac-9708-43b7-bc2a-b179b701ee51 req-fff77bb3-d274-4ffa-a14b-b4cbf43d8826 tempest-TestShelveInstance-639944802 None] Terminate volume connection completed successfully. Aug 11 04:47:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-11f8ddac-9708-43b7-bc2a-b179b701ee51 req-fff77bb3-d274-4ffa-a14b-b4cbf43d8826 tempest-TestShelveInstance-639944802 None] Deleting attachment d3f7b4dc-dcb5-44c5-a738-bf7ccd68a6ea. {{(pid=94472) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 11 04:47:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-11f8ddac-9708-43b7-bc2a-b179b701ee51 req-d7e5d612-a5db-40d8-af0e-d6ade8b25fb8 tempest-TestShelveInstance-639944802 None] Acquiring lock "cinder-1743ec6c-d666-424a-83b2-91752b9f4caa-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:47:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-11f8ddac-9708-43b7-bc2a-b179b701ee51 req-d7e5d612-a5db-40d8-af0e-d6ade8b25fb8 tempest-TestShelveInstance-639944802 None] Lock "cinder-1743ec6c-d666-424a-83b2-91752b9f4caa-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:47:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-11f8ddac-9708-43b7-bc2a-b179b701ee51 req-d7e5d612-a5db-40d8-af0e-d6ade8b25fb8 tempest-TestShelveInstance-639944802 None] Acquiring lock "cinder-quobyte-1743ec6c-d666-424a-83b2-91752b9f4caa" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:47:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-11f8ddac-9708-43b7-bc2a-b179b701ee51 req-d7e5d612-a5db-40d8-af0e-d6ade8b25fb8 tempest-TestShelveInstance-639944802 None] Lock "cinder-quobyte-1743ec6c-d666-424a-83b2-91752b9f4caa" acquired by "delete_volume" :: waited 0.043s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:47:25 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff65a990-c226-40f4-8948-423a8daefaed]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:47:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-11f8ddac-9708-43b7-bc2a-b179b701ee51 req-d7e5d612-a5db-40d8-af0e-d6ade8b25fb8 tempest-TestShelveInstance-639944802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1743ec6c-d666-424a-83b2-91752b9f4caa {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:25 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1743ec6c-d666-424a-83b2-91752b9f4caa Aug 11 04:47:25 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:25 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-11f8ddac-9708-43b7-bc2a-b179b701ee51 req-d7e5d612-a5db-40d8-af0e-d6ade8b25fb8 tempest-TestShelveInstance-639944802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1743ec6c-d666-424a-83b2-91752b9f4caa" returned: 0 in 0.519s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-11f8ddac-9708-43b7-bc2a-b179b701ee51 req-d7e5d612-a5db-40d8-af0e-d6ade8b25fb8 tempest-TestShelveInstance-639944802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1743ec6c-d666-424a-83b2-91752b9f4caa {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:25 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1743ec6c-d666-424a-83b2-91752b9f4caa Aug 11 04:47:25 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:26 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_jaw2y7uddevstack@QuobyteHD /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bca6b1c-87ee-471c-a664-6c841c7c6e12" returned: 0 in 3.011s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:26 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_935df48c-f244-44af-83c6-4799aff908b2_jaw2y7uddevstack@QuobyteHD, size 112.00 MB, duration 3.02 sec, destination /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bca6b1c-87ee-471c-a664-6c841c7c6e12 {{(pid=94472) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 11 04:47:26 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] Converted 112.00 MB image at 37.13 MB/s Aug 11 04:47:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bca6b1c-87ee-471c-a664-6c841c7c6e12 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:26 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bca6b1c-87ee-471c-a664-6c841c7c6e12 1G Aug 11 04:47:26 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:26 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-11f8ddac-9708-43b7-bc2a-b179b701ee51 req-d7e5d612-a5db-40d8-af0e-d6ade8b25fb8 tempest-TestShelveInstance-639944802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1743ec6c-d666-424a-83b2-91752b9f4caa" returned: 0 in 0.498s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:26 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-11f8ddac-9708-43b7-bc2a-b179b701ee51 req-d7e5d612-a5db-40d8-af0e-d6ade8b25fb8 tempest-TestShelveInstance-639944802 None] Lock "cinder-quobyte-1743ec6c-d666-424a-83b2-91752b9f4caa" released by "delete_volume" :: held 1.113s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:47:26 devstack cinder-volume[94472]: DEBUG cinder.quota [req-11f8ddac-9708-43b7-bc2a-b179b701ee51 req-d7e5d612-a5db-40d8-af0e-d6ade8b25fb8 tempest-TestShelveInstance-639944802 None] Created reservations ['8859ecf8-8ee3-4f0c-854d-7c1734afbf1a', '74cd67fb-3caf-401f-92d6-e5672135707c', 'a67c4652-7ac2-493a-9cf3-e88edc922332', '2e789a6b-ccdd-4f17-b036-ff347b9b0c23'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:47:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-11f8ddac-9708-43b7-bc2a-b179b701ee51 req-d7e5d612-a5db-40d8-af0e-d6ade8b25fb8 tempest-TestShelveInstance-639944802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:47:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-11f8ddac-9708-43b7-bc2a-b179b701ee51 req-d7e5d612-a5db-40d8-af0e-d6ade8b25fb8 tempest-TestShelveInstance-639944802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:47:26 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [req-11f8ddac-9708-43b7-bc2a-b179b701ee51 req-d7e5d612-a5db-40d8-af0e-d6ade8b25fb8 tempest-TestShelveInstance-639944802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:47:26 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [req-11f8ddac-9708-43b7-bc2a-b179b701ee51 req-d7e5d612-a5db-40d8-af0e-d6ade8b25fb8 tempest-TestShelveInstance-639944802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:47:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-11f8ddac-9708-43b7-bc2a-b179b701ee51 req-d7e5d612-a5db-40d8-af0e-d6ade8b25fb8 tempest-TestShelveInstance-639944802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:47:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-11f8ddac-9708-43b7-bc2a-b179b701ee51 req-d7e5d612-a5db-40d8-af0e-d6ade8b25fb8 tempest-TestShelveInstance-639944802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:26 devstack sudo[106345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:47:26 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:26 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bca6b1c-87ee-471c-a664-6c841c7c6e12 1G" returned: 0 in 0.530s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:26 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] Downloaded image 935df48c-f244-44af-83c6-4799aff908b2 ((None, [{'url': 'file:///opt/stack/data/glance/images/935df48c-f244-44af-83c6-4799aff908b2', 'metadata': {}}])) to volume 5bca6b1c-87ee-471c-a664-6c841c7c6e12 successfully. {{(pid=94472) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 11 04:47:26 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] Temporary image 935df48c-f244-44af-83c6-4799aff908b2 for user 00744c5fd95d4fbc9bb4bcec7e2a48a5 is deleted. {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 11 04:47:26 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] Marking volume 5bca6b1c-87ee-471c-a664-6c841c7c6e12 as bootable. {{(pid=94472) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 11 04:47:26 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] Copying metadata from image 935df48c-f244-44af-83c6-4799aff908b2 to 5bca6b1c-87ee-471c-a664-6c841c7c6e12. {{(pid=94472) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 11 04:47:26 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] Creating volume glance metadata for volume 5bca6b1c-87ee-471c-a664-6c841c7c6e12 backed by image 935df48c-f244-44af-83c6-4799aff908b2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '935df48c-f244-44af-83c6-4799aff908b2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94472) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 11 04:47:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (686a3035-6926-42cc-9810-62482888d144) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bca6b1c-87ee-471c-a664-6c841c7c6e12', 'volume_size': 1, 'image_id': '935df48c-f244-44af-83c6-4799aff908b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/935df48c-f244-44af-83c6-4799aff908b2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f74f87914afa4c849e1ab3e938cfb579', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '935df48c-f244-44af-83c6-4799aff908b2', 'created_at': datetime.datetime(2026, 8, 11, 2, 32, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 2, 32, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/935df48c-f244-44af-83c6-4799aff908b2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:47:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fdb51a1-0884-4354-9f1e-72619b9ae08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:47:26 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] Volume volume-5bca6b1c-87ee-471c-a664-6c841c7c6e12 (5bca6b1c-87ee-471c-a664-6c841c7c6e12): created successfully Aug 11 04:47:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fdb51a1-0884-4354-9f1e-72619b9ae08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:47:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] Flow 'volume_create_manager' (6c46d57f-6b69-429f-95f0-cfe88ed013d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:47:26 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-9cff3b2d-5cc8-446d-a32c-9498dbed0473 tempest-VolumesExtendTest-833384158 None] Created volume successfully. Aug 11 04:47:26 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-11f8ddac-9708-43b7-bc2a-b179b701ee51 req-d7e5d612-a5db-40d8-af0e-d6ade8b25fb8 tempest-TestShelveInstance-639944802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.329s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:26 devstack cinder-volume[94472]: DEBUG cinder.manager [req-11f8ddac-9708-43b7-bc2a-b179b701ee51 req-d7e5d612-a5db-40d8-af0e-d6ade8b25fb8 tempest-TestShelveInstance-639944802 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:47:26 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-11f8ddac-9708-43b7-bc2a-b179b701ee51 req-d7e5d612-a5db-40d8-af0e-d6ade8b25fb8 tempest-TestShelveInstance-639944802 None] Deleted volume successfully. Aug 11 04:47:26 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-11f8ddac-9708-43b7-bc2a-b179b701ee51 req-d7e5d612-a5db-40d8-af0e-d6ade8b25fb8 tempest-TestShelveInstance-639944802 None] Lock "cinder-1743ec6c-d666-424a-83b2-91752b9f4caa-delete_volume" released by "delete_volume" :: held 1.854s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:47:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8b94eebd-ed57-4df6-8f1a-015aa168ebaf tempest-VolumesExtendTest-833384158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:47:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8b94eebd-ed57-4df6-8f1a-015aa168ebaf tempest-VolumesExtendTest-833384158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:47:27 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[bceb0640-33d8-485b-9ab2-333eafa5c769]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:47:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8b94eebd-ed57-4df6-8f1a-015aa168ebaf tempest-VolumesExtendTest-833384158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bca6b1c-87ee-471c-a664-6c841c7c6e12 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:27 devstack sudo[106348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bca6b1c-87ee-471c-a664-6c841c7c6e12 Aug 11 04:47:27 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:27 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8b94eebd-ed57-4df6-8f1a-015aa168ebaf tempest-VolumesExtendTest-833384158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bca6b1c-87ee-471c-a664-6c841c7c6e12" returned: 0 in 0.441s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8b94eebd-ed57-4df6-8f1a-015aa168ebaf tempest-VolumesExtendTest-833384158 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bca6b1c-87ee-471c-a664-6c841c7c6e12 2G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8b94eebd-ed57-4df6-8f1a-015aa168ebaf tempest-VolumesExtendTest-833384158 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bca6b1c-87ee-471c-a664-6c841c7c6e12 2G" returned: 0 in 0.131s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8b94eebd-ed57-4df6-8f1a-015aa168ebaf tempest-VolumesExtendTest-833384158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.599s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:47:27 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-8b94eebd-ed57-4df6-8f1a-015aa168ebaf tempest-VolumesExtendTest-833384158 None] Extend volume completed successfully. Aug 11 04:47:28 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c9bef1ae-cc71-4176-b098-ea7e8554f261 tempest-VolumesExtendTest-833384158 None] Acquiring lock "cinder-5bca6b1c-87ee-471c-a664-6c841c7c6e12-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:47:28 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c9bef1ae-cc71-4176-b098-ea7e8554f261 tempest-VolumesExtendTest-833384158 None] Lock "cinder-5bca6b1c-87ee-471c-a664-6c841c7c6e12-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:47:28 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c9bef1ae-cc71-4176-b098-ea7e8554f261 tempest-VolumesExtendTest-833384158 None] Acquiring lock "cinder-quobyte-5bca6b1c-87ee-471c-a664-6c841c7c6e12" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:47:28 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c9bef1ae-cc71-4176-b098-ea7e8554f261 tempest-VolumesExtendTest-833384158 None] Lock "cinder-quobyte-5bca6b1c-87ee-471c-a664-6c841c7c6e12" acquired by "delete_volume" :: waited 0.017s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:47:28 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf23251c-7cc6-4fb1-8513-5881a7cfe988]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:47:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c9bef1ae-cc71-4176-b098-ea7e8554f261 tempest-VolumesExtendTest-833384158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bca6b1c-87ee-471c-a664-6c841c7c6e12 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:28 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bca6b1c-87ee-471c-a664-6c841c7c6e12 Aug 11 04:47:28 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:29 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c9bef1ae-cc71-4176-b098-ea7e8554f261 tempest-VolumesExtendTest-833384158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bca6b1c-87ee-471c-a664-6c841c7c6e12" returned: 0 in 0.516s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c9bef1ae-cc71-4176-b098-ea7e8554f261 tempest-VolumesExtendTest-833384158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bca6b1c-87ee-471c-a664-6c841c7c6e12 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:29 devstack sudo[106364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bca6b1c-87ee-471c-a664-6c841c7c6e12 Aug 11 04:47:29 devstack sudo[106364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:29 devstack sudo[106364]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c9bef1ae-cc71-4176-b098-ea7e8554f261 tempest-VolumesExtendTest-833384158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5bca6b1c-87ee-471c-a664-6c841c7c6e12" returned: 0 in 0.333s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:29 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c9bef1ae-cc71-4176-b098-ea7e8554f261 tempest-VolumesExtendTest-833384158 None] Lock "cinder-quobyte-5bca6b1c-87ee-471c-a664-6c841c7c6e12" released by "delete_volume" :: held 0.898s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:47:29 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-c9bef1ae-cc71-4176-b098-ea7e8554f261 tempest-VolumesExtendTest-833384158 None] Created reservations ['1fef59bc-79fa-4db0-9b5e-50f9bb94fcec', '1601523a-e295-4cd3-98b7-eaa2b4dcc5b8', '43060870-ae44-4a92-be6e-df62d886e1d6', 'cfc82843-0fe4-40e0-8ff6-d176d4bf5fe8'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:47:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c9bef1ae-cc71-4176-b098-ea7e8554f261 tempest-VolumesExtendTest-833384158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:47:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c9bef1ae-cc71-4176-b098-ea7e8554f261 tempest-VolumesExtendTest-833384158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:47:29 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c9bef1ae-cc71-4176-b098-ea7e8554f261 tempest-VolumesExtendTest-833384158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:47:29 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c9bef1ae-cc71-4176-b098-ea7e8554f261 tempest-VolumesExtendTest-833384158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:47:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c9bef1ae-cc71-4176-b098-ea7e8554f261 tempest-VolumesExtendTest-833384158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:47:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c9bef1ae-cc71-4176-b098-ea7e8554f261 tempest-VolumesExtendTest-833384158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:29 devstack sudo[106367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:47:29 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:29 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c9bef1ae-cc71-4176-b098-ea7e8554f261 tempest-VolumesExtendTest-833384158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.311s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:29 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-c9bef1ae-cc71-4176-b098-ea7e8554f261 tempest-VolumesExtendTest-833384158 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:47:29 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-c9bef1ae-cc71-4176-b098-ea7e8554f261 tempest-VolumesExtendTest-833384158 None] Deleted volume successfully. Aug 11 04:47:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c9bef1ae-cc71-4176-b098-ea7e8554f261 tempest-VolumesExtendTest-833384158 None] Lock "cinder-5bca6b1c-87ee-471c-a664-6c841c7c6e12-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:47:30 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6f8a1af-c266-4c66-913b-c0bc9811735b tempest-VolumesExtendTest-833384158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:47:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a6f8a1af-c266-4c66-913b-c0bc9811735b tempest-VolumesExtendTest-833384158 None] Flow 'volume_create_manager' (cf59f182-edfa-4097-9975-037e64e7e9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:47:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a6f8a1af-c266-4c66-913b-c0bc9811735b tempest-VolumesExtendTest-833384158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51a44fa4-fb84-43ea-b6ac-6bb99540de2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:47:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a6f8a1af-c266-4c66-913b-c0bc9811735b tempest-VolumesExtendTest-833384158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51a44fa4-fb84-43ea-b6ac-6bb99540de2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1819351137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e79a7ad4-10f8-4c33-809f-36421e972c70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4f98ad9755145c39306739906581785',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:47:30Z,use_quota=True,user_id='00744c5fd95d4fbc9bb4bcec7e2a48a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:47:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a6f8a1af-c266-4c66-913b-c0bc9811735b tempest-VolumesExtendTest-833384158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e823090-bb14-4055-a258-1865e9b1421d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:47:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a6f8a1af-c266-4c66-913b-c0bc9811735b tempest-VolumesExtendTest-833384158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e823090-bb14-4055-a258-1865e9b1421d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:47:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a6f8a1af-c266-4c66-913b-c0bc9811735b tempest-VolumesExtendTest-833384158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (831b60db-20a1-4a6a-b944-9469fa02e58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:47:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a6f8a1af-c266-4c66-913b-c0bc9811735b tempest-VolumesExtendTest-833384158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (831b60db-20a1-4a6a-b944-9469fa02e58f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e79a7ad4-10f8-4c33-809f-36421e972c70', 'volume_name': 'volume-e79a7ad4-10f8-4c33-809f-36421e972c70', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:47:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a6f8a1af-c266-4c66-913b-c0bc9811735b tempest-VolumesExtendTest-833384158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cbd3e3a-c46d-47e7-b95d-70a4b9deb498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:47:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a6f8a1af-c266-4c66-913b-c0bc9811735b tempest-VolumesExtendTest-833384158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cbd3e3a-c46d-47e7-b95d-70a4b9deb498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:47:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a6f8a1af-c266-4c66-913b-c0bc9811735b tempest-VolumesExtendTest-833384158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc8aeebf-f792-47f1-9b3f-0191b29c1aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:47:30 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-a6f8a1af-c266-4c66-913b-c0bc9811735b tempest-VolumesExtendTest-833384158 None] Volume e79a7ad4-10f8-4c33-809f-36421e972c70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e79a7ad4-10f8-4c33-809f-36421e972c70', 'volume_size': 1} Aug 11 04:47:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a6f8a1af-c266-4c66-913b-c0bc9811735b tempest-VolumesExtendTest-833384158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:47:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a6f8a1af-c266-4c66-913b-c0bc9811735b tempest-VolumesExtendTest-833384158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:47:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a6f8a1af-c266-4c66-913b-c0bc9811735b tempest-VolumesExtendTest-833384158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1819351137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e79a7ad4-10f8-4c33-809f-36421e972c70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4f98ad9755145c39306739906581785',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:47:30Z,use_quota=True,user_id='00744c5fd95d4fbc9bb4bcec7e2a48a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:47:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-a6f8a1af-c266-4c66-913b-c0bc9811735b tempest-VolumesExtendTest-833384158 None] Creating volume e79a7ad4-10f8-4c33-809f-36421e972c70 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:47:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a6f8a1af-c266-4c66-913b-c0bc9811735b tempest-VolumesExtendTest-833384158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:47:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a6f8a1af-c266-4c66-913b-c0bc9811735b tempest-VolumesExtendTest-833384158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:47:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a6f8a1af-c266-4c66-913b-c0bc9811735b tempest-VolumesExtendTest-833384158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:47:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a6f8a1af-c266-4c66-913b-c0bc9811735b tempest-VolumesExtendTest-833384158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:47:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a6f8a1af-c266-4c66-913b-c0bc9811735b tempest-VolumesExtendTest-833384158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:47:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a6f8a1af-c266-4c66-913b-c0bc9811735b tempest-VolumesExtendTest-833384158 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:47:30 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-a6f8a1af-c266-4c66-913b-c0bc9811735b tempest-VolumesExtendTest-833384158 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:47:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a6f8a1af-c266-4c66-913b-c0bc9811735b tempest-VolumesExtendTest-833384158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e79a7ad4-10f8-4c33-809f-36421e972c70 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:30 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e79a7ad4-10f8-4c33-809f-36421e972c70 1073741824 Aug 11 04:47:30 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:30 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a6f8a1af-c266-4c66-913b-c0bc9811735b tempest-VolumesExtendTest-833384158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e79a7ad4-10f8-4c33-809f-36421e972c70 1073741824" returned: 0 in 0.512s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a6f8a1af-c266-4c66-913b-c0bc9811735b tempest-VolumesExtendTest-833384158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e79a7ad4-10f8-4c33-809f-36421e972c70 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:31 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e79a7ad4-10f8-4c33-809f-36421e972c70 Aug 11 04:47:31 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:31 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a6f8a1af-c266-4c66-913b-c0bc9811735b tempest-VolumesExtendTest-833384158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e79a7ad4-10f8-4c33-809f-36421e972c70" returned: 0 in 0.289s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:31 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a6f8a1af-c266-4c66-913b-c0bc9811735b tempest-VolumesExtendTest-833384158 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:47:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a6f8a1af-c266-4c66-913b-c0bc9811735b tempest-VolumesExtendTest-833384158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:47:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a6f8a1af-c266-4c66-913b-c0bc9811735b tempest-VolumesExtendTest-833384158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc8aeebf-f792-47f1-9b3f-0191b29c1aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e79a7ad4-10f8-4c33-809f-36421e972c70', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:47:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a6f8a1af-c266-4c66-913b-c0bc9811735b tempest-VolumesExtendTest-833384158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77252ec0-6952-45e7-b6bf-3ab61e433e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:47:31 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-a6f8a1af-c266-4c66-913b-c0bc9811735b tempest-VolumesExtendTest-833384158 None] Volume volume-e79a7ad4-10f8-4c33-809f-36421e972c70 (e79a7ad4-10f8-4c33-809f-36421e972c70): created successfully Aug 11 04:47:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a6f8a1af-c266-4c66-913b-c0bc9811735b tempest-VolumesExtendTest-833384158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77252ec0-6952-45e7-b6bf-3ab61e433e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:47:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a6f8a1af-c266-4c66-913b-c0bc9811735b tempest-VolumesExtendTest-833384158 None] Flow 'volume_create_manager' (cf59f182-edfa-4097-9975-037e64e7e9dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:47:31 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-a6f8a1af-c266-4c66-913b-c0bc9811735b tempest-VolumesExtendTest-833384158 None] Created volume successfully. Aug 11 04:47:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3e4a38a4-fa91-4355-a60e-4c22e12281b3 tempest-VolumesExtendTest-833384158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:47:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3e4a38a4-fa91-4355-a60e-4c22e12281b3 tempest-VolumesExtendTest-833384158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:47:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-3e4a38a4-fa91-4355-a60e-4c22e12281b3 tempest-VolumesExtendTest-833384158 None] Creating offline snapshot 25c787c9-fc4a-4783-b7db-59f3b52333d2 of volume e79a7ad4-10f8-4c33-809f-36421e972c70 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 04:47:32 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b56a2d-ffc7-415b-a72d-a4c16c84530a]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:47:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3e4a38a4-fa91-4355-a60e-4c22e12281b3 tempest-VolumesExtendTest-833384158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e79a7ad4-10f8-4c33-809f-36421e972c70 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:32 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e79a7ad4-10f8-4c33-809f-36421e972c70 Aug 11 04:47:32 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:33 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3e4a38a4-fa91-4355-a60e-4c22e12281b3 tempest-VolumesExtendTest-833384158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e79a7ad4-10f8-4c33-809f-36421e972c70" returned: 0 in 0.441s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3e4a38a4-fa91-4355-a60e-4c22e12281b3 tempest-VolumesExtendTest-833384158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e79a7ad4-10f8-4c33-809f-36421e972c70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e79a7ad4-10f8-4c33-809f-36421e972c70.25c787c9-fc4a-4783-b7db-59f3b52333d2 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:33 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e79a7ad4-10f8-4c33-809f-36421e972c70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e79a7ad4-10f8-4c33-809f-36421e972c70.25c787c9-fc4a-4783-b7db-59f3b52333d2 1G Aug 11 04:47:33 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:33 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3e4a38a4-fa91-4355-a60e-4c22e12281b3 tempest-VolumesExtendTest-833384158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e79a7ad4-10f8-4c33-809f-36421e972c70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e79a7ad4-10f8-4c33-809f-36421e972c70.25c787c9-fc4a-4783-b7db-59f3b52333d2 1G" returned: 0 in 0.535s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3e4a38a4-fa91-4355-a60e-4c22e12281b3 tempest-VolumesExtendTest-833384158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e79a7ad4-10f8-4c33-809f-36421e972c70 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e79a7ad4-10f8-4c33-809f-36421e972c70.25c787c9-fc4a-4783-b7db-59f3b52333d2 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:33 devstack sudo[106392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e79a7ad4-10f8-4c33-809f-36421e972c70 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e79a7ad4-10f8-4c33-809f-36421e972c70.25c787c9-fc4a-4783-b7db-59f3b52333d2 Aug 11 04:47:33 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:34 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3e4a38a4-fa91-4355-a60e-4c22e12281b3 tempest-VolumesExtendTest-833384158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e79a7ad4-10f8-4c33-809f-36421e972c70 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e79a7ad4-10f8-4c33-809f-36421e972c70.25c787c9-fc4a-4783-b7db-59f3b52333d2" returned: 0 in 0.382s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:34 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-3e4a38a4-fa91-4355-a60e-4c22e12281b3 tempest-VolumesExtendTest-833384158 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e79a7ad4-10f8-4c33-809f-36421e972c70.25c787c9-fc4a-4783-b7db-59f3b52333d2 is being set with open permissions: ugo+rw Aug 11 04:47:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3e4a38a4-fa91-4355-a60e-4c22e12281b3 tempest-VolumesExtendTest-833384158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e79a7ad4-10f8-4c33-809f-36421e972c70.25c787c9-fc4a-4783-b7db-59f3b52333d2 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:34 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e79a7ad4-10f8-4c33-809f-36421e972c70.25c787c9-fc4a-4783-b7db-59f3b52333d2 Aug 11 04:47:34 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:34 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3e4a38a4-fa91-4355-a60e-4c22e12281b3 tempest-VolumesExtendTest-833384158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e79a7ad4-10f8-4c33-809f-36421e972c70.25c787c9-fc4a-4783-b7db-59f3b52333d2" returned: 0 in 0.333s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3e4a38a4-fa91-4355-a60e-4c22e12281b3 tempest-VolumesExtendTest-833384158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e79a7ad4-10f8-4c33-809f-36421e972c70.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:34 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e79a7ad4-10f8-4c33-809f-36421e972c70.info Aug 11 04:47:34 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:34 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3e4a38a4-fa91-4355-a60e-4c22e12281b3 tempest-VolumesExtendTest-833384158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e79a7ad4-10f8-4c33-809f-36421e972c70.info" returned: 0 in 0.297s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:34 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-3e4a38a4-fa91-4355-a60e-4c22e12281b3 tempest-VolumesExtendTest-833384158 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e79a7ad4-10f8-4c33-809f-36421e972c70.info is being set with open permissions: ugo+rw Aug 11 04:47:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3e4a38a4-fa91-4355-a60e-4c22e12281b3 tempest-VolumesExtendTest-833384158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e79a7ad4-10f8-4c33-809f-36421e972c70.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:34 devstack sudo[106405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e79a7ad4-10f8-4c33-809f-36421e972c70.info Aug 11 04:47:34 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:35 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3e4a38a4-fa91-4355-a60e-4c22e12281b3 tempest-VolumesExtendTest-833384158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e79a7ad4-10f8-4c33-809f-36421e972c70.info" returned: 0 in 0.291s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3e4a38a4-fa91-4355-a60e-4c22e12281b3 tempest-VolumesExtendTest-833384158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.422s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:47:35 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-3e4a38a4-fa91-4355-a60e-4c22e12281b3 tempest-VolumesExtendTest-833384158 None] Create snapshot completed successfully Aug 11 04:47:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-43a63b90-36f6-459d-865e-d65b066d730a tempest-VolumesExtendTest-833384158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:47:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-43a63b90-36f6-459d-865e-d65b066d730a tempest-VolumesExtendTest-833384158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:47:36 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66cfaa7-2eef-47ae-af59-88b6d4bb175e]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:47:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-43a63b90-36f6-459d-865e-d65b066d730a tempest-VolumesExtendTest-833384158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e79a7ad4-10f8-4c33-809f-36421e972c70 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:36 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e79a7ad4-10f8-4c33-809f-36421e972c70 Aug 11 04:47:36 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:36 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-43a63b90-36f6-459d-865e-d65b066d730a tempest-VolumesExtendTest-833384158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e79a7ad4-10f8-4c33-809f-36421e972c70" returned: 0 in 0.518s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-43a63b90-36f6-459d-865e-d65b066d730a tempest-VolumesExtendTest-833384158 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e79a7ad4-10f8-4c33-809f-36421e972c70.25c787c9-fc4a-4783-b7db-59f3b52333d2 2G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-43a63b90-36f6-459d-865e-d65b066d730a tempest-VolumesExtendTest-833384158 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e79a7ad4-10f8-4c33-809f-36421e972c70.25c787c9-fc4a-4783-b7db-59f3b52333d2 2G" returned: 0 in 0.267s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-43a63b90-36f6-459d-865e-d65b066d730a tempest-VolumesExtendTest-833384158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.851s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:47:36 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-43a63b90-36f6-459d-865e-d65b066d730a tempest-VolumesExtendTest-833384158 None] Extend volume completed successfully. Aug 11 04:47:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a50dce82-a764-4a9b-9209-e929d2559367 tempest-VolumesExtendTest-833384158 None] Acquiring lock "cinder-25c787c9-fc4a-4783-b7db-59f3b52333d2-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:47:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a50dce82-a764-4a9b-9209-e929d2559367 tempest-VolumesExtendTest-833384158 None] Lock "cinder-25c787c9-fc4a-4783-b7db-59f3b52333d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:47:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a50dce82-a764-4a9b-9209-e929d2559367 tempest-VolumesExtendTest-833384158 None] Acquiring lock "cinder-quobyte-e79a7ad4-10f8-4c33-809f-36421e972c70" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:47:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a50dce82-a764-4a9b-9209-e929d2559367 tempest-VolumesExtendTest-833384158 None] Lock "cinder-quobyte-e79a7ad4-10f8-4c33-809f-36421e972c70" acquired by "delete_snapshot" :: waited 0.036s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:47:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a50dce82-a764-4a9b-9209-e929d2559367 tempest-VolumesExtendTest-833384158 None] Acquiring lock "cinder-quobyte-25c787c9-fc4a-4783-b7db-59f3b52333d2" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:47:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a50dce82-a764-4a9b-9209-e929d2559367 tempest-VolumesExtendTest-833384158 None] Lock "cinder-quobyte-25c787c9-fc4a-4783-b7db-59f3b52333d2" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:47:37 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-a50dce82-a764-4a9b-9209-e929d2559367 tempest-VolumesExtendTest-833384158 None] Deleting offline snapshot 25c787c9-fc4a-4783-b7db-59f3b52333d2 of volume e79a7ad4-10f8-4c33-809f-36421e972c70 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 04:47:37 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-a50dce82-a764-4a9b-9209-e929d2559367 tempest-VolumesExtendTest-833384158 None] snapshot_file for this snap is: volume-e79a7ad4-10f8-4c33-809f-36421e972c70.25c787c9-fc4a-4783-b7db-59f3b52333d2 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 04:47:37 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf89a6a-9636-44f9-8749-2f170faf7f47]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:47:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a50dce82-a764-4a9b-9209-e929d2559367 tempest-VolumesExtendTest-833384158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e79a7ad4-10f8-4c33-809f-36421e972c70.25c787c9-fc4a-4783-b7db-59f3b52333d2 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:37 devstack sudo[106418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e79a7ad4-10f8-4c33-809f-36421e972c70.25c787c9-fc4a-4783-b7db-59f3b52333d2 Aug 11 04:47:37 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:38 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a50dce82-a764-4a9b-9209-e929d2559367 tempest-VolumesExtendTest-833384158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e79a7ad4-10f8-4c33-809f-36421e972c70.25c787c9-fc4a-4783-b7db-59f3b52333d2" returned: 0 in 0.705s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:38 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-a50dce82-a764-4a9b-9209-e929d2559367 tempest-VolumesExtendTest-833384158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e79a7ad4-10f8-4c33-809f-36421e972c70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:47:38 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed2f0da-8c63-41ba-8e4d-a2f4d8e97421]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:47:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a50dce82-a764-4a9b-9209-e929d2559367 tempest-VolumesExtendTest-833384158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e79a7ad4-10f8-4c33-809f-36421e972c70 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:38 devstack sudo[106423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e79a7ad4-10f8-4c33-809f-36421e972c70 Aug 11 04:47:38 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:38 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a50dce82-a764-4a9b-9209-e929d2559367 tempest-VolumesExtendTest-833384158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e79a7ad4-10f8-4c33-809f-36421e972c70" returned: 0 in 0.504s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a50dce82-a764-4a9b-9209-e929d2559367 tempest-VolumesExtendTest-833384158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e79a7ad4-10f8-4c33-809f-36421e972c70.25c787c9-fc4a-4783-b7db-59f3b52333d2 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:38 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e79a7ad4-10f8-4c33-809f-36421e972c70.25c787c9-fc4a-4783-b7db-59f3b52333d2 Aug 11 04:47:38 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:39 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a50dce82-a764-4a9b-9209-e929d2559367 tempest-VolumesExtendTest-833384158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e79a7ad4-10f8-4c33-809f-36421e972c70.25c787c9-fc4a-4783-b7db-59f3b52333d2" returned: 0 in 0.438s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a50dce82-a764-4a9b-9209-e929d2559367 tempest-VolumesExtendTest-833384158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e79a7ad4-10f8-4c33-809f-36421e972c70.25c787c9-fc4a-4783-b7db-59f3b52333d2 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:39 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e79a7ad4-10f8-4c33-809f-36421e972c70.25c787c9-fc4a-4783-b7db-59f3b52333d2 Aug 11 04:47:39 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:39 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a50dce82-a764-4a9b-9209-e929d2559367 tempest-VolumesExtendTest-833384158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e79a7ad4-10f8-4c33-809f-36421e972c70.25c787c9-fc4a-4783-b7db-59f3b52333d2" returned: 0 in 0.439s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a50dce82-a764-4a9b-9209-e929d2559367 tempest-VolumesExtendTest-833384158 None] Lock "cinder-quobyte-25c787c9-fc4a-4783-b7db-59f3b52333d2" released by "_delete_snapshot" :: held 2.284s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:47:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a50dce82-a764-4a9b-9209-e929d2559367 tempest-VolumesExtendTest-833384158 None] Lock "cinder-quobyte-e79a7ad4-10f8-4c33-809f-36421e972c70" released by "delete_snapshot" :: held 2.328s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:47:39 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-a50dce82-a764-4a9b-9209-e929d2559367 tempest-VolumesExtendTest-833384158 None] Created reservations ['69f382f9-9837-4762-9561-f44ca3620128', '1f0afc69-3585-4159-8fdd-18cbdede4af0', 'bfdc241c-0d75-4b11-b440-7365a9bf5dcc', '9dbc8c46-24e1-47be-8683-5f3d07be4d83'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:47:40 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-a50dce82-a764-4a9b-9209-e929d2559367 tempest-VolumesExtendTest-833384158 None] Delete snapshot completed successfully. Aug 11 04:47:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a50dce82-a764-4a9b-9209-e929d2559367 tempest-VolumesExtendTest-833384158 None] Lock "cinder-25c787c9-fc4a-4783-b7db-59f3b52333d2-delete_snapshot" released by "delete_snapshot" :: held 2.571s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:47:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-67111636-f95b-4b17-8dff-7c989a85aa25 tempest-VolumesExtendTest-833384158 None] Acquiring lock "cinder-e79a7ad4-10f8-4c33-809f-36421e972c70-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:47:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-67111636-f95b-4b17-8dff-7c989a85aa25 tempest-VolumesExtendTest-833384158 None] Lock "cinder-e79a7ad4-10f8-4c33-809f-36421e972c70-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:47:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-67111636-f95b-4b17-8dff-7c989a85aa25 tempest-VolumesExtendTest-833384158 None] Acquiring lock "cinder-quobyte-e79a7ad4-10f8-4c33-809f-36421e972c70" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:47:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-67111636-f95b-4b17-8dff-7c989a85aa25 tempest-VolumesExtendTest-833384158 None] Lock "cinder-quobyte-e79a7ad4-10f8-4c33-809f-36421e972c70" acquired by "delete_volume" :: waited 0.038s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:47:41 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[061995de-93dc-4e30-81ea-d2fdf67654ad]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:47:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-67111636-f95b-4b17-8dff-7c989a85aa25 tempest-VolumesExtendTest-833384158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e79a7ad4-10f8-4c33-809f-36421e972c70 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:41 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e79a7ad4-10f8-4c33-809f-36421e972c70 Aug 11 04:47:41 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:41 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-67111636-f95b-4b17-8dff-7c989a85aa25 tempest-VolumesExtendTest-833384158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e79a7ad4-10f8-4c33-809f-36421e972c70" returned: 0 in 0.750s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-67111636-f95b-4b17-8dff-7c989a85aa25 tempest-VolumesExtendTest-833384158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e79a7ad4-10f8-4c33-809f-36421e972c70 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:41 devstack sudo[106479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e79a7ad4-10f8-4c33-809f-36421e972c70 Aug 11 04:47:41 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:42 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-67111636-f95b-4b17-8dff-7c989a85aa25 tempest-VolumesExtendTest-833384158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e79a7ad4-10f8-4c33-809f-36421e972c70" returned: 0 in 0.321s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:42 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-67111636-f95b-4b17-8dff-7c989a85aa25 tempest-VolumesExtendTest-833384158 None] Lock "cinder-quobyte-e79a7ad4-10f8-4c33-809f-36421e972c70" released by "delete_volume" :: held 1.159s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:47:42 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-67111636-f95b-4b17-8dff-7c989a85aa25 tempest-VolumesExtendTest-833384158 None] Created reservations ['b7078d57-71fd-4d47-a817-f232e3cf4d9d', '9e091e0a-32c7-4503-91a8-2501b3d1adfc', 'b61e5c87-eea2-4fb5-a693-c2df4a6cd703', '90ba1d66-4e5f-4438-83e4-39781a22c98b'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:47:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-67111636-f95b-4b17-8dff-7c989a85aa25 tempest-VolumesExtendTest-833384158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:47:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-67111636-f95b-4b17-8dff-7c989a85aa25 tempest-VolumesExtendTest-833384158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:47:42 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-67111636-f95b-4b17-8dff-7c989a85aa25 tempest-VolumesExtendTest-833384158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:47:42 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-67111636-f95b-4b17-8dff-7c989a85aa25 tempest-VolumesExtendTest-833384158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:47:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-67111636-f95b-4b17-8dff-7c989a85aa25 tempest-VolumesExtendTest-833384158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:47:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-67111636-f95b-4b17-8dff-7c989a85aa25 tempest-VolumesExtendTest-833384158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:42 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:47:42 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:42 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-67111636-f95b-4b17-8dff-7c989a85aa25 tempest-VolumesExtendTest-833384158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.415s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:42 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-67111636-f95b-4b17-8dff-7c989a85aa25 tempest-VolumesExtendTest-833384158 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:47:42 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-67111636-f95b-4b17-8dff-7c989a85aa25 tempest-VolumesExtendTest-833384158 None] Deleted volume successfully. Aug 11 04:47:42 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-67111636-f95b-4b17-8dff-7c989a85aa25 tempest-VolumesExtendTest-833384158 None] Lock "cinder-e79a7ad4-10f8-4c33-809f-36421e972c70-delete_volume" released by "delete_volume" :: held 1.948s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:47:52 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:UPDATE=60,cinder:DELETE=4,cinder:SELECT=49,cinder:INSERT=19 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:47:52 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:UPDATE=60,cinder:SELECT=52,cinder:INSERT=21,cinder:DELETE=5 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:47:54 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a7a0ec7-4a4a-47aa-b7ef-8476afb7879d tempest-TestServerVolumeAttachmentScenario-1192690184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:47:54 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6a7a0ec7-4a4a-47aa-b7ef-8476afb7879d tempest-TestServerVolumeAttachmentScenario-1192690184 None] Flow 'volume_create_manager' (49a57024-efb2-4508-95d3-2223bbed6e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:47:54 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6a7a0ec7-4a4a-47aa-b7ef-8476afb7879d tempest-TestServerVolumeAttachmentScenario-1192690184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80eed1b6-dc8b-471b-99e4-8b1ab00490c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:47:54 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6a7a0ec7-4a4a-47aa-b7ef-8476afb7879d tempest-TestServerVolumeAttachmentScenario-1192690184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80eed1b6-dc8b-471b-99e4-8b1ab00490c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:47:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-391072642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71509722-97fa-4c59-8307-b98af3e1011b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1afb85cb63e482297860c2405751cc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:47:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:47:54Z,use_quota=True,user_id='c4ffdb3e2614444dac652ae57c7fbaec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:47:54 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6a7a0ec7-4a4a-47aa-b7ef-8476afb7879d tempest-TestServerVolumeAttachmentScenario-1192690184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6de97dee-4a62-4eee-8391-01ba33640c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:47:54 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6a7a0ec7-4a4a-47aa-b7ef-8476afb7879d tempest-TestServerVolumeAttachmentScenario-1192690184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6de97dee-4a62-4eee-8391-01ba33640c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:47:54 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6a7a0ec7-4a4a-47aa-b7ef-8476afb7879d tempest-TestServerVolumeAttachmentScenario-1192690184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c9ee511-22f2-4a8a-80c6-d45ef58d3b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:47:54 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6a7a0ec7-4a4a-47aa-b7ef-8476afb7879d tempest-TestServerVolumeAttachmentScenario-1192690184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c9ee511-22f2-4a8a-80c6-d45ef58d3b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71509722-97fa-4c59-8307-b98af3e1011b', 'volume_name': 'volume-71509722-97fa-4c59-8307-b98af3e1011b', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:47:54 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6a7a0ec7-4a4a-47aa-b7ef-8476afb7879d tempest-TestServerVolumeAttachmentScenario-1192690184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4848fe8-57c8-41ac-90d0-8701147c2747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:47:54 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6a7a0ec7-4a4a-47aa-b7ef-8476afb7879d tempest-TestServerVolumeAttachmentScenario-1192690184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4848fe8-57c8-41ac-90d0-8701147c2747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:47:54 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6a7a0ec7-4a4a-47aa-b7ef-8476afb7879d tempest-TestServerVolumeAttachmentScenario-1192690184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05cbbe33-d7fb-4bfa-9363-b0e317b203dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:47:54 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-6a7a0ec7-4a4a-47aa-b7ef-8476afb7879d tempest-TestServerVolumeAttachmentScenario-1192690184 None] Volume 71509722-97fa-4c59-8307-b98af3e1011b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71509722-97fa-4c59-8307-b98af3e1011b', 'volume_size': 1} Aug 11 04:47:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6a7a0ec7-4a4a-47aa-b7ef-8476afb7879d tempest-TestServerVolumeAttachmentScenario-1192690184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:47:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6a7a0ec7-4a4a-47aa-b7ef-8476afb7879d tempest-TestServerVolumeAttachmentScenario-1192690184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:47:54 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6a7a0ec7-4a4a-47aa-b7ef-8476afb7879d tempest-TestServerVolumeAttachmentScenario-1192690184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:47:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-391072642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71509722-97fa-4c59-8307-b98af3e1011b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1afb85cb63e482297860c2405751cc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:47:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:47:54Z,use_quota=True,user_id='c4ffdb3e2614444dac652ae57c7fbaec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:47:54 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-6a7a0ec7-4a4a-47aa-b7ef-8476afb7879d tempest-TestServerVolumeAttachmentScenario-1192690184 None] Creating volume 71509722-97fa-4c59-8307-b98af3e1011b {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:47:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6a7a0ec7-4a4a-47aa-b7ef-8476afb7879d tempest-TestServerVolumeAttachmentScenario-1192690184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:47:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6a7a0ec7-4a4a-47aa-b7ef-8476afb7879d tempest-TestServerVolumeAttachmentScenario-1192690184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:47:54 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6a7a0ec7-4a4a-47aa-b7ef-8476afb7879d tempest-TestServerVolumeAttachmentScenario-1192690184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:47:54 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6a7a0ec7-4a4a-47aa-b7ef-8476afb7879d tempest-TestServerVolumeAttachmentScenario-1192690184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:47:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6a7a0ec7-4a4a-47aa-b7ef-8476afb7879d tempest-TestServerVolumeAttachmentScenario-1192690184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:47:54 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6a7a0ec7-4a4a-47aa-b7ef-8476afb7879d tempest-TestServerVolumeAttachmentScenario-1192690184 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:47:54 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-6a7a0ec7-4a4a-47aa-b7ef-8476afb7879d tempest-TestServerVolumeAttachmentScenario-1192690184 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:47:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6a7a0ec7-4a4a-47aa-b7ef-8476afb7879d tempest-TestServerVolumeAttachmentScenario-1192690184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-71509722-97fa-4c59-8307-b98af3e1011b 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:54 devstack sudo[106582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-71509722-97fa-4c59-8307-b98af3e1011b 1073741824 Aug 11 04:47:54 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:55 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d0feb80-6f2e-460c-a994-2e84cb7a3cc5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:47:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1d0feb80-6f2e-460c-a994-2e84cb7a3cc5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Flow 'volume_create_manager' (66b51df1-0e98-4f3a-bd1b-ab7f325696b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:47:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1d0feb80-6f2e-460c-a994-2e84cb7a3cc5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e00bcf70-d5ad-4215-a488-49d6e3b879f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:47:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1d0feb80-6f2e-460c-a994-2e84cb7a3cc5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e00bcf70-d5ad-4215-a488-49d6e3b879f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:47:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-882575552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91f3d2e6-433f-49b9-8e67-be6727223eb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1afb85cb63e482297860c2405751cc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:47:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:47:55Z,use_quota=True,user_id='c4ffdb3e2614444dac652ae57c7fbaec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:47:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1d0feb80-6f2e-460c-a994-2e84cb7a3cc5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23d7a25f-e70a-42ca-ae48-3705d443d33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:47:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1d0feb80-6f2e-460c-a994-2e84cb7a3cc5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23d7a25f-e70a-42ca-ae48-3705d443d33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:47:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1d0feb80-6f2e-460c-a994-2e84cb7a3cc5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2564d8e4-db32-4983-bb74-8bd6bfed98ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:47:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1d0feb80-6f2e-460c-a994-2e84cb7a3cc5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2564d8e4-db32-4983-bb74-8bd6bfed98ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91f3d2e6-433f-49b9-8e67-be6727223eb3', 'volume_name': 'volume-91f3d2e6-433f-49b9-8e67-be6727223eb3', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:47:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1d0feb80-6f2e-460c-a994-2e84cb7a3cc5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a20ab22-18c0-4f32-9c83-02b4a4b83b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:47:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1d0feb80-6f2e-460c-a994-2e84cb7a3cc5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a20ab22-18c0-4f32-9c83-02b4a4b83b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:47:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1d0feb80-6f2e-460c-a994-2e84cb7a3cc5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (833528f9-1ec6-4973-879f-c3c356f77ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:47:55 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-1d0feb80-6f2e-460c-a994-2e84cb7a3cc5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Volume 91f3d2e6-433f-49b9-8e67-be6727223eb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91f3d2e6-433f-49b9-8e67-be6727223eb3', 'volume_size': 1} Aug 11 04:47:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1d0feb80-6f2e-460c-a994-2e84cb7a3cc5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:47:55 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6a7a0ec7-4a4a-47aa-b7ef-8476afb7879d tempest-TestServerVolumeAttachmentScenario-1192690184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-71509722-97fa-4c59-8307-b98af3e1011b 1073741824" returned: 0 in 1.006s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6a7a0ec7-4a4a-47aa-b7ef-8476afb7879d tempest-TestServerVolumeAttachmentScenario-1192690184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-71509722-97fa-4c59-8307-b98af3e1011b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:55 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-71509722-97fa-4c59-8307-b98af3e1011b Aug 11 04:47:55 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:56 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6a7a0ec7-4a4a-47aa-b7ef-8476afb7879d tempest-TestServerVolumeAttachmentScenario-1192690184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-71509722-97fa-4c59-8307-b98af3e1011b" returned: 0 in 0.430s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6a7a0ec7-4a4a-47aa-b7ef-8476afb7879d tempest-TestServerVolumeAttachmentScenario-1192690184 None] <== create_volume: return (1524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:47:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6a7a0ec7-4a4a-47aa-b7ef-8476afb7879d tempest-TestServerVolumeAttachmentScenario-1192690184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:47:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1d0feb80-6f2e-460c-a994-2e84cb7a3cc5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.764s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:47:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1d0feb80-6f2e-460c-a994-2e84cb7a3cc5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:47:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-882575552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91f3d2e6-433f-49b9-8e67-be6727223eb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1afb85cb63e482297860c2405751cc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:47:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:47:55Z,use_quota=True,user_id='c4ffdb3e2614444dac652ae57c7fbaec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:47:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-1d0feb80-6f2e-460c-a994-2e84cb7a3cc5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Creating volume 91f3d2e6-433f-49b9-8e67-be6727223eb3 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:47:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1d0feb80-6f2e-460c-a994-2e84cb7a3cc5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:47:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1d0feb80-6f2e-460c-a994-2e84cb7a3cc5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:47:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1d0feb80-6f2e-460c-a994-2e84cb7a3cc5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:47:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1d0feb80-6f2e-460c-a994-2e84cb7a3cc5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:47:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1d0feb80-6f2e-460c-a994-2e84cb7a3cc5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:47:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1d0feb80-6f2e-460c-a994-2e84cb7a3cc5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:47:56 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-1d0feb80-6f2e-460c-a994-2e84cb7a3cc5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:47:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1d0feb80-6f2e-460c-a994-2e84cb7a3cc5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-91f3d2e6-433f-49b9-8e67-be6727223eb3 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6a7a0ec7-4a4a-47aa-b7ef-8476afb7879d tempest-TestServerVolumeAttachmentScenario-1192690184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05cbbe33-d7fb-4bfa-9363-b0e317b203dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71509722-97fa-4c59-8307-b98af3e1011b', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:47:56 devstack sudo[106591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-91f3d2e6-433f-49b9-8e67-be6727223eb3 1073741824 Aug 11 04:47:56 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6a7a0ec7-4a4a-47aa-b7ef-8476afb7879d tempest-TestServerVolumeAttachmentScenario-1192690184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b08493a-7e48-4e78-a04f-5ba979edc45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:47:56 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-6a7a0ec7-4a4a-47aa-b7ef-8476afb7879d tempest-TestServerVolumeAttachmentScenario-1192690184 None] Volume volume-71509722-97fa-4c59-8307-b98af3e1011b (71509722-97fa-4c59-8307-b98af3e1011b): created successfully Aug 11 04:47:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6a7a0ec7-4a4a-47aa-b7ef-8476afb7879d tempest-TestServerVolumeAttachmentScenario-1192690184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b08493a-7e48-4e78-a04f-5ba979edc45a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:47:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6a7a0ec7-4a4a-47aa-b7ef-8476afb7879d tempest-TestServerVolumeAttachmentScenario-1192690184 None] Flow 'volume_create_manager' (49a57024-efb2-4508-95d3-2223bbed6e2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:47:56 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-6a7a0ec7-4a4a-47aa-b7ef-8476afb7879d tempest-TestServerVolumeAttachmentScenario-1192690184 None] Created volume successfully. Aug 11 04:47:56 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1d0feb80-6f2e-460c-a994-2e84cb7a3cc5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-91f3d2e6-433f-49b9-8e67-be6727223eb3 1073741824" returned: 0 in 0.716s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1d0feb80-6f2e-460c-a994-2e84cb7a3cc5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-91f3d2e6-433f-49b9-8e67-be6727223eb3 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:56 devstack sudo[106597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-91f3d2e6-433f-49b9-8e67-be6727223eb3 Aug 11 04:47:56 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:57 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1d0feb80-6f2e-460c-a994-2e84cb7a3cc5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-91f3d2e6-433f-49b9-8e67-be6727223eb3" returned: 0 in 0.345s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1d0feb80-6f2e-460c-a994-2e84cb7a3cc5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:47:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1d0feb80-6f2e-460c-a994-2e84cb7a3cc5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:47:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1d0feb80-6f2e-460c-a994-2e84cb7a3cc5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (833528f9-1ec6-4973-879f-c3c356f77ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91f3d2e6-433f-49b9-8e67-be6727223eb3', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:47:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1d0feb80-6f2e-460c-a994-2e84cb7a3cc5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c6adeda-7d81-41cc-a9e8-d4ee304f3fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:47:57 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-1d0feb80-6f2e-460c-a994-2e84cb7a3cc5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Volume volume-91f3d2e6-433f-49b9-8e67-be6727223eb3 (91f3d2e6-433f-49b9-8e67-be6727223eb3): created successfully Aug 11 04:47:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1d0feb80-6f2e-460c-a994-2e84cb7a3cc5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c6adeda-7d81-41cc-a9e8-d4ee304f3fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:47:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1d0feb80-6f2e-460c-a994-2e84cb7a3cc5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Flow 'volume_create_manager' (66b51df1-0e98-4f3a-bd1b-ab7f325696b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:47:57 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-1d0feb80-6f2e-460c-a994-2e84cb7a3cc5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Created volume successfully. Aug 11 04:47:58 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 04:47:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:47:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:47:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:47:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:47:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:47:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:47:58 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:47:58 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:47:58 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Aug 11 04:47:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.292s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:47:58 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:47:58 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running periodic task VolumeManager._thread_info {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 04:47:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] thread count: 28 {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 11 04:47:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] thread info: [<_MainThread(MainThread, started 133315846115456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 11 04:48:02 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-d42dd4a0-dfb2-40cf-b77e-5ed8b1198948 tempest-VolumesSnapshotTestJSON-1155347685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:48:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d42dd4a0-dfb2-40cf-b77e-5ed8b1198948 tempest-VolumesSnapshotTestJSON-1155347685 None] Flow 'volume_create_manager' (f0014e26-cc6d-4b67-bda0-a8a20b8e7e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:48:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d42dd4a0-dfb2-40cf-b77e-5ed8b1198948 tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a3bde06-aa8e-4d39-b824-89302e64fd6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:48:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d42dd4a0-dfb2-40cf-b77e-5ed8b1198948 tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a3bde06-aa8e-4d39-b824-89302e64fd6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:48:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-184014817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f06a3105584cdba4395699869938d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:48:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:48:03Z,use_quota=True,user_id='484120d562854fa3b682753a0d9fd99c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:48:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d42dd4a0-dfb2-40cf-b77e-5ed8b1198948 tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d429ee15-19ef-49d3-82a6-95eb68afe4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:48:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d42dd4a0-dfb2-40cf-b77e-5ed8b1198948 tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d429ee15-19ef-49d3-82a6-95eb68afe4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:48:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d42dd4a0-dfb2-40cf-b77e-5ed8b1198948 tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (560171f4-ba7d-4d83-b44f-d2edfd373fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:48:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d42dd4a0-dfb2-40cf-b77e-5ed8b1198948 tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (560171f4-ba7d-4d83-b44f-d2edfd373fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3', 'volume_name': 'volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:48:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d42dd4a0-dfb2-40cf-b77e-5ed8b1198948 tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (446ceef9-5a0c-46b5-9944-ad1b88c6245f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:48:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d42dd4a0-dfb2-40cf-b77e-5ed8b1198948 tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (446ceef9-5a0c-46b5-9944-ad1b88c6245f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:48:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d42dd4a0-dfb2-40cf-b77e-5ed8b1198948 tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da78e386-ff54-44e3-af69-a5f42e9e1fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:48:02 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-d42dd4a0-dfb2-40cf-b77e-5ed8b1198948 tempest-VolumesSnapshotTestJSON-1155347685 None] Volume e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3', 'volume_size': 1} Aug 11 04:48:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d42dd4a0-dfb2-40cf-b77e-5ed8b1198948 tempest-VolumesSnapshotTestJSON-1155347685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:48:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d42dd4a0-dfb2-40cf-b77e-5ed8b1198948 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:48:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d42dd4a0-dfb2-40cf-b77e-5ed8b1198948 tempest-VolumesSnapshotTestJSON-1155347685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:48:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-184014817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f06a3105584cdba4395699869938d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:48:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:48:03Z,use_quota=True,user_id='484120d562854fa3b682753a0d9fd99c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:48:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-d42dd4a0-dfb2-40cf-b77e-5ed8b1198948 tempest-VolumesSnapshotTestJSON-1155347685 None] Creating volume e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:48:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d42dd4a0-dfb2-40cf-b77e-5ed8b1198948 tempest-VolumesSnapshotTestJSON-1155347685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:48:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d42dd4a0-dfb2-40cf-b77e-5ed8b1198948 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:48:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d42dd4a0-dfb2-40cf-b77e-5ed8b1198948 tempest-VolumesSnapshotTestJSON-1155347685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:48:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d42dd4a0-dfb2-40cf-b77e-5ed8b1198948 tempest-VolumesSnapshotTestJSON-1155347685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:48:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d42dd4a0-dfb2-40cf-b77e-5ed8b1198948 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:48:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d42dd4a0-dfb2-40cf-b77e-5ed8b1198948 tempest-VolumesSnapshotTestJSON-1155347685 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:48:02 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-d42dd4a0-dfb2-40cf-b77e-5ed8b1198948 tempest-VolumesSnapshotTestJSON-1155347685 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:48:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d42dd4a0-dfb2-40cf-b77e-5ed8b1198948 tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:02 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3 1073741824 Aug 11 04:48:02 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:03 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d42dd4a0-dfb2-40cf-b77e-5ed8b1198948 tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3 1073741824" returned: 0 in 0.468s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d42dd4a0-dfb2-40cf-b77e-5ed8b1198948 tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:03 devstack sudo[106644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3 Aug 11 04:48:03 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:03 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d42dd4a0-dfb2-40cf-b77e-5ed8b1198948 tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3" returned: 0 in 0.392s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:03 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d42dd4a0-dfb2-40cf-b77e-5ed8b1198948 tempest-VolumesSnapshotTestJSON-1155347685 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:48:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d42dd4a0-dfb2-40cf-b77e-5ed8b1198948 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:48:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d42dd4a0-dfb2-40cf-b77e-5ed8b1198948 tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da78e386-ff54-44e3-af69-a5f42e9e1fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:48:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d42dd4a0-dfb2-40cf-b77e-5ed8b1198948 tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b8519dc-6db6-4fe8-91da-3ba92650c808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:48:03 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-d42dd4a0-dfb2-40cf-b77e-5ed8b1198948 tempest-VolumesSnapshotTestJSON-1155347685 None] Volume volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3 (e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3): created successfully Aug 11 04:48:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d42dd4a0-dfb2-40cf-b77e-5ed8b1198948 tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b8519dc-6db6-4fe8-91da-3ba92650c808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:48:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d42dd4a0-dfb2-40cf-b77e-5ed8b1198948 tempest-VolumesSnapshotTestJSON-1155347685 None] Flow 'volume_create_manager' (f0014e26-cc6d-4b67-bda0-a8a20b8e7e7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:48:03 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-d42dd4a0-dfb2-40cf-b77e-5ed8b1198948 tempest-VolumesSnapshotTestJSON-1155347685 None] Created volume successfully. Aug 11 04:48:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c3742b3e-faae-4948-910d-3fe5ce6e5ef6 tempest-VolumesSnapshotTestJSON-1155347685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:48:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c3742b3e-faae-4948-910d-3fe5ce6e5ef6 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:48:05 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-c3742b3e-faae-4948-910d-3fe5ce6e5ef6 tempest-VolumesSnapshotTestJSON-1155347685 None] Creating offline snapshot 3541ee52-8a01-4bcb-911d-e05e95e209e2 of volume e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 04:48:05 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[834bf564-211b-407b-85f2-388daa5e36b1]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:48:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c3742b3e-faae-4948-910d-3fe5ce6e5ef6 tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:05 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3 Aug 11 04:48:05 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:05 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c3742b3e-faae-4948-910d-3fe5ce6e5ef6 tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3" returned: 0 in 0.406s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c3742b3e-faae-4948-910d-3fe5ce6e5ef6 tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3.3541ee52-8a01-4bcb-911d-e05e95e209e2 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:05 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3.3541ee52-8a01-4bcb-911d-e05e95e209e2 1G Aug 11 04:48:05 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:06 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c3742b3e-faae-4948-910d-3fe5ce6e5ef6 tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3.3541ee52-8a01-4bcb-911d-e05e95e209e2 1G" returned: 0 in 0.516s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c3742b3e-faae-4948-910d-3fe5ce6e5ef6 tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3.3541ee52-8a01-4bcb-911d-e05e95e209e2 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:06 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3.3541ee52-8a01-4bcb-911d-e05e95e209e2 Aug 11 04:48:06 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:06 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c3742b3e-faae-4948-910d-3fe5ce6e5ef6 tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3.3541ee52-8a01-4bcb-911d-e05e95e209e2" returned: 0 in 0.306s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:06 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-c3742b3e-faae-4948-910d-3fe5ce6e5ef6 tempest-VolumesSnapshotTestJSON-1155347685 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3.3541ee52-8a01-4bcb-911d-e05e95e209e2 is being set with open permissions: ugo+rw Aug 11 04:48:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c3742b3e-faae-4948-910d-3fe5ce6e5ef6 tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3.3541ee52-8a01-4bcb-911d-e05e95e209e2 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:06 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3.3541ee52-8a01-4bcb-911d-e05e95e209e2 Aug 11 04:48:06 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:06 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c3742b3e-faae-4948-910d-3fe5ce6e5ef6 tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3.3541ee52-8a01-4bcb-911d-e05e95e209e2" returned: 0 in 0.257s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c3742b3e-faae-4948-910d-3fe5ce6e5ef6 tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:06 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3.info Aug 11 04:48:06 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:06 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c3742b3e-faae-4948-910d-3fe5ce6e5ef6 tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3.info" returned: 0 in 0.266s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:06 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-c3742b3e-faae-4948-910d-3fe5ce6e5ef6 tempest-VolumesSnapshotTestJSON-1155347685 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3.info is being set with open permissions: ugo+rw Aug 11 04:48:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c3742b3e-faae-4948-910d-3fe5ce6e5ef6 tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:06 devstack sudo[106750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3.info Aug 11 04:48:06 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:07 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c3742b3e-faae-4948-910d-3fe5ce6e5ef6 tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3.info" returned: 0 in 0.264s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c3742b3e-faae-4948-910d-3fe5ce6e5ef6 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.110s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:48:07 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-c3742b3e-faae-4948-910d-3fe5ce6e5ef6 tempest-VolumesSnapshotTestJSON-1155347685 None] Create snapshot completed successfully Aug 11 04:48:08 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-be64dd1b-669a-4477-a976-9b90e5fcb9a0 tempest-VolumesSnapshotTestJSON-1155347685 None] Acquiring lock "cinder-3541ee52-8a01-4bcb-911d-e05e95e209e2-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:48:08 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-be64dd1b-669a-4477-a976-9b90e5fcb9a0 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "cinder-3541ee52-8a01-4bcb-911d-e05e95e209e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:48:08 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-be64dd1b-669a-4477-a976-9b90e5fcb9a0 tempest-VolumesSnapshotTestJSON-1155347685 None] Acquiring lock "cinder-quobyte-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:48:08 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-be64dd1b-669a-4477-a976-9b90e5fcb9a0 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "cinder-quobyte-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:48:08 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-be64dd1b-669a-4477-a976-9b90e5fcb9a0 tempest-VolumesSnapshotTestJSON-1155347685 None] Acquiring lock "cinder-quobyte-3541ee52-8a01-4bcb-911d-e05e95e209e2" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:48:08 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-be64dd1b-669a-4477-a976-9b90e5fcb9a0 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "cinder-quobyte-3541ee52-8a01-4bcb-911d-e05e95e209e2" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:48:08 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-be64dd1b-669a-4477-a976-9b90e5fcb9a0 tempest-VolumesSnapshotTestJSON-1155347685 None] Deleting offline snapshot 3541ee52-8a01-4bcb-911d-e05e95e209e2 of volume e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 04:48:08 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-be64dd1b-669a-4477-a976-9b90e5fcb9a0 tempest-VolumesSnapshotTestJSON-1155347685 None] snapshot_file for this snap is: volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3.3541ee52-8a01-4bcb-911d-e05e95e209e2 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 04:48:08 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[5181909f-8c3a-4fc4-ae6f-f2bd26a14031]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:48:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-be64dd1b-669a-4477-a976-9b90e5fcb9a0 tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3.3541ee52-8a01-4bcb-911d-e05e95e209e2 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:08 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3.3541ee52-8a01-4bcb-911d-e05e95e209e2 Aug 11 04:48:08 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:09 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-be64dd1b-669a-4477-a976-9b90e5fcb9a0 tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3.3541ee52-8a01-4bcb-911d-e05e95e209e2" returned: 0 in 0.439s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-be64dd1b-669a-4477-a976-9b90e5fcb9a0 tempest-VolumesSnapshotTestJSON-1155347685 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:48:09 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8410662-f720-481c-8d6d-910318ac9353]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:48:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-be64dd1b-669a-4477-a976-9b90e5fcb9a0 tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:09 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3 Aug 11 04:48:09 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:09 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-be64dd1b-669a-4477-a976-9b90e5fcb9a0 tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3" returned: 0 in 0.492s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-be64dd1b-669a-4477-a976-9b90e5fcb9a0 tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3.3541ee52-8a01-4bcb-911d-e05e95e209e2 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:09 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3.3541ee52-8a01-4bcb-911d-e05e95e209e2 Aug 11 04:48:09 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:10 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-be64dd1b-669a-4477-a976-9b90e5fcb9a0 tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3.3541ee52-8a01-4bcb-911d-e05e95e209e2" returned: 0 in 0.606s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-be64dd1b-669a-4477-a976-9b90e5fcb9a0 tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3.3541ee52-8a01-4bcb-911d-e05e95e209e2 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:10 devstack sudo[106798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3.3541ee52-8a01-4bcb-911d-e05e95e209e2 Aug 11 04:48:10 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:10 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-be64dd1b-669a-4477-a976-9b90e5fcb9a0 tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3.3541ee52-8a01-4bcb-911d-e05e95e209e2" returned: 0 in 0.298s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-be64dd1b-669a-4477-a976-9b90e5fcb9a0 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "cinder-quobyte-3541ee52-8a01-4bcb-911d-e05e95e209e2" released by "_delete_snapshot" :: held 1.991s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:48:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-be64dd1b-669a-4477-a976-9b90e5fcb9a0 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "cinder-quobyte-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3" released by "delete_snapshot" :: held 2.022s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:48:10 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-be64dd1b-669a-4477-a976-9b90e5fcb9a0 tempest-VolumesSnapshotTestJSON-1155347685 None] Created reservations ['463821fa-7174-4451-970d-78c72ab96b31', '0354044b-71a3-439c-9302-6f4d04940ad3', '708b59d6-e907-4d85-9787-445cc5945440', '844c857a-b057-4cba-8954-7c934812e454'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:48:10 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-be64dd1b-669a-4477-a976-9b90e5fcb9a0 tempest-VolumesSnapshotTestJSON-1155347685 None] Delete snapshot completed successfully. Aug 11 04:48:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-be64dd1b-669a-4477-a976-9b90e5fcb9a0 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "cinder-3541ee52-8a01-4bcb-911d-e05e95e209e2-delete_snapshot" released by "delete_snapshot" :: held 2.295s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:48:12 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-37026c92-4c5a-4daf-84b4-2dc142905f7b tempest-VolumesSnapshotTestJSON-1155347685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:48:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-37026c92-4c5a-4daf-84b4-2dc142905f7b tempest-VolumesSnapshotTestJSON-1155347685 None] Flow 'volume_create_manager' (3436c44e-e013-47cf-9f7e-3a77d1b65aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:48:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-37026c92-4c5a-4daf-84b4-2dc142905f7b tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc76e067-742c-4b3e-a8c1-67b51eb225dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:48:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-37026c92-4c5a-4daf-84b4-2dc142905f7b tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc76e067-742c-4b3e-a8c1-67b51eb225dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-115869911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85f391a1-dce6-41ed-9302-46de56c3e677,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f06a3105584cdba4395699869938d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:48:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:48:12Z,use_quota=True,user_id='484120d562854fa3b682753a0d9fd99c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:48:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-37026c92-4c5a-4daf-84b4-2dc142905f7b tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5405a49a-bc61-4bed-a7a6-94fe9a9fe79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:48:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-37026c92-4c5a-4daf-84b4-2dc142905f7b tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5405a49a-bc61-4bed-a7a6-94fe9a9fe79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:48:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-37026c92-4c5a-4daf-84b4-2dc142905f7b tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d020fe39-c6da-408b-9e37-95999160e67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:48:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-37026c92-4c5a-4daf-84b4-2dc142905f7b tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d020fe39-c6da-408b-9e37-95999160e67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85f391a1-dce6-41ed-9302-46de56c3e677', 'volume_name': 'volume-85f391a1-dce6-41ed-9302-46de56c3e677', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:48:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-37026c92-4c5a-4daf-84b4-2dc142905f7b tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e5748c7-d5c9-43c9-b4b4-17074da204b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:48:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-37026c92-4c5a-4daf-84b4-2dc142905f7b tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e5748c7-d5c9-43c9-b4b4-17074da204b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:48:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-37026c92-4c5a-4daf-84b4-2dc142905f7b tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff09651d-0458-46f8-8da0-6baac3bf7fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:48:12 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-37026c92-4c5a-4daf-84b4-2dc142905f7b tempest-VolumesSnapshotTestJSON-1155347685 None] Volume 85f391a1-dce6-41ed-9302-46de56c3e677: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85f391a1-dce6-41ed-9302-46de56c3e677', 'volume_size': 1} Aug 11 04:48:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-37026c92-4c5a-4daf-84b4-2dc142905f7b tempest-VolumesSnapshotTestJSON-1155347685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:48:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-37026c92-4c5a-4daf-84b4-2dc142905f7b tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:48:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-37026c92-4c5a-4daf-84b4-2dc142905f7b tempest-VolumesSnapshotTestJSON-1155347685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-115869911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85f391a1-dce6-41ed-9302-46de56c3e677,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f06a3105584cdba4395699869938d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:48:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:48:12Z,use_quota=True,user_id='484120d562854fa3b682753a0d9fd99c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:48:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-37026c92-4c5a-4daf-84b4-2dc142905f7b tempest-VolumesSnapshotTestJSON-1155347685 None] Creating volume 85f391a1-dce6-41ed-9302-46de56c3e677 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:48:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-37026c92-4c5a-4daf-84b4-2dc142905f7b tempest-VolumesSnapshotTestJSON-1155347685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:48:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-37026c92-4c5a-4daf-84b4-2dc142905f7b tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:48:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-37026c92-4c5a-4daf-84b4-2dc142905f7b tempest-VolumesSnapshotTestJSON-1155347685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:48:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-37026c92-4c5a-4daf-84b4-2dc142905f7b tempest-VolumesSnapshotTestJSON-1155347685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:48:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-37026c92-4c5a-4daf-84b4-2dc142905f7b tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:48:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-37026c92-4c5a-4daf-84b4-2dc142905f7b tempest-VolumesSnapshotTestJSON-1155347685 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:48:12 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-37026c92-4c5a-4daf-84b4-2dc142905f7b tempest-VolumesSnapshotTestJSON-1155347685 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:48:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-37026c92-4c5a-4daf-84b4-2dc142905f7b tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:12 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677 1073741824 Aug 11 04:48:12 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:12 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-37026c92-4c5a-4daf-84b4-2dc142905f7b tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677 1073741824" returned: 0 in 0.427s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-37026c92-4c5a-4daf-84b4-2dc142905f7b tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:13 devstack sudo[106810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677 Aug 11 04:48:13 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:13 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-37026c92-4c5a-4daf-84b4-2dc142905f7b tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677" returned: 0 in 0.317s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-37026c92-4c5a-4daf-84b4-2dc142905f7b tempest-VolumesSnapshotTestJSON-1155347685 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:48:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-37026c92-4c5a-4daf-84b4-2dc142905f7b tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:48:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-37026c92-4c5a-4daf-84b4-2dc142905f7b tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff09651d-0458-46f8-8da0-6baac3bf7fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85f391a1-dce6-41ed-9302-46de56c3e677', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:48:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-37026c92-4c5a-4daf-84b4-2dc142905f7b tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4ba41de-4007-43d3-83b8-e2f05690a42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:48:13 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-37026c92-4c5a-4daf-84b4-2dc142905f7b tempest-VolumesSnapshotTestJSON-1155347685 None] Volume volume-85f391a1-dce6-41ed-9302-46de56c3e677 (85f391a1-dce6-41ed-9302-46de56c3e677): created successfully Aug 11 04:48:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-37026c92-4c5a-4daf-84b4-2dc142905f7b tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4ba41de-4007-43d3-83b8-e2f05690a42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:48:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-37026c92-4c5a-4daf-84b4-2dc142905f7b tempest-VolumesSnapshotTestJSON-1155347685 None] Flow 'volume_create_manager' (3436c44e-e013-47cf-9f7e-3a77d1b65aea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:48:13 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-37026c92-4c5a-4daf-84b4-2dc142905f7b tempest-VolumesSnapshotTestJSON-1155347685 None] Created volume successfully. Aug 11 04:48:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4121211b-3d43-4470-afbc-5f84d9ec6ada tempest-AttachVolumeShelveTestJSON-1872118428 None] Acquiring lock "cinder-55dfffba-d0af-445f-8b11-1155656bb341-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:48:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4121211b-3d43-4470-afbc-5f84d9ec6ada tempest-AttachVolumeShelveTestJSON-1872118428 None] Lock "cinder-55dfffba-d0af-445f-8b11-1155656bb341-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:48:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4121211b-3d43-4470-afbc-5f84d9ec6ada tempest-AttachVolumeShelveTestJSON-1872118428 None] Acquiring lock "cinder-quobyte-55dfffba-d0af-445f-8b11-1155656bb341" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:48:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4121211b-3d43-4470-afbc-5f84d9ec6ada tempest-AttachVolumeShelveTestJSON-1872118428 None] Lock "cinder-quobyte-55dfffba-d0af-445f-8b11-1155656bb341" acquired by "delete_volume" :: waited 0.016s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:48:14 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a036a41-29ed-4c72-aa1c-eeb00e4cf08f]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:48:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4121211b-3d43-4470-afbc-5f84d9ec6ada tempest-AttachVolumeShelveTestJSON-1872118428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-55dfffba-d0af-445f-8b11-1155656bb341 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:14 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-55dfffba-d0af-445f-8b11-1155656bb341 Aug 11 04:48:14 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-23b73904-e0aa-4361-9229-d520360d1338 tempest-VolumesSnapshotTestJSON-1155347685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:48:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-23b73904-e0aa-4361-9229-d520360d1338 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:48:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-23b73904-e0aa-4361-9229-d520360d1338 tempest-VolumesSnapshotTestJSON-1155347685 None] Creating offline snapshot d4741d62-fb4c-4f46-ab8c-fbbf75f1abce of volume 85f391a1-dce6-41ed-9302-46de56c3e677 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 04:48:14 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4121211b-3d43-4470-afbc-5f84d9ec6ada tempest-AttachVolumeShelveTestJSON-1872118428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-55dfffba-d0af-445f-8b11-1155656bb341" returned: 0 in 0.425s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4121211b-3d43-4470-afbc-5f84d9ec6ada tempest-AttachVolumeShelveTestJSON-1872118428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-55dfffba-d0af-445f-8b11-1155656bb341 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:14 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[f165e740-248d-482b-80c4-b8d0abb7aa31]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:48:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-23b73904-e0aa-4361-9229-d520360d1338 tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:14 devstack sudo[106819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-55dfffba-d0af-445f-8b11-1155656bb341 Aug 11 04:48:14 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:14 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677 Aug 11 04:48:14 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:14 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4121211b-3d43-4470-afbc-5f84d9ec6ada tempest-AttachVolumeShelveTestJSON-1872118428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-55dfffba-d0af-445f-8b11-1155656bb341" returned: 0 in 0.270s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4121211b-3d43-4470-afbc-5f84d9ec6ada tempest-AttachVolumeShelveTestJSON-1872118428 None] Lock "cinder-quobyte-55dfffba-d0af-445f-8b11-1155656bb341" released by "delete_volume" :: held 0.752s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:48:15 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-4121211b-3d43-4470-afbc-5f84d9ec6ada tempest-AttachVolumeShelveTestJSON-1872118428 None] Created reservations ['99e8a0a7-76eb-4759-8da7-fd3664e3e9c5', '5df19a46-d0b6-416c-ab6d-8a8de65e49e6', '2455049f-1fbc-4497-8cef-36f59562b8d4', 'b3bd557f-39c0-4810-8e03-c7dbe5414eef'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:48:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4121211b-3d43-4470-afbc-5f84d9ec6ada tempest-AttachVolumeShelveTestJSON-1872118428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:48:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4121211b-3d43-4470-afbc-5f84d9ec6ada tempest-AttachVolumeShelveTestJSON-1872118428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:48:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4121211b-3d43-4470-afbc-5f84d9ec6ada tempest-AttachVolumeShelveTestJSON-1872118428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:48:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4121211b-3d43-4470-afbc-5f84d9ec6ada tempest-AttachVolumeShelveTestJSON-1872118428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:48:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4121211b-3d43-4470-afbc-5f84d9ec6ada tempest-AttachVolumeShelveTestJSON-1872118428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:48:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4121211b-3d43-4470-afbc-5f84d9ec6ada tempest-AttachVolumeShelveTestJSON-1872118428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:15 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-23b73904-e0aa-4361-9229-d520360d1338 tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677" returned: 0 in 0.490s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-23b73904-e0aa-4361-9229-d520360d1338 tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677.d4741d62-fb4c-4f46-ab8c-fbbf75f1abce 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:15 devstack sudo[106863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:48:15 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:15 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677.d4741d62-fb4c-4f46-ab8c-fbbf75f1abce 1G Aug 11 04:48:15 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:15 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4121211b-3d43-4470-afbc-5f84d9ec6ada tempest-AttachVolumeShelveTestJSON-1872118428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.351s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:15 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-4121211b-3d43-4470-afbc-5f84d9ec6ada tempest-AttachVolumeShelveTestJSON-1872118428 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:48:15 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-4121211b-3d43-4470-afbc-5f84d9ec6ada tempest-AttachVolumeShelveTestJSON-1872118428 None] Deleted volume successfully. Aug 11 04:48:15 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4121211b-3d43-4470-afbc-5f84d9ec6ada tempest-AttachVolumeShelveTestJSON-1872118428 None] Lock "cinder-55dfffba-d0af-445f-8b11-1155656bb341-delete_volume" released by "delete_volume" :: held 1.410s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:48:15 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-23b73904-e0aa-4361-9229-d520360d1338 tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677.d4741d62-fb4c-4f46-ab8c-fbbf75f1abce 1G" returned: 0 in 0.590s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-23b73904-e0aa-4361-9229-d520360d1338 tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85f391a1-dce6-41ed-9302-46de56c3e677 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677.d4741d62-fb4c-4f46-ab8c-fbbf75f1abce {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:15 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85f391a1-dce6-41ed-9302-46de56c3e677 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677.d4741d62-fb4c-4f46-ab8c-fbbf75f1abce Aug 11 04:48:15 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:16 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-23b73904-e0aa-4361-9229-d520360d1338 tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85f391a1-dce6-41ed-9302-46de56c3e677 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677.d4741d62-fb4c-4f46-ab8c-fbbf75f1abce" returned: 0 in 0.298s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:16 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-23b73904-e0aa-4361-9229-d520360d1338 tempest-VolumesSnapshotTestJSON-1155347685 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677.d4741d62-fb4c-4f46-ab8c-fbbf75f1abce is being set with open permissions: ugo+rw Aug 11 04:48:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-23b73904-e0aa-4361-9229-d520360d1338 tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677.d4741d62-fb4c-4f46-ab8c-fbbf75f1abce {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:16 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677.d4741d62-fb4c-4f46-ab8c-fbbf75f1abce Aug 11 04:48:16 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:16 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-23b73904-e0aa-4361-9229-d520360d1338 tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677.d4741d62-fb4c-4f46-ab8c-fbbf75f1abce" returned: 0 in 0.279s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-23b73904-e0aa-4361-9229-d520360d1338 tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:16 devstack sudo[106885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677.info Aug 11 04:48:16 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:16 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-23b73904-e0aa-4361-9229-d520360d1338 tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677.info" returned: 0 in 0.271s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:16 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-23b73904-e0aa-4361-9229-d520360d1338 tempest-VolumesSnapshotTestJSON-1155347685 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677.info is being set with open permissions: ugo+rw Aug 11 04:48:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-23b73904-e0aa-4361-9229-d520360d1338 tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:16 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677.info Aug 11 04:48:16 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:16 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-23b73904-e0aa-4361-9229-d520360d1338 tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677.info" returned: 0 in 0.267s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-23b73904-e0aa-4361-9229-d520360d1338 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.327s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:48:17 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-23b73904-e0aa-4361-9229-d520360d1338 tempest-VolumesSnapshotTestJSON-1155347685 None] Create snapshot completed successfully Aug 11 04:48:18 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-536a6f12-1214-4ff1-93f7-501283964a37 tempest-VolumesSnapshotTestJSON-1155347685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:48:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-536a6f12-1214-4ff1-93f7-501283964a37 tempest-VolumesSnapshotTestJSON-1155347685 None] Flow 'volume_create_manager' (cdfefa4a-d7d7-4bbb-8fdb-67904870197f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:48:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-536a6f12-1214-4ff1-93f7-501283964a37 tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9c6c72b-16b2-4ad5-a24a-e60f91abb50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:48:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-536a6f12-1214-4ff1-93f7-501283964a37 tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9c6c72b-16b2-4ad5-a24a-e60f91abb50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:48:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2000389472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3c83415-babe-4049-93fb-1b764d822c4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f06a3105584cdba4395699869938d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:48:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=d4741d62-fb4c-4f46-ab8c-fbbf75f1abce,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:48:18Z,use_quota=True,user_id='484120d562854fa3b682753a0d9fd99c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:48:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-536a6f12-1214-4ff1-93f7-501283964a37 tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b0cbd53-224e-4e12-a8b1-1f4668808c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:48:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-536a6f12-1214-4ff1-93f7-501283964a37 tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b0cbd53-224e-4e12-a8b1-1f4668808c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:48:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-536a6f12-1214-4ff1-93f7-501283964a37 tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d187ce02-0bea-43c0-a413-14753fbb7488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:48:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-536a6f12-1214-4ff1-93f7-501283964a37 tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d187ce02-0bea-43c0-a413-14753fbb7488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f3c83415-babe-4049-93fb-1b764d822c4d', 'volume_name': 'volume-f3c83415-babe-4049-93fb-1b764d822c4d', 'volume_size': 2, 'snapshot_id': 'd4741d62-fb4c-4f46-ab8c-fbbf75f1abce'}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:48:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-536a6f12-1214-4ff1-93f7-501283964a37 tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdd76039-72d7-4f01-8f1d-c50ecd186875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:48:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-536a6f12-1214-4ff1-93f7-501283964a37 tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdd76039-72d7-4f01-8f1d-c50ecd186875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:48:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-536a6f12-1214-4ff1-93f7-501283964a37 tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f0b9f85-0a2a-400a-b163-45cdeab96dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:48:18 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-536a6f12-1214-4ff1-93f7-501283964a37 tempest-VolumesSnapshotTestJSON-1155347685 None] Volume f3c83415-babe-4049-93fb-1b764d822c4d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f3c83415-babe-4049-93fb-1b764d822c4d', 'volume_size': 2, 'snapshot_id': 'd4741d62-fb4c-4f46-ab8c-fbbf75f1abce'} Aug 11 04:48:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-536a6f12-1214-4ff1-93f7-501283964a37 tempest-VolumesSnapshotTestJSON-1155347685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:48:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-536a6f12-1214-4ff1-93f7-501283964a37 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:48:18 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-536a6f12-1214-4ff1-93f7-501283964a37 tempest-VolumesSnapshotTestJSON-1155347685 None] Acquiring lock "cinder-quobyte-d4741d62-fb4c-4f46-ab8c-fbbf75f1abce-f3c83415-babe-4049-93fb-1b764d822c4d" by "_create_volume_from_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:48:18 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-536a6f12-1214-4ff1-93f7-501283964a37 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "cinder-quobyte-d4741d62-fb4c-4f46-ab8c-fbbf75f1abce-f3c83415-babe-4049-93fb-1b764d822c4d" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:48:18 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-536a6f12-1214-4ff1-93f7-501283964a37 tempest-VolumesSnapshotTestJSON-1155347685 None] Creating volume f3c83415-babe-4049-93fb-1b764d822c4d from snapshot d4741d62-fb4c-4f46-ab8c-fbbf75f1abce {{(pid=94472) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 11 04:48:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-536a6f12-1214-4ff1-93f7-501283964a37 tempest-VolumesSnapshotTestJSON-1155347685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:48:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-536a6f12-1214-4ff1-93f7-501283964a37 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:48:18 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-536a6f12-1214-4ff1-93f7-501283964a37 tempest-VolumesSnapshotTestJSON-1155347685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:48:18 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-536a6f12-1214-4ff1-93f7-501283964a37 tempest-VolumesSnapshotTestJSON-1155347685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:48:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-536a6f12-1214-4ff1-93f7-501283964a37 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:48:18 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-536a6f12-1214-4ff1-93f7-501283964a37 tempest-VolumesSnapshotTestJSON-1155347685 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:48:18 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-536a6f12-1214-4ff1-93f7-501283964a37 tempest-VolumesSnapshotTestJSON-1155347685 None] Acquiring lock "cinder-quobyte-f3c83415-babe-4049-93fb-1b764d822c4d" by "_copy_volume_from_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:48:18 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-536a6f12-1214-4ff1-93f7-501283964a37 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "cinder-quobyte-f3c83415-babe-4049-93fb-1b764d822c4d" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:48:18 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-536a6f12-1214-4ff1-93f7-501283964a37 tempest-VolumesSnapshotTestJSON-1155347685 None] snapshot: d4741d62-fb4c-4f46-ab8c-fbbf75f1abce, volume: f3c83415-babe-4049-93fb-1b764d822c4d, {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 11 04:48:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-536a6f12-1214-4ff1-93f7-501283964a37 tempest-VolumesSnapshotTestJSON-1155347685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:48:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-536a6f12-1214-4ff1-93f7-501283964a37 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:48:18 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-536a6f12-1214-4ff1-93f7-501283964a37 tempest-VolumesSnapshotTestJSON-1155347685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:48:18 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-536a6f12-1214-4ff1-93f7-501283964a37 tempest-VolumesSnapshotTestJSON-1155347685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:48:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-536a6f12-1214-4ff1-93f7-501283964a37 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:48:18 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e469b5-cd8f-4b89-86eb-90c6b07de42c]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:48:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-536a6f12-1214-4ff1-93f7-501283964a37 tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677.d4741d62-fb4c-4f46-ab8c-fbbf75f1abce {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:18 devstack sudo[106907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677.d4741d62-fb4c-4f46-ab8c-fbbf75f1abce Aug 11 04:48:18 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:18 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-536a6f12-1214-4ff1-93f7-501283964a37 tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677.d4741d62-fb4c-4f46-ab8c-fbbf75f1abce" returned: 0 in 0.360s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:18 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-536a6f12-1214-4ff1-93f7-501283964a37 tempest-VolumesSnapshotTestJSON-1155347685 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85f391a1-dce6-41ed-9302-46de56c3e677(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:48:18 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7dcfb2-cb27-43ce-860e-8552a00e5389]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:48:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-536a6f12-1214-4ff1-93f7-501283964a37 tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:19 devstack sudo[106912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677 Aug 11 04:48:19 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:19 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-536a6f12-1214-4ff1-93f7-501283964a37 tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677" returned: 0 in 0.454s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-536a6f12-1214-4ff1-93f7-501283964a37 tempest-VolumesSnapshotTestJSON-1155347685 None] will copy from snapshot at /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677 {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 11 04:48:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-536a6f12-1214-4ff1-93f7-501283964a37 tempest-VolumesSnapshotTestJSON-1155347685 None] Creating direct copy from snapshot {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 11 04:48:19 devstack cinder-volume[94472]: DEBUG cinder.utils [None req-536a6f12-1214-4ff1-93f7-501283964a37 tempest-VolumesSnapshotTestJSON-1155347685 None] Path /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f3c83415-babe-4049-93fb-1b764d822c4d not found in is_blk_device check {{(pid=94472) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 11 04:48:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-536a6f12-1214-4ff1-93f7-501283964a37 tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f3c83415-babe-4049-93fb-1b764d822c4d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:19 devstack sudo[106917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f3c83415-babe-4049-93fb-1b764d822c4d Aug 11 04:48:19 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:24 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-536a6f12-1214-4ff1-93f7-501283964a37 tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f3c83415-babe-4049-93fb-1b764d822c4d" returned: 0 in 4.945s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:24 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-536a6f12-1214-4ff1-93f7-501283964a37 tempest-VolumesSnapshotTestJSON-1155347685 None] Image conversion details: src /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677, size 1024.00 MB, duration 4.95 sec, destination /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f3c83415-babe-4049-93fb-1b764d822c4d {{(pid=94472) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 11 04:48:24 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-536a6f12-1214-4ff1-93f7-501283964a37 tempest-VolumesSnapshotTestJSON-1155347685 None] Converted 1024.00 MB image at 207.03 MB/s Aug 11 04:48:24 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-536a6f12-1214-4ff1-93f7-501283964a37 tempest-VolumesSnapshotTestJSON-1155347685 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f3c83415-babe-4049-93fb-1b764d822c4d is being set with open permissions: ugo+rw Aug 11 04:48:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-536a6f12-1214-4ff1-93f7-501283964a37 tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f3c83415-babe-4049-93fb-1b764d822c4d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:24 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f3c83415-babe-4049-93fb-1b764d822c4d Aug 11 04:48:24 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:24 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-536a6f12-1214-4ff1-93f7-501283964a37 tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f3c83415-babe-4049-93fb-1b764d822c4d" returned: 0 in 0.310s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:24 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-536a6f12-1214-4ff1-93f7-501283964a37 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "cinder-quobyte-f3c83415-babe-4049-93fb-1b764d822c4d" released by "_copy_volume_from_snapshot" :: held 6.153s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:48:24 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-536a6f12-1214-4ff1-93f7-501283964a37 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "cinder-quobyte-d4741d62-fb4c-4f46-ab8c-fbbf75f1abce-f3c83415-babe-4049-93fb-1b764d822c4d" released by "_create_volume_from_snapshot" :: held 6.235s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:48:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-536a6f12-1214-4ff1-93f7-501283964a37 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.249s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:48:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-536a6f12-1214-4ff1-93f7-501283964a37 tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f0b9f85-0a2a-400a-b163-45cdeab96dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3c83415-babe-4049-93fb-1b764d822c4d', 'volume_size': 2, 'snapshot_id': 'd4741d62-fb4c-4f46-ab8c-fbbf75f1abce'}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:48:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-536a6f12-1214-4ff1-93f7-501283964a37 tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (304779f5-ce81-47eb-8f56-5dd406b966e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:48:24 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-536a6f12-1214-4ff1-93f7-501283964a37 tempest-VolumesSnapshotTestJSON-1155347685 None] Volume volume-f3c83415-babe-4049-93fb-1b764d822c4d (f3c83415-babe-4049-93fb-1b764d822c4d): created successfully Aug 11 04:48:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-536a6f12-1214-4ff1-93f7-501283964a37 tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (304779f5-ce81-47eb-8f56-5dd406b966e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:48:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-536a6f12-1214-4ff1-93f7-501283964a37 tempest-VolumesSnapshotTestJSON-1155347685 None] Flow 'volume_create_manager' (cdfefa4a-d7d7-4bbb-8fdb-67904870197f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:48:24 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-536a6f12-1214-4ff1-93f7-501283964a37 tempest-VolumesSnapshotTestJSON-1155347685 None] Created volume successfully. Aug 11 04:48:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8f0a6702-ddfe-4a69-8732-8506a96efd36 tempest-VolumesSnapshotTestJSON-1155347685 None] Acquiring lock "cinder-f3c83415-babe-4049-93fb-1b764d822c4d-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:48:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8f0a6702-ddfe-4a69-8732-8506a96efd36 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "cinder-f3c83415-babe-4049-93fb-1b764d822c4d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:48:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8f0a6702-ddfe-4a69-8732-8506a96efd36 tempest-VolumesSnapshotTestJSON-1155347685 None] Acquiring lock "cinder-quobyte-f3c83415-babe-4049-93fb-1b764d822c4d" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:48:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8f0a6702-ddfe-4a69-8732-8506a96efd36 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "cinder-quobyte-f3c83415-babe-4049-93fb-1b764d822c4d" acquired by "delete_volume" :: waited 0.056s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:48:25 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a65648e-46bf-4fc5-b21c-358d624d450e]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:48:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8f0a6702-ddfe-4a69-8732-8506a96efd36 tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f3c83415-babe-4049-93fb-1b764d822c4d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:25 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f3c83415-babe-4049-93fb-1b764d822c4d Aug 11 04:48:25 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:25 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8f0a6702-ddfe-4a69-8732-8506a96efd36 tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f3c83415-babe-4049-93fb-1b764d822c4d" returned: 0 in 0.411s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8f0a6702-ddfe-4a69-8732-8506a96efd36 tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f3c83415-babe-4049-93fb-1b764d822c4d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:25 devstack sudo[106946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f3c83415-babe-4049-93fb-1b764d822c4d Aug 11 04:48:25 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:26 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8f0a6702-ddfe-4a69-8732-8506a96efd36 tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f3c83415-babe-4049-93fb-1b764d822c4d" returned: 0 in 0.284s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:26 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8f0a6702-ddfe-4a69-8732-8506a96efd36 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "cinder-quobyte-f3c83415-babe-4049-93fb-1b764d822c4d" released by "delete_volume" :: held 0.772s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:48:26 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-8f0a6702-ddfe-4a69-8732-8506a96efd36 tempest-VolumesSnapshotTestJSON-1155347685 None] Created reservations ['0e982791-2db6-469d-a1c9-8be7e87643d4', 'e80b9843-b04c-47d9-9370-620f39a46bdf', '570483c8-34e7-4406-8a52-86903f916acd', 'd2aa5663-d64c-4943-a301-179f4f036ef1'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:48:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8f0a6702-ddfe-4a69-8732-8506a96efd36 tempest-VolumesSnapshotTestJSON-1155347685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:48:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8f0a6702-ddfe-4a69-8732-8506a96efd36 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:48:26 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-8f0a6702-ddfe-4a69-8732-8506a96efd36 tempest-VolumesSnapshotTestJSON-1155347685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:48:26 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-8f0a6702-ddfe-4a69-8732-8506a96efd36 tempest-VolumesSnapshotTestJSON-1155347685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:48:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8f0a6702-ddfe-4a69-8732-8506a96efd36 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:48:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8f0a6702-ddfe-4a69-8732-8506a96efd36 tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:26 devstack sudo[106949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:48:26 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:26 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8f0a6702-ddfe-4a69-8732-8506a96efd36 tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.268s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:26 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-8f0a6702-ddfe-4a69-8732-8506a96efd36 tempest-VolumesSnapshotTestJSON-1155347685 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:48:26 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-8f0a6702-ddfe-4a69-8732-8506a96efd36 tempest-VolumesSnapshotTestJSON-1155347685 None] Deleted volume successfully. Aug 11 04:48:26 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8f0a6702-ddfe-4a69-8732-8506a96efd36 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "cinder-f3c83415-babe-4049-93fb-1b764d822c4d-delete_volume" released by "delete_volume" :: held 1.323s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:48:26 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-759d8740-de62-402e-aee9-c3fb418d86ec tempest-VolumesSnapshotTestJSON-1155347685 None] Acquiring lock "cinder-d4741d62-fb4c-4f46-ab8c-fbbf75f1abce-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:48:26 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-759d8740-de62-402e-aee9-c3fb418d86ec tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "cinder-d4741d62-fb4c-4f46-ab8c-fbbf75f1abce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:48:26 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-759d8740-de62-402e-aee9-c3fb418d86ec tempest-VolumesSnapshotTestJSON-1155347685 None] Acquiring lock "cinder-quobyte-85f391a1-dce6-41ed-9302-46de56c3e677" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:48:26 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-759d8740-de62-402e-aee9-c3fb418d86ec tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "cinder-quobyte-85f391a1-dce6-41ed-9302-46de56c3e677" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:48:26 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-759d8740-de62-402e-aee9-c3fb418d86ec tempest-VolumesSnapshotTestJSON-1155347685 None] Acquiring lock "cinder-quobyte-d4741d62-fb4c-4f46-ab8c-fbbf75f1abce" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:48:26 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-759d8740-de62-402e-aee9-c3fb418d86ec tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "cinder-quobyte-d4741d62-fb4c-4f46-ab8c-fbbf75f1abce" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:48:26 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-759d8740-de62-402e-aee9-c3fb418d86ec tempest-VolumesSnapshotTestJSON-1155347685 None] Deleting offline snapshot d4741d62-fb4c-4f46-ab8c-fbbf75f1abce of volume 85f391a1-dce6-41ed-9302-46de56c3e677 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 04:48:26 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-759d8740-de62-402e-aee9-c3fb418d86ec tempest-VolumesSnapshotTestJSON-1155347685 None] snapshot_file for this snap is: volume-85f391a1-dce6-41ed-9302-46de56c3e677.d4741d62-fb4c-4f46-ab8c-fbbf75f1abce {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 04:48:26 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ed022c-e201-4b1f-8029-133301dbe538]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:48:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-759d8740-de62-402e-aee9-c3fb418d86ec tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677.d4741d62-fb4c-4f46-ab8c-fbbf75f1abce {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:26 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677.d4741d62-fb4c-4f46-ab8c-fbbf75f1abce Aug 11 04:48:26 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:27 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-759d8740-de62-402e-aee9-c3fb418d86ec tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677.d4741d62-fb4c-4f46-ab8c-fbbf75f1abce" returned: 0 in 0.367s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-759d8740-de62-402e-aee9-c3fb418d86ec tempest-VolumesSnapshotTestJSON-1155347685 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85f391a1-dce6-41ed-9302-46de56c3e677(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:48:27 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa907dd-e103-418e-8343-4046b368e1a9]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:48:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-759d8740-de62-402e-aee9-c3fb418d86ec tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:27 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677 Aug 11 04:48:27 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:27 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-759d8740-de62-402e-aee9-c3fb418d86ec tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677" returned: 0 in 0.536s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-759d8740-de62-402e-aee9-c3fb418d86ec tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677.d4741d62-fb4c-4f46-ab8c-fbbf75f1abce {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:27 devstack sudo[106962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677.d4741d62-fb4c-4f46-ab8c-fbbf75f1abce Aug 11 04:48:27 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:28 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-759d8740-de62-402e-aee9-c3fb418d86ec tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677.d4741d62-fb4c-4f46-ab8c-fbbf75f1abce" returned: 0 in 0.414s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-759d8740-de62-402e-aee9-c3fb418d86ec tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677.d4741d62-fb4c-4f46-ab8c-fbbf75f1abce {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:28 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677.d4741d62-fb4c-4f46-ab8c-fbbf75f1abce Aug 11 04:48:28 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:28 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-759d8740-de62-402e-aee9-c3fb418d86ec tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677.d4741d62-fb4c-4f46-ab8c-fbbf75f1abce" returned: 0 in 0.272s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:28 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-759d8740-de62-402e-aee9-c3fb418d86ec tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "cinder-quobyte-d4741d62-fb4c-4f46-ab8c-fbbf75f1abce" released by "_delete_snapshot" :: held 1.703s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:48:28 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-759d8740-de62-402e-aee9-c3fb418d86ec tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "cinder-quobyte-85f391a1-dce6-41ed-9302-46de56c3e677" released by "delete_snapshot" :: held 1.732s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:48:28 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-759d8740-de62-402e-aee9-c3fb418d86ec tempest-VolumesSnapshotTestJSON-1155347685 None] Created reservations ['d8a405a9-9225-4095-b4e6-b54399312af0', '8ed19f6e-c4de-4fcf-94df-e362d881244e', '7318d590-ee44-46fb-8a15-c2f39f98e718', '69cbfe90-56ee-41a0-a5d0-ee70f7020723'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:48:28 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-759d8740-de62-402e-aee9-c3fb418d86ec tempest-VolumesSnapshotTestJSON-1155347685 None] Delete snapshot completed successfully. Aug 11 04:48:28 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-759d8740-de62-402e-aee9-c3fb418d86ec tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "cinder-d4741d62-fb4c-4f46-ab8c-fbbf75f1abce-delete_snapshot" released by "delete_snapshot" :: held 1.886s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:48:28 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9317e405-f938-4438-8c24-1f19a6c507b5 tempest-VolumesSnapshotTestJSON-1155347685 None] Acquiring lock "cinder-85f391a1-dce6-41ed-9302-46de56c3e677-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:48:28 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9317e405-f938-4438-8c24-1f19a6c507b5 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "cinder-85f391a1-dce6-41ed-9302-46de56c3e677-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:48:29 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9317e405-f938-4438-8c24-1f19a6c507b5 tempest-VolumesSnapshotTestJSON-1155347685 None] Acquiring lock "cinder-quobyte-85f391a1-dce6-41ed-9302-46de56c3e677" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:48:29 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9317e405-f938-4438-8c24-1f19a6c507b5 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "cinder-quobyte-85f391a1-dce6-41ed-9302-46de56c3e677" acquired by "delete_volume" :: waited 0.021s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:48:29 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eee8d67-8b4a-4773-82d8-6f6455fdbe89]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:48:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9317e405-f938-4438-8c24-1f19a6c507b5 tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:29 devstack sudo[106976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677 Aug 11 04:48:29 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:29 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9317e405-f938-4438-8c24-1f19a6c507b5 tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677" returned: 0 in 0.483s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9317e405-f938-4438-8c24-1f19a6c507b5 tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:29 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677 Aug 11 04:48:29 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-a0c57932-8e5a-409b-b46f-7822363785b1 req-157dd4d3-29f4-41c1-a127-e0c3cfb9e210 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:48:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-a0c57932-8e5a-409b-b46f-7822363785b1 req-157dd4d3-29f4-41c1-a127-e0c3cfb9e210 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:48:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-a0c57932-8e5a-409b-b46f-7822363785b1 req-157dd4d3-29f4-41c1-a127-e0c3cfb9e210 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:48:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-a0c57932-8e5a-409b-b46f-7822363785b1 req-157dd4d3-29f4-41c1-a127-e0c3cfb9e210 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd', 'name': 'volume-71509722-97fa-4c59-8307-b98af3e1011b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bc010066-bccb-432d-b8d0-8f982dcb3dd9', 'enforce_multipath': True} {{(pid=94472) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 11 04:48:29 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-a0c57932-8e5a-409b-b46f-7822363785b1 req-157dd4d3-29f4-41c1-a127-e0c3cfb9e210 tempest-TestServerVolumeAttachmentScenario-1192690184 None] attachment_update completed successfully. Aug 11 04:48:29 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9317e405-f938-4438-8c24-1f19a6c507b5 tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-85f391a1-dce6-41ed-9302-46de56c3e677" returned: 0 in 0.332s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:29 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9317e405-f938-4438-8c24-1f19a6c507b5 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "cinder-quobyte-85f391a1-dce6-41ed-9302-46de56c3e677" released by "delete_volume" :: held 0.936s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:48:30 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-9317e405-f938-4438-8c24-1f19a6c507b5 tempest-VolumesSnapshotTestJSON-1155347685 None] Created reservations ['dc7a2673-60f5-4265-ac71-e477250ba5df', 'd7e351d4-304c-42b4-a785-a97df7fe1f2d', 'b2793230-32a8-480e-8495-7527555bd5c1', '4e0b6885-ef3a-4b4d-bb40-6df211fd5a5b'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:48:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9317e405-f938-4438-8c24-1f19a6c507b5 tempest-VolumesSnapshotTestJSON-1155347685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:48:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9317e405-f938-4438-8c24-1f19a6c507b5 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:48:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9317e405-f938-4438-8c24-1f19a6c507b5 tempest-VolumesSnapshotTestJSON-1155347685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:48:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9317e405-f938-4438-8c24-1f19a6c507b5 tempest-VolumesSnapshotTestJSON-1155347685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:48:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9317e405-f938-4438-8c24-1f19a6c507b5 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:48:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9317e405-f938-4438-8c24-1f19a6c507b5 tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:30 devstack sudo[107134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:48:30 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:30 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9317e405-f938-4438-8c24-1f19a6c507b5 tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.288s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:30 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-9317e405-f938-4438-8c24-1f19a6c507b5 tempest-VolumesSnapshotTestJSON-1155347685 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:48:30 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-9317e405-f938-4438-8c24-1f19a6c507b5 tempest-VolumesSnapshotTestJSON-1155347685 None] Deleted volume successfully. Aug 11 04:48:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9317e405-f938-4438-8c24-1f19a6c507b5 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "cinder-85f391a1-dce6-41ed-9302-46de56c3e677-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:48:31 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ffab2a1-1042-4309-94b5-b9fc8e73e1ca tempest-VolumesSnapshotTestJSON-1155347685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:48:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0ffab2a1-1042-4309-94b5-b9fc8e73e1ca tempest-VolumesSnapshotTestJSON-1155347685 None] Flow 'volume_create_manager' (94b07bac-bffd-4457-a91d-684b655ece9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:48:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0ffab2a1-1042-4309-94b5-b9fc8e73e1ca tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c26923a1-75b4-4fbd-8092-311e37221605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:48:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0ffab2a1-1042-4309-94b5-b9fc8e73e1ca tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c26923a1-75b4-4fbd-8092-311e37221605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:48:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1670607523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=495c7865-c724-4038-a605-f0b0ec1ba864,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f06a3105584cdba4395699869938d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:48:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:48:32Z,use_quota=True,user_id='484120d562854fa3b682753a0d9fd99c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:48:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0ffab2a1-1042-4309-94b5-b9fc8e73e1ca tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b789ee8-3ea9-4a6b-9a06-c93095a1e70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:48:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0ffab2a1-1042-4309-94b5-b9fc8e73e1ca tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b789ee8-3ea9-4a6b-9a06-c93095a1e70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:48:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0ffab2a1-1042-4309-94b5-b9fc8e73e1ca tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd6c5c91-caf4-4caa-bc6b-f2fd1d6d8445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:48:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0ffab2a1-1042-4309-94b5-b9fc8e73e1ca tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd6c5c91-caf4-4caa-bc6b-f2fd1d6d8445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '495c7865-c724-4038-a605-f0b0ec1ba864', 'volume_name': 'volume-495c7865-c724-4038-a605-f0b0ec1ba864', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:48:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0ffab2a1-1042-4309-94b5-b9fc8e73e1ca tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd344c18-b392-43a8-8f1d-88ea50125641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:48:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0ffab2a1-1042-4309-94b5-b9fc8e73e1ca tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd344c18-b392-43a8-8f1d-88ea50125641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:48:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0ffab2a1-1042-4309-94b5-b9fc8e73e1ca tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce33331b-9847-43ac-9d22-a6c3d895e87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:48:32 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-0ffab2a1-1042-4309-94b5-b9fc8e73e1ca tempest-VolumesSnapshotTestJSON-1155347685 None] Volume 495c7865-c724-4038-a605-f0b0ec1ba864: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-495c7865-c724-4038-a605-f0b0ec1ba864', 'volume_size': 1} Aug 11 04:48:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0ffab2a1-1042-4309-94b5-b9fc8e73e1ca tempest-VolumesSnapshotTestJSON-1155347685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:48:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0ffab2a1-1042-4309-94b5-b9fc8e73e1ca tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:48:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0ffab2a1-1042-4309-94b5-b9fc8e73e1ca tempest-VolumesSnapshotTestJSON-1155347685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:48:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1670607523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=495c7865-c724-4038-a605-f0b0ec1ba864,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f06a3105584cdba4395699869938d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:48:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:48:32Z,use_quota=True,user_id='484120d562854fa3b682753a0d9fd99c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:48:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-0ffab2a1-1042-4309-94b5-b9fc8e73e1ca tempest-VolumesSnapshotTestJSON-1155347685 None] Creating volume 495c7865-c724-4038-a605-f0b0ec1ba864 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:48:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0ffab2a1-1042-4309-94b5-b9fc8e73e1ca tempest-VolumesSnapshotTestJSON-1155347685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:48:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0ffab2a1-1042-4309-94b5-b9fc8e73e1ca tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:48:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0ffab2a1-1042-4309-94b5-b9fc8e73e1ca tempest-VolumesSnapshotTestJSON-1155347685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:48:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0ffab2a1-1042-4309-94b5-b9fc8e73e1ca tempest-VolumesSnapshotTestJSON-1155347685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:48:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0ffab2a1-1042-4309-94b5-b9fc8e73e1ca tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:48:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0ffab2a1-1042-4309-94b5-b9fc8e73e1ca tempest-VolumesSnapshotTestJSON-1155347685 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:48:32 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-0ffab2a1-1042-4309-94b5-b9fc8e73e1ca tempest-VolumesSnapshotTestJSON-1155347685 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:48:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0ffab2a1-1042-4309-94b5-b9fc8e73e1ca tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:32 devstack sudo[107383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864 1073741824 Aug 11 04:48:32 devstack sudo[107383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:32 devstack sudo[107383]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0ffab2a1-1042-4309-94b5-b9fc8e73e1ca tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864 1073741824" returned: 0 in 0.522s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0ffab2a1-1042-4309-94b5-b9fc8e73e1ca tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:32 devstack sudo[107389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864 Aug 11 04:48:32 devstack sudo[107389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:32 devstack sudo[107389]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0ffab2a1-1042-4309-94b5-b9fc8e73e1ca tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864" returned: 0 in 0.315s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0ffab2a1-1042-4309-94b5-b9fc8e73e1ca tempest-VolumesSnapshotTestJSON-1155347685 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:48:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0ffab2a1-1042-4309-94b5-b9fc8e73e1ca tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:48:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0ffab2a1-1042-4309-94b5-b9fc8e73e1ca tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce33331b-9847-43ac-9d22-a6c3d895e87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-495c7865-c724-4038-a605-f0b0ec1ba864', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:48:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0ffab2a1-1042-4309-94b5-b9fc8e73e1ca tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc09d5d4-d54b-4733-a679-a793ca5d7a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:48:32 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-0ffab2a1-1042-4309-94b5-b9fc8e73e1ca tempest-VolumesSnapshotTestJSON-1155347685 None] Volume volume-495c7865-c724-4038-a605-f0b0ec1ba864 (495c7865-c724-4038-a605-f0b0ec1ba864): created successfully Aug 11 04:48:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0ffab2a1-1042-4309-94b5-b9fc8e73e1ca tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc09d5d4-d54b-4733-a679-a793ca5d7a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:48:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0ffab2a1-1042-4309-94b5-b9fc8e73e1ca tempest-VolumesSnapshotTestJSON-1155347685 None] Flow 'volume_create_manager' (94b07bac-bffd-4457-a91d-684b655ece9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:48:33 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-0ffab2a1-1042-4309-94b5-b9fc8e73e1ca tempest-VolumesSnapshotTestJSON-1155347685 None] Created volume successfully. Aug 11 04:48:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-61ac3bc2-5e54-4feb-9c0b-848dae719048 tempest-VolumesSnapshotTestJSON-1155347685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:48:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-61ac3bc2-5e54-4feb-9c0b-848dae719048 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:48:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-61ac3bc2-5e54-4feb-9c0b-848dae719048 tempest-VolumesSnapshotTestJSON-1155347685 None] Creating offline snapshot f793fdeb-a37f-400b-aa12-d8addc893229 of volume 495c7865-c724-4038-a605-f0b0ec1ba864 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 04:48:34 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef4f63c-168b-4288-a546-683ec2092e5d]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:48:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-61ac3bc2-5e54-4feb-9c0b-848dae719048 tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:34 devstack sudo[107393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864 Aug 11 04:48:34 devstack sudo[107393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:34 devstack sudo[107393]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-61ac3bc2-5e54-4feb-9c0b-848dae719048 tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864" returned: 0 in 0.396s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-61ac3bc2-5e54-4feb-9c0b-848dae719048 tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864.f793fdeb-a37f-400b-aa12-d8addc893229 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:34 devstack sudo[107401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864.f793fdeb-a37f-400b-aa12-d8addc893229 1G Aug 11 04:48:34 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:35 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-61ac3bc2-5e54-4feb-9c0b-848dae719048 tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864.f793fdeb-a37f-400b-aa12-d8addc893229 1G" returned: 0 in 0.500s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-61ac3bc2-5e54-4feb-9c0b-848dae719048 tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-495c7865-c724-4038-a605-f0b0ec1ba864 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864.f793fdeb-a37f-400b-aa12-d8addc893229 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:35 devstack sudo[107407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-495c7865-c724-4038-a605-f0b0ec1ba864 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864.f793fdeb-a37f-400b-aa12-d8addc893229 Aug 11 04:48:35 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:35 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-61ac3bc2-5e54-4feb-9c0b-848dae719048 tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-495c7865-c724-4038-a605-f0b0ec1ba864 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864.f793fdeb-a37f-400b-aa12-d8addc893229" returned: 0 in 0.374s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:35 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-61ac3bc2-5e54-4feb-9c0b-848dae719048 tempest-VolumesSnapshotTestJSON-1155347685 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864.f793fdeb-a37f-400b-aa12-d8addc893229 is being set with open permissions: ugo+rw Aug 11 04:48:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-61ac3bc2-5e54-4feb-9c0b-848dae719048 tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864.f793fdeb-a37f-400b-aa12-d8addc893229 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-e8122d5d-adde-4f33-bd22-f60e6d126df5 req-b85de23e-ac5e-493d-a567-6f17cc037e71 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:48:35 devstack sudo[107420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864.f793fdeb-a37f-400b-aa12-d8addc893229 Aug 11 04:48:35 devstack sudo[107420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:35 devstack sudo[107420]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-61ac3bc2-5e54-4feb-9c0b-848dae719048 tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864.f793fdeb-a37f-400b-aa12-d8addc893229" returned: 0 in 0.278s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-61ac3bc2-5e54-4feb-9c0b-848dae719048 tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:35 devstack sudo[107423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864.info Aug 11 04:48:35 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:36 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-61ac3bc2-5e54-4feb-9c0b-848dae719048 tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864.info" returned: 0 in 0.251s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:36 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-61ac3bc2-5e54-4feb-9c0b-848dae719048 tempest-VolumesSnapshotTestJSON-1155347685 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864.info is being set with open permissions: ugo+rw Aug 11 04:48:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-61ac3bc2-5e54-4feb-9c0b-848dae719048 tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:36 devstack sudo[107426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864.info Aug 11 04:48:36 devstack sudo[107426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:36 devstack sudo[107426]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-61ac3bc2-5e54-4feb-9c0b-848dae719048 tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864.info" returned: 0 in 0.265s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-61ac3bc2-5e54-4feb-9c0b-848dae719048 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.166s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:48:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-e8122d5d-adde-4f33-bd22-f60e6d126df5 req-b85de23e-ac5e-493d-a567-6f17cc037e71 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.820s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:48:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-e8122d5d-adde-4f33-bd22-f60e6d126df5 req-b85de23e-ac5e-493d-a567-6f17cc037e71 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:48:36 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-61ac3bc2-5e54-4feb-9c0b-848dae719048 tempest-VolumesSnapshotTestJSON-1155347685 None] Create snapshot completed successfully Aug 11 04:48:36 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-e8122d5d-adde-4f33-bd22-f60e6d126df5 req-b85de23e-ac5e-493d-a567-6f17cc037e71 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd', 'name': 'volume-91f3d2e6-433f-49b9-8e67-be6727223eb3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8522f2f8-6694-4e14-a991-3d7b589ea4fa', 'enforce_multipath': True} {{(pid=94472) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 11 04:48:36 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-e8122d5d-adde-4f33-bd22-f60e6d126df5 req-b85de23e-ac5e-493d-a567-6f17cc037e71 tempest-TestServerVolumeAttachmentScenario-1192690184 None] attachment_update completed successfully. Aug 11 04:48:38 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-b418ab45-48de-4ba5-8893-b4cd9d28b69e tempest-VolumesSnapshotTestJSON-1155347685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:48:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b418ab45-48de-4ba5-8893-b4cd9d28b69e tempest-VolumesSnapshotTestJSON-1155347685 None] Flow 'volume_create_manager' (2ae96f14-16f5-48ab-a974-0ed150d6cfad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:48:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b418ab45-48de-4ba5-8893-b4cd9d28b69e tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a292e50-cd5e-44c0-8bd7-8372b1a7e06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:48:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b418ab45-48de-4ba5-8893-b4cd9d28b69e tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a292e50-cd5e-44c0-8bd7-8372b1a7e06e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:48:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-656809920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e80c26b8-3e52-472b-a549-32fcb0ad0190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f06a3105584cdba4395699869938d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:48:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f793fdeb-a37f-400b-aa12-d8addc893229,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:48:38Z,use_quota=True,user_id='484120d562854fa3b682753a0d9fd99c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:48:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b418ab45-48de-4ba5-8893-b4cd9d28b69e tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f90db0f3-99b4-4570-9072-ee3ca1405da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:48:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b418ab45-48de-4ba5-8893-b4cd9d28b69e tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f90db0f3-99b4-4570-9072-ee3ca1405da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:48:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b418ab45-48de-4ba5-8893-b4cd9d28b69e tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17466467-e7ec-43b9-bdd0-521a926bf802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:48:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b418ab45-48de-4ba5-8893-b4cd9d28b69e tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17466467-e7ec-43b9-bdd0-521a926bf802) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e80c26b8-3e52-472b-a549-32fcb0ad0190', 'volume_name': 'volume-e80c26b8-3e52-472b-a549-32fcb0ad0190', 'volume_size': 1, 'snapshot_id': 'f793fdeb-a37f-400b-aa12-d8addc893229'}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:48:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b418ab45-48de-4ba5-8893-b4cd9d28b69e tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41b7374a-c082-4066-93ab-dbe70db468d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:48:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b418ab45-48de-4ba5-8893-b4cd9d28b69e tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41b7374a-c082-4066-93ab-dbe70db468d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:48:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b418ab45-48de-4ba5-8893-b4cd9d28b69e tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47a1b8b0-95fc-4544-8698-bf42f944cbf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:48:38 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-b418ab45-48de-4ba5-8893-b4cd9d28b69e tempest-VolumesSnapshotTestJSON-1155347685 None] Volume e80c26b8-3e52-472b-a549-32fcb0ad0190: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e80c26b8-3e52-472b-a549-32fcb0ad0190', 'volume_size': 1, 'snapshot_id': 'f793fdeb-a37f-400b-aa12-d8addc893229'} Aug 11 04:48:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b418ab45-48de-4ba5-8893-b4cd9d28b69e tempest-VolumesSnapshotTestJSON-1155347685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:48:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b418ab45-48de-4ba5-8893-b4cd9d28b69e tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:48:38 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b418ab45-48de-4ba5-8893-b4cd9d28b69e tempest-VolumesSnapshotTestJSON-1155347685 None] Acquiring lock "cinder-quobyte-f793fdeb-a37f-400b-aa12-d8addc893229-e80c26b8-3e52-472b-a549-32fcb0ad0190" by "_create_volume_from_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:48:38 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b418ab45-48de-4ba5-8893-b4cd9d28b69e tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "cinder-quobyte-f793fdeb-a37f-400b-aa12-d8addc893229-e80c26b8-3e52-472b-a549-32fcb0ad0190" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:48:38 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b418ab45-48de-4ba5-8893-b4cd9d28b69e tempest-VolumesSnapshotTestJSON-1155347685 None] Creating volume e80c26b8-3e52-472b-a549-32fcb0ad0190 from snapshot f793fdeb-a37f-400b-aa12-d8addc893229 {{(pid=94472) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 11 04:48:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b418ab45-48de-4ba5-8893-b4cd9d28b69e tempest-VolumesSnapshotTestJSON-1155347685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:48:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b418ab45-48de-4ba5-8893-b4cd9d28b69e tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:48:38 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b418ab45-48de-4ba5-8893-b4cd9d28b69e tempest-VolumesSnapshotTestJSON-1155347685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:48:38 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b418ab45-48de-4ba5-8893-b4cd9d28b69e tempest-VolumesSnapshotTestJSON-1155347685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:48:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b418ab45-48de-4ba5-8893-b4cd9d28b69e tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:48:38 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b418ab45-48de-4ba5-8893-b4cd9d28b69e tempest-VolumesSnapshotTestJSON-1155347685 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:48:38 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b418ab45-48de-4ba5-8893-b4cd9d28b69e tempest-VolumesSnapshotTestJSON-1155347685 None] Acquiring lock "cinder-quobyte-e80c26b8-3e52-472b-a549-32fcb0ad0190" by "_copy_volume_from_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:48:38 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b418ab45-48de-4ba5-8893-b4cd9d28b69e tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "cinder-quobyte-e80c26b8-3e52-472b-a549-32fcb0ad0190" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:48:38 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b418ab45-48de-4ba5-8893-b4cd9d28b69e tempest-VolumesSnapshotTestJSON-1155347685 None] snapshot: f793fdeb-a37f-400b-aa12-d8addc893229, volume: e80c26b8-3e52-472b-a549-32fcb0ad0190, {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 11 04:48:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b418ab45-48de-4ba5-8893-b4cd9d28b69e tempest-VolumesSnapshotTestJSON-1155347685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:48:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b418ab45-48de-4ba5-8893-b4cd9d28b69e tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:48:38 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b418ab45-48de-4ba5-8893-b4cd9d28b69e tempest-VolumesSnapshotTestJSON-1155347685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:48:38 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b418ab45-48de-4ba5-8893-b4cd9d28b69e tempest-VolumesSnapshotTestJSON-1155347685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:48:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b418ab45-48de-4ba5-8893-b4cd9d28b69e tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:48:38 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80132c8-c30f-4eb7-96c3-7cc91ba114dc]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:48:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b418ab45-48de-4ba5-8893-b4cd9d28b69e tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864.f793fdeb-a37f-400b-aa12-d8addc893229 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:38 devstack sudo[107440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864.f793fdeb-a37f-400b-aa12-d8addc893229 Aug 11 04:48:38 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:38 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-75e98fa1-2b01-42b5-b948-9e6b425e40ea req-c076ccfb-c9ab-4174-967b-37ac6df0ecc3 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Terminate volume connection completed successfully. Aug 11 04:48:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-75e98fa1-2b01-42b5-b948-9e6b425e40ea req-c076ccfb-c9ab-4174-967b-37ac6df0ecc3 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Deleting attachment 8522f2f8-6694-4e14-a991-3d7b589ea4fa. {{(pid=94472) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 11 04:48:38 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b418ab45-48de-4ba5-8893-b4cd9d28b69e tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864.f793fdeb-a37f-400b-aa12-d8addc893229" returned: 0 in 0.437s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:38 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-b418ab45-48de-4ba5-8893-b4cd9d28b69e tempest-VolumesSnapshotTestJSON-1155347685 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-495c7865-c724-4038-a605-f0b0ec1ba864(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:48:38 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca621b85-5465-4ebb-be4b-74dc0dba4194]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:48:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b418ab45-48de-4ba5-8893-b4cd9d28b69e tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:38 devstack sudo[107448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864 Aug 11 04:48:38 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:39 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b418ab45-48de-4ba5-8893-b4cd9d28b69e tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864" returned: 0 in 0.436s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b418ab45-48de-4ba5-8893-b4cd9d28b69e tempest-VolumesSnapshotTestJSON-1155347685 None] will copy from snapshot at /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864 {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 11 04:48:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b418ab45-48de-4ba5-8893-b4cd9d28b69e tempest-VolumesSnapshotTestJSON-1155347685 None] Creating direct copy from snapshot {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 11 04:48:39 devstack cinder-volume[94472]: DEBUG cinder.utils [None req-b418ab45-48de-4ba5-8893-b4cd9d28b69e tempest-VolumesSnapshotTestJSON-1155347685 None] Path /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e80c26b8-3e52-472b-a549-32fcb0ad0190 not found in is_blk_device check {{(pid=94472) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 11 04:48:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b418ab45-48de-4ba5-8893-b4cd9d28b69e tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e80c26b8-3e52-472b-a549-32fcb0ad0190 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:39 devstack sudo[107453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e80c26b8-3e52-472b-a549-32fcb0ad0190 Aug 11 04:48:39 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:40 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-63ea3f67-6122-4f70-82f1-c687e600a274 req-6cacf8c9-a5d6-443c-a964-4cdeb98c40d5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Terminate volume connection completed successfully. Aug 11 04:48:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-63ea3f67-6122-4f70-82f1-c687e600a274 req-6cacf8c9-a5d6-443c-a964-4cdeb98c40d5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Deleting attachment bc010066-bccb-432d-b8d0-8f982dcb3dd9. {{(pid=94472) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 11 04:48:45 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b418ab45-48de-4ba5-8893-b4cd9d28b69e tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e80c26b8-3e52-472b-a549-32fcb0ad0190" returned: 0 in 6.372s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:45 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-b418ab45-48de-4ba5-8893-b4cd9d28b69e tempest-VolumesSnapshotTestJSON-1155347685 None] Image conversion details: src /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864, size 1024.00 MB, duration 6.37 sec, destination /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e80c26b8-3e52-472b-a549-32fcb0ad0190 {{(pid=94472) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 11 04:48:45 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-b418ab45-48de-4ba5-8893-b4cd9d28b69e tempest-VolumesSnapshotTestJSON-1155347685 None] Converted 1024.00 MB image at 160.67 MB/s Aug 11 04:48:45 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-b418ab45-48de-4ba5-8893-b4cd9d28b69e tempest-VolumesSnapshotTestJSON-1155347685 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e80c26b8-3e52-472b-a549-32fcb0ad0190 is being set with open permissions: ugo+rw Aug 11 04:48:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b418ab45-48de-4ba5-8893-b4cd9d28b69e tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e80c26b8-3e52-472b-a549-32fcb0ad0190 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:45 devstack sudo[107540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e80c26b8-3e52-472b-a549-32fcb0ad0190 Aug 11 04:48:45 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:45 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b418ab45-48de-4ba5-8893-b4cd9d28b69e tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e80c26b8-3e52-472b-a549-32fcb0ad0190" returned: 0 in 0.362s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:45 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b418ab45-48de-4ba5-8893-b4cd9d28b69e tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "cinder-quobyte-e80c26b8-3e52-472b-a549-32fcb0ad0190" released by "_copy_volume_from_snapshot" :: held 7.736s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:48:46 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b418ab45-48de-4ba5-8893-b4cd9d28b69e tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "cinder-quobyte-f793fdeb-a37f-400b-aa12-d8addc893229-e80c26b8-3e52-472b-a549-32fcb0ad0190" released by "_create_volume_from_snapshot" :: held 7.880s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:48:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b418ab45-48de-4ba5-8893-b4cd9d28b69e tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.896s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:48:46 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b418ab45-48de-4ba5-8893-b4cd9d28b69e tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47a1b8b0-95fc-4544-8698-bf42f944cbf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e80c26b8-3e52-472b-a549-32fcb0ad0190', 'volume_size': 1, 'snapshot_id': 'f793fdeb-a37f-400b-aa12-d8addc893229'}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:48:46 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b418ab45-48de-4ba5-8893-b4cd9d28b69e tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (212c4868-8dc6-4bdb-b92c-25db0e6cbe4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:48:46 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-b418ab45-48de-4ba5-8893-b4cd9d28b69e tempest-VolumesSnapshotTestJSON-1155347685 None] Volume volume-e80c26b8-3e52-472b-a549-32fcb0ad0190 (e80c26b8-3e52-472b-a549-32fcb0ad0190): created successfully Aug 11 04:48:46 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b418ab45-48de-4ba5-8893-b4cd9d28b69e tempest-VolumesSnapshotTestJSON-1155347685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (212c4868-8dc6-4bdb-b92c-25db0e6cbe4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:48:46 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b418ab45-48de-4ba5-8893-b4cd9d28b69e tempest-VolumesSnapshotTestJSON-1155347685 None] Flow 'volume_create_manager' (2ae96f14-16f5-48ab-a974-0ed150d6cfad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:48:46 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-b418ab45-48de-4ba5-8893-b4cd9d28b69e tempest-VolumesSnapshotTestJSON-1155347685 None] Created volume successfully. Aug 11 04:48:47 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f683f2c1-c0f1-40e3-9631-d965a1c4f0c1 tempest-VolumesSnapshotTestJSON-1155347685 None] Acquiring lock "cinder-e80c26b8-3e52-472b-a549-32fcb0ad0190-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:48:47 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f683f2c1-c0f1-40e3-9631-d965a1c4f0c1 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "cinder-e80c26b8-3e52-472b-a549-32fcb0ad0190-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:48:47 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f683f2c1-c0f1-40e3-9631-d965a1c4f0c1 tempest-VolumesSnapshotTestJSON-1155347685 None] Acquiring lock "cinder-quobyte-e80c26b8-3e52-472b-a549-32fcb0ad0190" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:48:47 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f683f2c1-c0f1-40e3-9631-d965a1c4f0c1 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "cinder-quobyte-e80c26b8-3e52-472b-a549-32fcb0ad0190" acquired by "delete_volume" :: waited 0.020s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:48:47 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50fc5fc-a10e-46ca-aadb-6f0ec4bfce6a]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:48:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f683f2c1-c0f1-40e3-9631-d965a1c4f0c1 tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e80c26b8-3e52-472b-a549-32fcb0ad0190 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:47 devstack sudo[107610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e80c26b8-3e52-472b-a549-32fcb0ad0190 Aug 11 04:48:47 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:47 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f683f2c1-c0f1-40e3-9631-d965a1c4f0c1 tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e80c26b8-3e52-472b-a549-32fcb0ad0190" returned: 0 in 0.477s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f683f2c1-c0f1-40e3-9631-d965a1c4f0c1 tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e80c26b8-3e52-472b-a549-32fcb0ad0190 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:47 devstack sudo[107631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e80c26b8-3e52-472b-a549-32fcb0ad0190 Aug 11 04:48:47 devstack sudo[107631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:48 devstack sudo[107631]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f683f2c1-c0f1-40e3-9631-d965a1c4f0c1 tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e80c26b8-3e52-472b-a549-32fcb0ad0190" returned: 0 in 0.283s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:48 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f683f2c1-c0f1-40e3-9631-d965a1c4f0c1 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "cinder-quobyte-e80c26b8-3e52-472b-a549-32fcb0ad0190" released by "delete_volume" :: held 0.832s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:48:48 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-f683f2c1-c0f1-40e3-9631-d965a1c4f0c1 tempest-VolumesSnapshotTestJSON-1155347685 None] Created reservations ['33f5e102-4d9d-48a8-b396-59f2c7f4b7d4', 'de2beeb3-27d3-4661-9252-fa0ef1d3c359', '9a285bef-2f97-48dc-8c30-5b9e2cc98207', '8578587f-51ac-49d6-9882-8544afe0fba0'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:48:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f683f2c1-c0f1-40e3-9631-d965a1c4f0c1 tempest-VolumesSnapshotTestJSON-1155347685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:48:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f683f2c1-c0f1-40e3-9631-d965a1c4f0c1 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:48:48 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f683f2c1-c0f1-40e3-9631-d965a1c4f0c1 tempest-VolumesSnapshotTestJSON-1155347685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:48:48 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f683f2c1-c0f1-40e3-9631-d965a1c4f0c1 tempest-VolumesSnapshotTestJSON-1155347685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:48:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f683f2c1-c0f1-40e3-9631-d965a1c4f0c1 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:48:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f683f2c1-c0f1-40e3-9631-d965a1c4f0c1 tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:48 devstack sudo[107634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:48:48 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:48 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-787d8d37-bf44-4ba2-9138-4dc8b410e6b6 tempest-VolumesSnapshotTestJSON-1155347685 None] Acquiring lock "cinder-f793fdeb-a37f-400b-aa12-d8addc893229-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:48:48 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-787d8d37-bf44-4ba2-9138-4dc8b410e6b6 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "cinder-f793fdeb-a37f-400b-aa12-d8addc893229-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:48:48 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-787d8d37-bf44-4ba2-9138-4dc8b410e6b6 tempest-VolumesSnapshotTestJSON-1155347685 None] Acquiring lock "cinder-quobyte-495c7865-c724-4038-a605-f0b0ec1ba864" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:48:48 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-787d8d37-bf44-4ba2-9138-4dc8b410e6b6 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "cinder-quobyte-495c7865-c724-4038-a605-f0b0ec1ba864" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:48:48 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-787d8d37-bf44-4ba2-9138-4dc8b410e6b6 tempest-VolumesSnapshotTestJSON-1155347685 None] Acquiring lock "cinder-quobyte-f793fdeb-a37f-400b-aa12-d8addc893229" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:48:48 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-787d8d37-bf44-4ba2-9138-4dc8b410e6b6 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "cinder-quobyte-f793fdeb-a37f-400b-aa12-d8addc893229" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:48:48 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-787d8d37-bf44-4ba2-9138-4dc8b410e6b6 tempest-VolumesSnapshotTestJSON-1155347685 None] Deleting offline snapshot f793fdeb-a37f-400b-aa12-d8addc893229 of volume 495c7865-c724-4038-a605-f0b0ec1ba864 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 04:48:48 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-787d8d37-bf44-4ba2-9138-4dc8b410e6b6 tempest-VolumesSnapshotTestJSON-1155347685 None] snapshot_file for this snap is: volume-495c7865-c724-4038-a605-f0b0ec1ba864.f793fdeb-a37f-400b-aa12-d8addc893229 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 04:48:48 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb126fd-87d1-4ddc-bde2-8d7937b60a22]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:48:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-787d8d37-bf44-4ba2-9138-4dc8b410e6b6 tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864.f793fdeb-a37f-400b-aa12-d8addc893229 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:48 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f683f2c1-c0f1-40e3-9631-d965a1c4f0c1 tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.300s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:48 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-f683f2c1-c0f1-40e3-9631-d965a1c4f0c1 tempest-VolumesSnapshotTestJSON-1155347685 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:48:48 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-f683f2c1-c0f1-40e3-9631-d965a1c4f0c1 tempest-VolumesSnapshotTestJSON-1155347685 None] Deleted volume successfully. Aug 11 04:48:48 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f683f2c1-c0f1-40e3-9631-d965a1c4f0c1 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "cinder-e80c26b8-3e52-472b-a549-32fcb0ad0190-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:48:48 devstack sudo[107637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864.f793fdeb-a37f-400b-aa12-d8addc893229 Aug 11 04:48:48 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:49 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-787d8d37-bf44-4ba2-9138-4dc8b410e6b6 tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864.f793fdeb-a37f-400b-aa12-d8addc893229" returned: 0 in 0.593s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:49 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-787d8d37-bf44-4ba2-9138-4dc8b410e6b6 tempest-VolumesSnapshotTestJSON-1155347685 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-495c7865-c724-4038-a605-f0b0ec1ba864(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:48:49 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf18917-0c36-465f-8dc8-00607cf898bb]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:48:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-787d8d37-bf44-4ba2-9138-4dc8b410e6b6 tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:49 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-311b8d6b-2ff0-43e7-a249-fb6081d9b5b5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Acquiring lock "cinder-91f3d2e6-433f-49b9-8e67-be6727223eb3-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:48:49 devstack sudo[107644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864 Aug 11 04:48:49 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-311b8d6b-2ff0-43e7-a249-fb6081d9b5b5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Lock "cinder-91f3d2e6-433f-49b9-8e67-be6727223eb3-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:48:49 devstack sudo[107644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:49 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-311b8d6b-2ff0-43e7-a249-fb6081d9b5b5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Acquiring lock "cinder-quobyte-91f3d2e6-433f-49b9-8e67-be6727223eb3" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:48:49 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-311b8d6b-2ff0-43e7-a249-fb6081d9b5b5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Lock "cinder-quobyte-91f3d2e6-433f-49b9-8e67-be6727223eb3" acquired by "delete_volume" :: waited 0.021s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:48:49 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca9db76-41ca-463f-887d-3080456c7e02]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:48:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-311b8d6b-2ff0-43e7-a249-fb6081d9b5b5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-91f3d2e6-433f-49b9-8e67-be6727223eb3 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:49 devstack sudo[107646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-91f3d2e6-433f-49b9-8e67-be6727223eb3 Aug 11 04:48:49 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:49 devstack sudo[107644]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-787d8d37-bf44-4ba2-9138-4dc8b410e6b6 tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864" returned: 0 in 0.642s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-787d8d37-bf44-4ba2-9138-4dc8b410e6b6 tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864.f793fdeb-a37f-400b-aa12-d8addc893229 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:49 devstack sudo[107654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864.f793fdeb-a37f-400b-aa12-d8addc893229 Aug 11 04:48:49 devstack sudo[107654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:50 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-311b8d6b-2ff0-43e7-a249-fb6081d9b5b5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-91f3d2e6-433f-49b9-8e67-be6727223eb3" returned: 0 in 0.411s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-311b8d6b-2ff0-43e7-a249-fb6081d9b5b5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-91f3d2e6-433f-49b9-8e67-be6727223eb3 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:50 devstack sudo[107656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-91f3d2e6-433f-49b9-8e67-be6727223eb3 Aug 11 04:48:50 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:50 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-311b8d6b-2ff0-43e7-a249-fb6081d9b5b5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-91f3d2e6-433f-49b9-8e67-be6727223eb3" returned: 0 in 0.296s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:50 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-311b8d6b-2ff0-43e7-a249-fb6081d9b5b5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Lock "cinder-quobyte-91f3d2e6-433f-49b9-8e67-be6727223eb3" released by "delete_volume" :: held 0.751s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:48:50 devstack sudo[107654]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-787d8d37-bf44-4ba2-9138-4dc8b410e6b6 tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864.f793fdeb-a37f-400b-aa12-d8addc893229" returned: 0 in 0.419s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-787d8d37-bf44-4ba2-9138-4dc8b410e6b6 tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864.f793fdeb-a37f-400b-aa12-d8addc893229 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:50 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-311b8d6b-2ff0-43e7-a249-fb6081d9b5b5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Created reservations ['78c2236d-ad81-459d-aea8-86b4e277b059', 'e4acf630-e33f-4528-bad3-d7288f6dab90', '897c9015-379a-4641-8947-678476ff1166', '7a780146-e87d-4082-bede-ea5ce976146d'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:48:50 devstack sudo[107663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864.f793fdeb-a37f-400b-aa12-d8addc893229 Aug 11 04:48:50 devstack sudo[107663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-311b8d6b-2ff0-43e7-a249-fb6081d9b5b5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:48:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-311b8d6b-2ff0-43e7-a249-fb6081d9b5b5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:48:50 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-311b8d6b-2ff0-43e7-a249-fb6081d9b5b5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:48:50 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-311b8d6b-2ff0-43e7-a249-fb6081d9b5b5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:48:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-311b8d6b-2ff0-43e7-a249-fb6081d9b5b5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:48:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-311b8d6b-2ff0-43e7-a249-fb6081d9b5b5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:50 devstack sudo[107665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:48:50 devstack sudo[107665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:50 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b165a356-0c4f-4bd6-bf07-03c0447fdb91 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Acquiring lock "cinder-71509722-97fa-4c59-8307-b98af3e1011b-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:48:50 devstack sudo[107663]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:50 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b165a356-0c4f-4bd6-bf07-03c0447fdb91 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Lock "cinder-71509722-97fa-4c59-8307-b98af3e1011b-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:48:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-787d8d37-bf44-4ba2-9138-4dc8b410e6b6 tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864.f793fdeb-a37f-400b-aa12-d8addc893229" returned: 0 in 0.427s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:50 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-787d8d37-bf44-4ba2-9138-4dc8b410e6b6 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "cinder-quobyte-f793fdeb-a37f-400b-aa12-d8addc893229" released by "_delete_snapshot" :: held 2.253s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:48:50 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b165a356-0c4f-4bd6-bf07-03c0447fdb91 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Acquiring lock "cinder-quobyte-71509722-97fa-4c59-8307-b98af3e1011b" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:48:50 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-787d8d37-bf44-4ba2-9138-4dc8b410e6b6 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "cinder-quobyte-495c7865-c724-4038-a605-f0b0ec1ba864" released by "delete_snapshot" :: held 2.306s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:48:50 devstack sudo[107665]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:50 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b165a356-0c4f-4bd6-bf07-03c0447fdb91 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Lock "cinder-quobyte-71509722-97fa-4c59-8307-b98af3e1011b" acquired by "delete_volume" :: waited 0.038s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:48:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-311b8d6b-2ff0-43e7-a249-fb6081d9b5b5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.452s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:50 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-311b8d6b-2ff0-43e7-a249-fb6081d9b5b5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:48:50 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-311b8d6b-2ff0-43e7-a249-fb6081d9b5b5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Deleted volume successfully. Aug 11 04:48:50 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[627b180b-853a-4125-94a8-c9116393066c]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:48:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b165a356-0c4f-4bd6-bf07-03c0447fdb91 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-71509722-97fa-4c59-8307-b98af3e1011b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:51 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-311b8d6b-2ff0-43e7-a249-fb6081d9b5b5 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Lock "cinder-91f3d2e6-433f-49b9-8e67-be6727223eb3-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:48:51 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-787d8d37-bf44-4ba2-9138-4dc8b410e6b6 tempest-VolumesSnapshotTestJSON-1155347685 None] Created reservations ['16c73bc1-7998-4b65-b46e-d7fb41782bec', 'c97118b2-1a26-4543-b378-d939240d4660', '34e163f1-dc74-4629-b108-f744d08cda2c', '703747e2-9b24-4e20-bebd-b8409689c157'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:48:51 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-787d8d37-bf44-4ba2-9138-4dc8b410e6b6 tempest-VolumesSnapshotTestJSON-1155347685 None] Delete snapshot completed successfully. Aug 11 04:48:51 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-787d8d37-bf44-4ba2-9138-4dc8b410e6b6 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "cinder-f793fdeb-a37f-400b-aa12-d8addc893229-delete_snapshot" released by "delete_snapshot" :: held 2.554s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:48:51 devstack sudo[107669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-71509722-97fa-4c59-8307-b98af3e1011b Aug 11 04:48:51 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:51 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b165a356-0c4f-4bd6-bf07-03c0447fdb91 tempest-TestServerVolumeAttachmentScenario-1192690184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-71509722-97fa-4c59-8307-b98af3e1011b" returned: 0 in 0.456s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b165a356-0c4f-4bd6-bf07-03c0447fdb91 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-71509722-97fa-4c59-8307-b98af3e1011b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:51 devstack sudo[107675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-71509722-97fa-4c59-8307-b98af3e1011b Aug 11 04:48:51 devstack sudo[107675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:51 devstack sudo[107675]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b165a356-0c4f-4bd6-bf07-03c0447fdb91 tempest-TestServerVolumeAttachmentScenario-1192690184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-71509722-97fa-4c59-8307-b98af3e1011b" returned: 0 in 0.296s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:51 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b165a356-0c4f-4bd6-bf07-03c0447fdb91 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Lock "cinder-quobyte-71509722-97fa-4c59-8307-b98af3e1011b" released by "delete_volume" :: held 0.818s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:48:51 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-b165a356-0c4f-4bd6-bf07-03c0447fdb91 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Created reservations ['a22a7341-ed42-4020-a8cb-fe9f4fa66a8d', 'e7b482ea-b24d-4d92-a5bf-9d1ebaaff981', '99ef6599-3245-4571-b39d-3f28cfc8d693', '760a9576-128b-48a1-bb2b-c23b1062c41a'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:48:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b165a356-0c4f-4bd6-bf07-03c0447fdb91 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:48:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b165a356-0c4f-4bd6-bf07-03c0447fdb91 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:48:51 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b165a356-0c4f-4bd6-bf07-03c0447fdb91 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:48:51 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b165a356-0c4f-4bd6-bf07-03c0447fdb91 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:48:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b165a356-0c4f-4bd6-bf07-03c0447fdb91 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:48:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b165a356-0c4f-4bd6-bf07-03c0447fdb91 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:51 devstack sudo[107679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:48:51 devstack sudo[107679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:51 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-90e5a280-0932-4834-90e8-6a2918d5617b tempest-VolumesSnapshotTestJSON-1155347685 None] Acquiring lock "cinder-495c7865-c724-4038-a605-f0b0ec1ba864-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:48:52 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-90e5a280-0932-4834-90e8-6a2918d5617b tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "cinder-495c7865-c724-4038-a605-f0b0ec1ba864-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:48:52 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-90e5a280-0932-4834-90e8-6a2918d5617b tempest-VolumesSnapshotTestJSON-1155347685 None] Acquiring lock "cinder-quobyte-495c7865-c724-4038-a605-f0b0ec1ba864" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:48:52 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-90e5a280-0932-4834-90e8-6a2918d5617b tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "cinder-quobyte-495c7865-c724-4038-a605-f0b0ec1ba864" acquired by "delete_volume" :: waited 0.024s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:48:52 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59c97f2-de19-4e36-8b13-f7cb3b2332db]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:48:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-90e5a280-0932-4834-90e8-6a2918d5617b tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:52 devstack sudo[107681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864 Aug 11 04:48:52 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:52 devstack sudo[107679]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b165a356-0c4f-4bd6-bf07-03c0447fdb91 tempest-TestServerVolumeAttachmentScenario-1192690184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.550s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:52 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-b165a356-0c4f-4bd6-bf07-03c0447fdb91 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:48:52 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-b165a356-0c4f-4bd6-bf07-03c0447fdb91 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Deleted volume successfully. Aug 11 04:48:52 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b165a356-0c4f-4bd6-bf07-03c0447fdb91 tempest-TestServerVolumeAttachmentScenario-1192690184 None] Lock "cinder-71509722-97fa-4c59-8307-b98af3e1011b-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:48:52 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-90e5a280-0932-4834-90e8-6a2918d5617b tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864" returned: 0 in 0.602s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-90e5a280-0932-4834-90e8-6a2918d5617b tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:52 devstack sudo[107688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864 Aug 11 04:48:52 devstack sudo[107688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:53 devstack sudo[107688]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-90e5a280-0932-4834-90e8-6a2918d5617b tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-495c7865-c724-4038-a605-f0b0ec1ba864" returned: 0 in 0.383s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:53 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-90e5a280-0932-4834-90e8-6a2918d5617b tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "cinder-quobyte-495c7865-c724-4038-a605-f0b0ec1ba864" released by "delete_volume" :: held 1.094s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:48:53 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=107,cinder:UPDATE=86,cinder:DELETE=12,cinder:INSERT=23 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:48:53 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:UPDATE=103,cinder:SELECT=88,cinder:INSERT=23,cinder:DELETE=4 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:48:53 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-90e5a280-0932-4834-90e8-6a2918d5617b tempest-VolumesSnapshotTestJSON-1155347685 None] Created reservations ['7670b93e-86ab-4101-b045-732a6c492beb', 'c75a4cb1-b547-42f0-8385-1b01e6f0cbfb', '7df9e158-eab8-46ce-87ab-c985f6378f1f', '9b78f049-fccc-4200-96b5-96002baa9134'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:48:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-90e5a280-0932-4834-90e8-6a2918d5617b tempest-VolumesSnapshotTestJSON-1155347685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:48:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-90e5a280-0932-4834-90e8-6a2918d5617b tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:48:53 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-90e5a280-0932-4834-90e8-6a2918d5617b tempest-VolumesSnapshotTestJSON-1155347685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:48:53 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-90e5a280-0932-4834-90e8-6a2918d5617b tempest-VolumesSnapshotTestJSON-1155347685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:48:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-90e5a280-0932-4834-90e8-6a2918d5617b tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:48:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-90e5a280-0932-4834-90e8-6a2918d5617b tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:53 devstack sudo[107692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:48:53 devstack sudo[107692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:53 devstack sudo[107692]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-90e5a280-0932-4834-90e8-6a2918d5617b tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.334s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:53 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-90e5a280-0932-4834-90e8-6a2918d5617b tempest-VolumesSnapshotTestJSON-1155347685 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:48:53 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-90e5a280-0932-4834-90e8-6a2918d5617b tempest-VolumesSnapshotTestJSON-1155347685 None] Deleted volume successfully. Aug 11 04:48:53 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-90e5a280-0932-4834-90e8-6a2918d5617b tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "cinder-495c7865-c724-4038-a605-f0b0ec1ba864-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:48:54 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-76c71009-2b91-4e41-8190-589ca14e1106 tempest-VolumesSnapshotTestJSON-1155347685 None] Acquiring lock "cinder-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:48:54 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-76c71009-2b91-4e41-8190-589ca14e1106 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "cinder-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:48:54 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-76c71009-2b91-4e41-8190-589ca14e1106 tempest-VolumesSnapshotTestJSON-1155347685 None] Acquiring lock "cinder-quobyte-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:48:54 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-76c71009-2b91-4e41-8190-589ca14e1106 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "cinder-quobyte-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3" acquired by "delete_volume" :: waited 0.030s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:48:54 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7a36b1-0689-4006-a669-8dd9b5c1b3dd]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:48:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-76c71009-2b91-4e41-8190-589ca14e1106 tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:54 devstack sudo[107705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3 Aug 11 04:48:54 devstack sudo[107705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:54 devstack sudo[107705]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-76c71009-2b91-4e41-8190-589ca14e1106 tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3" returned: 0 in 0.384s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-76c71009-2b91-4e41-8190-589ca14e1106 tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:55 devstack sudo[107711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3 Aug 11 04:48:55 devstack sudo[107711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:55 devstack sudo[107711]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-76c71009-2b91-4e41-8190-589ca14e1106 tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3" returned: 0 in 0.318s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:55 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-76c71009-2b91-4e41-8190-589ca14e1106 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "cinder-quobyte-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3" released by "delete_volume" :: held 0.769s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:48:55 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-76c71009-2b91-4e41-8190-589ca14e1106 tempest-VolumesSnapshotTestJSON-1155347685 None] Created reservations ['e1d34612-9138-46ac-9750-fbb10bd0873f', '729ce701-5900-458d-8091-63eae2fba649', 'b7656545-fa4e-47c4-a23b-681a658f62ae', '22df6613-f3a3-43ae-bf00-0958206205f9'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:48:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-76c71009-2b91-4e41-8190-589ca14e1106 tempest-VolumesSnapshotTestJSON-1155347685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:48:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-76c71009-2b91-4e41-8190-589ca14e1106 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:48:55 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-76c71009-2b91-4e41-8190-589ca14e1106 tempest-VolumesSnapshotTestJSON-1155347685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:48:55 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-76c71009-2b91-4e41-8190-589ca14e1106 tempest-VolumesSnapshotTestJSON-1155347685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:48:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-76c71009-2b91-4e41-8190-589ca14e1106 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:48:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-76c71009-2b91-4e41-8190-589ca14e1106 tempest-VolumesSnapshotTestJSON-1155347685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:48:55 devstack sudo[107714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:48:55 devstack sudo[107714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:48:55 devstack sudo[107714]: pam_unix(sudo:session): session closed for user root Aug 11 04:48:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-76c71009-2b91-4e41-8190-589ca14e1106 tempest-VolumesSnapshotTestJSON-1155347685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.275s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:48:55 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-76c71009-2b91-4e41-8190-589ca14e1106 tempest-VolumesSnapshotTestJSON-1155347685 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:48:55 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-76c71009-2b91-4e41-8190-589ca14e1106 tempest-VolumesSnapshotTestJSON-1155347685 None] Deleted volume successfully. Aug 11 04:48:55 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-76c71009-2b91-4e41-8190-589ca14e1106 tempest-VolumesSnapshotTestJSON-1155347685 None] Lock "cinder-e0d18b9d-31e2-423c-87c2-70b0d9e7bdb3-delete_volume" released by "delete_volume" :: held 1.273s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:48:58 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running periodic task VolumeManager._thread_info {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 04:48:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] thread count: 28 {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 11 04:48:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] thread info: [<_MainThread(MainThread, started 133315846115456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 11 04:49:03 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-46555920-720c-49e5-8bcc-070817526d58 tempest-VolumesSnapshotListTestJSON-1215637245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:49:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-46555920-720c-49e5-8bcc-070817526d58 tempest-VolumesSnapshotListTestJSON-1215637245 None] Flow 'volume_create_manager' (475ffcd6-e85b-448f-b7c4-4d4777c0ccae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:49:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-46555920-720c-49e5-8bcc-070817526d58 tempest-VolumesSnapshotListTestJSON-1215637245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b940ff57-bcd4-40ef-988e-e8a251ffb96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:49:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-46555920-720c-49e5-8bcc-070817526d58 tempest-VolumesSnapshotListTestJSON-1215637245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b940ff57-bcd4-40ef-988e-e8a251ffb96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:49:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1430601884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=886ca293-ed1b-48f4-b119-25dca904f852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59a2a1e50cbe43f7b7bc121336f4b19d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:49:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:49:04Z,use_quota=True,user_id='b048de962c6a4f7695f4b5b1071cb1d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:49:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-46555920-720c-49e5-8bcc-070817526d58 tempest-VolumesSnapshotListTestJSON-1215637245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (230d7394-2a88-4512-8b51-1244c8b088b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:49:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-46555920-720c-49e5-8bcc-070817526d58 tempest-VolumesSnapshotListTestJSON-1215637245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (230d7394-2a88-4512-8b51-1244c8b088b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:49:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-46555920-720c-49e5-8bcc-070817526d58 tempest-VolumesSnapshotListTestJSON-1215637245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1477d861-d1a6-4b76-a9b6-f82f3c870ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:49:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-46555920-720c-49e5-8bcc-070817526d58 tempest-VolumesSnapshotListTestJSON-1215637245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1477d861-d1a6-4b76-a9b6-f82f3c870ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '886ca293-ed1b-48f4-b119-25dca904f852', 'volume_name': 'volume-886ca293-ed1b-48f4-b119-25dca904f852', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:49:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-46555920-720c-49e5-8bcc-070817526d58 tempest-VolumesSnapshotListTestJSON-1215637245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ab0dee3-30a7-4254-bdf2-34f8faa7de74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:49:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-46555920-720c-49e5-8bcc-070817526d58 tempest-VolumesSnapshotListTestJSON-1215637245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ab0dee3-30a7-4254-bdf2-34f8faa7de74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:49:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-46555920-720c-49e5-8bcc-070817526d58 tempest-VolumesSnapshotListTestJSON-1215637245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (330ee7ee-1d52-4df6-a545-3e73209fb79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:49:03 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-46555920-720c-49e5-8bcc-070817526d58 tempest-VolumesSnapshotListTestJSON-1215637245 None] Volume 886ca293-ed1b-48f4-b119-25dca904f852: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-886ca293-ed1b-48f4-b119-25dca904f852', 'volume_size': 1} Aug 11 04:49:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-46555920-720c-49e5-8bcc-070817526d58 tempest-VolumesSnapshotListTestJSON-1215637245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:49:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-46555920-720c-49e5-8bcc-070817526d58 tempest-VolumesSnapshotListTestJSON-1215637245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:49:03 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-46555920-720c-49e5-8bcc-070817526d58 tempest-VolumesSnapshotListTestJSON-1215637245 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:49:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1430601884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=886ca293-ed1b-48f4-b119-25dca904f852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59a2a1e50cbe43f7b7bc121336f4b19d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:49:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:49:04Z,use_quota=True,user_id='b048de962c6a4f7695f4b5b1071cb1d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:49:03 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-46555920-720c-49e5-8bcc-070817526d58 tempest-VolumesSnapshotListTestJSON-1215637245 None] Creating volume 886ca293-ed1b-48f4-b119-25dca904f852 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:49:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-46555920-720c-49e5-8bcc-070817526d58 tempest-VolumesSnapshotListTestJSON-1215637245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:49:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-46555920-720c-49e5-8bcc-070817526d58 tempest-VolumesSnapshotListTestJSON-1215637245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:49:03 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-46555920-720c-49e5-8bcc-070817526d58 tempest-VolumesSnapshotListTestJSON-1215637245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:49:03 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-46555920-720c-49e5-8bcc-070817526d58 tempest-VolumesSnapshotListTestJSON-1215637245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:49:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-46555920-720c-49e5-8bcc-070817526d58 tempest-VolumesSnapshotListTestJSON-1215637245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:49:03 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-46555920-720c-49e5-8bcc-070817526d58 tempest-VolumesSnapshotListTestJSON-1215637245 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:49:03 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-46555920-720c-49e5-8bcc-070817526d58 tempest-VolumesSnapshotListTestJSON-1215637245 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:49:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-46555920-720c-49e5-8bcc-070817526d58 tempest-VolumesSnapshotListTestJSON-1215637245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:49:03 devstack sudo[107744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852 1073741824 Aug 11 04:49:03 devstack sudo[107744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:49:04 devstack sudo[107744]: pam_unix(sudo:session): session closed for user root Aug 11 04:49:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-46555920-720c-49e5-8bcc-070817526d58 tempest-VolumesSnapshotListTestJSON-1215637245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852 1073741824" returned: 0 in 0.462s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:49:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-46555920-720c-49e5-8bcc-070817526d58 tempest-VolumesSnapshotListTestJSON-1215637245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:49:04 devstack sudo[107750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852 Aug 11 04:49:04 devstack sudo[107750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:49:04 devstack sudo[107750]: pam_unix(sudo:session): session closed for user root Aug 11 04:49:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-46555920-720c-49e5-8bcc-070817526d58 tempest-VolumesSnapshotListTestJSON-1215637245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852" returned: 0 in 0.268s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:49:04 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-46555920-720c-49e5-8bcc-070817526d58 tempest-VolumesSnapshotListTestJSON-1215637245 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:49:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-46555920-720c-49e5-8bcc-070817526d58 tempest-VolumesSnapshotListTestJSON-1215637245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:49:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-46555920-720c-49e5-8bcc-070817526d58 tempest-VolumesSnapshotListTestJSON-1215637245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (330ee7ee-1d52-4df6-a545-3e73209fb79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-886ca293-ed1b-48f4-b119-25dca904f852', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:49:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-46555920-720c-49e5-8bcc-070817526d58 tempest-VolumesSnapshotListTestJSON-1215637245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f5d6014-ad42-4700-9d31-bda17e49afc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:49:04 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-46555920-720c-49e5-8bcc-070817526d58 tempest-VolumesSnapshotListTestJSON-1215637245 None] Volume volume-886ca293-ed1b-48f4-b119-25dca904f852 (886ca293-ed1b-48f4-b119-25dca904f852): created successfully Aug 11 04:49:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-46555920-720c-49e5-8bcc-070817526d58 tempest-VolumesSnapshotListTestJSON-1215637245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f5d6014-ad42-4700-9d31-bda17e49afc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:49:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-46555920-720c-49e5-8bcc-070817526d58 tempest-VolumesSnapshotListTestJSON-1215637245 None] Flow 'volume_create_manager' (475ffcd6-e85b-448f-b7c4-4d4777c0ccae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:49:04 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-46555920-720c-49e5-8bcc-070817526d58 tempest-VolumesSnapshotListTestJSON-1215637245 None] Created volume successfully. Aug 11 04:49:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c68e83ad-11d0-41f0-8def-3e2f03b1509a tempest-VolumesSnapshotListTestJSON-1215637245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:49:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c68e83ad-11d0-41f0-8def-3e2f03b1509a tempest-VolumesSnapshotListTestJSON-1215637245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:49:06 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-c68e83ad-11d0-41f0-8def-3e2f03b1509a tempest-VolumesSnapshotListTestJSON-1215637245 None] Creating offline snapshot 8a04d140-8ce6-4a7c-941c-7d416e64bd21 of volume 886ca293-ed1b-48f4-b119-25dca904f852 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 04:49:06 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b538baf-b164-49ea-a1c2-b954c1dae2fa]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:49:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c68e83ad-11d0-41f0-8def-3e2f03b1509a tempest-VolumesSnapshotListTestJSON-1215637245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:49:06 devstack sudo[107753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852 Aug 11 04:49:06 devstack sudo[107753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:49:06 devstack sudo[107753]: pam_unix(sudo:session): session closed for user root Aug 11 04:49:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c68e83ad-11d0-41f0-8def-3e2f03b1509a tempest-VolumesSnapshotListTestJSON-1215637245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852" returned: 0 in 0.422s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:49:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c68e83ad-11d0-41f0-8def-3e2f03b1509a tempest-VolumesSnapshotListTestJSON-1215637245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.8a04d140-8ce6-4a7c-941c-7d416e64bd21 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:49:06 devstack sudo[107758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.8a04d140-8ce6-4a7c-941c-7d416e64bd21 1G Aug 11 04:49:06 devstack sudo[107758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:49:06 devstack sudo[107758]: pam_unix(sudo:session): session closed for user root Aug 11 04:49:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c68e83ad-11d0-41f0-8def-3e2f03b1509a tempest-VolumesSnapshotListTestJSON-1215637245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.8a04d140-8ce6-4a7c-941c-7d416e64bd21 1G" returned: 0 in 0.394s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:49:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c68e83ad-11d0-41f0-8def-3e2f03b1509a tempest-VolumesSnapshotListTestJSON-1215637245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-886ca293-ed1b-48f4-b119-25dca904f852 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.8a04d140-8ce6-4a7c-941c-7d416e64bd21 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:49:06 devstack sudo[107764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-886ca293-ed1b-48f4-b119-25dca904f852 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.8a04d140-8ce6-4a7c-941c-7d416e64bd21 Aug 11 04:49:06 devstack sudo[107764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:49:07 devstack sudo[107764]: pam_unix(sudo:session): session closed for user root Aug 11 04:49:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c68e83ad-11d0-41f0-8def-3e2f03b1509a tempest-VolumesSnapshotListTestJSON-1215637245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-886ca293-ed1b-48f4-b119-25dca904f852 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.8a04d140-8ce6-4a7c-941c-7d416e64bd21" returned: 0 in 0.298s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:49:07 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-c68e83ad-11d0-41f0-8def-3e2f03b1509a tempest-VolumesSnapshotListTestJSON-1215637245 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.8a04d140-8ce6-4a7c-941c-7d416e64bd21 is being set with open permissions: ugo+rw Aug 11 04:49:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c68e83ad-11d0-41f0-8def-3e2f03b1509a tempest-VolumesSnapshotListTestJSON-1215637245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.8a04d140-8ce6-4a7c-941c-7d416e64bd21 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:49:07 devstack sudo[107770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.8a04d140-8ce6-4a7c-941c-7d416e64bd21 Aug 11 04:49:07 devstack sudo[107770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:49:07 devstack sudo[107770]: pam_unix(sudo:session): session closed for user root Aug 11 04:49:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c68e83ad-11d0-41f0-8def-3e2f03b1509a tempest-VolumesSnapshotListTestJSON-1215637245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.8a04d140-8ce6-4a7c-941c-7d416e64bd21" returned: 0 in 0.279s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:49:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c68e83ad-11d0-41f0-8def-3e2f03b1509a tempest-VolumesSnapshotListTestJSON-1215637245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:49:07 devstack sudo[107773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.info Aug 11 04:49:07 devstack sudo[107773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:49:07 devstack sudo[107773]: pam_unix(sudo:session): session closed for user root Aug 11 04:49:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c68e83ad-11d0-41f0-8def-3e2f03b1509a tempest-VolumesSnapshotListTestJSON-1215637245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.info" returned: 0 in 0.299s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:49:07 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-c68e83ad-11d0-41f0-8def-3e2f03b1509a tempest-VolumesSnapshotListTestJSON-1215637245 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.info is being set with open permissions: ugo+rw Aug 11 04:49:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c68e83ad-11d0-41f0-8def-3e2f03b1509a tempest-VolumesSnapshotListTestJSON-1215637245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:49:07 devstack sudo[107776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.info Aug 11 04:49:07 devstack sudo[107776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:49:08 devstack sudo[107776]: pam_unix(sudo:session): session closed for user root Aug 11 04:49:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c68e83ad-11d0-41f0-8def-3e2f03b1509a tempest-VolumesSnapshotListTestJSON-1215637245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.info" returned: 0 in 0.263s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:49:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c68e83ad-11d0-41f0-8def-3e2f03b1509a tempest-VolumesSnapshotListTestJSON-1215637245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.086s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:49:08 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-c68e83ad-11d0-41f0-8def-3e2f03b1509a tempest-VolumesSnapshotListTestJSON-1215637245 None] Create snapshot completed successfully Aug 11 04:49:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-cf4386d5-e714-4241-b8fb-e9a84cde5ab5 tempest-VolumesSnapshotListTestJSON-1215637245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:49:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-cf4386d5-e714-4241-b8fb-e9a84cde5ab5 tempest-VolumesSnapshotListTestJSON-1215637245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:49:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-cf4386d5-e714-4241-b8fb-e9a84cde5ab5 tempest-VolumesSnapshotListTestJSON-1215637245 None] Creating offline snapshot 265234e6-ee00-4b8e-afb1-0f168fe7fc4e of volume 886ca293-ed1b-48f4-b119-25dca904f852 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 04:49:09 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f1e31b-ea06-4747-b446-94aa8326b565]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:49:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cf4386d5-e714-4241-b8fb-e9a84cde5ab5 tempest-VolumesSnapshotListTestJSON-1215637245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.8a04d140-8ce6-4a7c-941c-7d416e64bd21 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:49:09 devstack sudo[107779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.8a04d140-8ce6-4a7c-941c-7d416e64bd21 Aug 11 04:49:09 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:49:09 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root Aug 11 04:49:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cf4386d5-e714-4241-b8fb-e9a84cde5ab5 tempest-VolumesSnapshotListTestJSON-1215637245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.8a04d140-8ce6-4a7c-941c-7d416e64bd21" returned: 0 in 0.455s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:49:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-cf4386d5-e714-4241-b8fb-e9a84cde5ab5 tempest-VolumesSnapshotListTestJSON-1215637245 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-886ca293-ed1b-48f4-b119-25dca904f852(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:49:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cf4386d5-e714-4241-b8fb-e9a84cde5ab5 tempest-VolumesSnapshotListTestJSON-1215637245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.8a04d140-8ce6-4a7c-941c-7d416e64bd21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.265234e6-ee00-4b8e-afb1-0f168fe7fc4e 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:49:09 devstack sudo[107784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.8a04d140-8ce6-4a7c-941c-7d416e64bd21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.265234e6-ee00-4b8e-afb1-0f168fe7fc4e 1G Aug 11 04:49:09 devstack sudo[107784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:49:10 devstack sudo[107784]: pam_unix(sudo:session): session closed for user root Aug 11 04:49:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cf4386d5-e714-4241-b8fb-e9a84cde5ab5 tempest-VolumesSnapshotListTestJSON-1215637245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.8a04d140-8ce6-4a7c-941c-7d416e64bd21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.265234e6-ee00-4b8e-afb1-0f168fe7fc4e 1G" returned: 0 in 0.471s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:49:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cf4386d5-e714-4241-b8fb-e9a84cde5ab5 tempest-VolumesSnapshotListTestJSON-1215637245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-886ca293-ed1b-48f4-b119-25dca904f852.8a04d140-8ce6-4a7c-941c-7d416e64bd21 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.265234e6-ee00-4b8e-afb1-0f168fe7fc4e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:49:10 devstack sudo[107790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-886ca293-ed1b-48f4-b119-25dca904f852.8a04d140-8ce6-4a7c-941c-7d416e64bd21 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.265234e6-ee00-4b8e-afb1-0f168fe7fc4e Aug 11 04:49:10 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:49:10 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root Aug 11 04:49:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cf4386d5-e714-4241-b8fb-e9a84cde5ab5 tempest-VolumesSnapshotListTestJSON-1215637245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-886ca293-ed1b-48f4-b119-25dca904f852.8a04d140-8ce6-4a7c-941c-7d416e64bd21 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.265234e6-ee00-4b8e-afb1-0f168fe7fc4e" returned: 0 in 0.327s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:49:10 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-cf4386d5-e714-4241-b8fb-e9a84cde5ab5 tempest-VolumesSnapshotListTestJSON-1215637245 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.265234e6-ee00-4b8e-afb1-0f168fe7fc4e is being set with open permissions: ugo+rw Aug 11 04:49:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cf4386d5-e714-4241-b8fb-e9a84cde5ab5 tempest-VolumesSnapshotListTestJSON-1215637245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.265234e6-ee00-4b8e-afb1-0f168fe7fc4e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:49:10 devstack sudo[107796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.265234e6-ee00-4b8e-afb1-0f168fe7fc4e Aug 11 04:49:10 devstack sudo[107796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:49:11 devstack sudo[107796]: pam_unix(sudo:session): session closed for user root Aug 11 04:49:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cf4386d5-e714-4241-b8fb-e9a84cde5ab5 tempest-VolumesSnapshotListTestJSON-1215637245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.265234e6-ee00-4b8e-afb1-0f168fe7fc4e" returned: 0 in 0.269s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:49:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-cf4386d5-e714-4241-b8fb-e9a84cde5ab5 tempest-VolumesSnapshotListTestJSON-1215637245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.655s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:49:11 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-cf4386d5-e714-4241-b8fb-e9a84cde5ab5 tempest-VolumesSnapshotListTestJSON-1215637245 None] Create snapshot completed successfully Aug 11 04:49:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c7412109-080a-45fe-937d-99d0b9ad78b0 tempest-VolumesSnapshotListTestJSON-1215637245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:49:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c7412109-080a-45fe-937d-99d0b9ad78b0 tempest-VolumesSnapshotListTestJSON-1215637245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:49:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-c7412109-080a-45fe-937d-99d0b9ad78b0 tempest-VolumesSnapshotListTestJSON-1215637245 None] Creating offline snapshot 131186dc-3452-4f1e-b431-92fe5c88b79d of volume 886ca293-ed1b-48f4-b119-25dca904f852 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 04:49:11 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[2284523b-93b2-4d6a-a081-9ce47208b753]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:49:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c7412109-080a-45fe-937d-99d0b9ad78b0 tempest-VolumesSnapshotListTestJSON-1215637245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.265234e6-ee00-4b8e-afb1-0f168fe7fc4e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:49:11 devstack sudo[107799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.265234e6-ee00-4b8e-afb1-0f168fe7fc4e Aug 11 04:49:11 devstack sudo[107799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:49:12 devstack sudo[107799]: pam_unix(sudo:session): session closed for user root Aug 11 04:49:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c7412109-080a-45fe-937d-99d0b9ad78b0 tempest-VolumesSnapshotListTestJSON-1215637245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.265234e6-ee00-4b8e-afb1-0f168fe7fc4e" returned: 0 in 0.463s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:49:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-c7412109-080a-45fe-937d-99d0b9ad78b0 tempest-VolumesSnapshotListTestJSON-1215637245 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-886ca293-ed1b-48f4-b119-25dca904f852(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:49:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c7412109-080a-45fe-937d-99d0b9ad78b0 tempest-VolumesSnapshotListTestJSON-1215637245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.265234e6-ee00-4b8e-afb1-0f168fe7fc4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.131186dc-3452-4f1e-b431-92fe5c88b79d 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:49:12 devstack sudo[107806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.265234e6-ee00-4b8e-afb1-0f168fe7fc4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.131186dc-3452-4f1e-b431-92fe5c88b79d 1G Aug 11 04:49:12 devstack sudo[107806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:49:12 devstack sudo[107806]: pam_unix(sudo:session): session closed for user root Aug 11 04:49:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c7412109-080a-45fe-937d-99d0b9ad78b0 tempest-VolumesSnapshotListTestJSON-1215637245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.265234e6-ee00-4b8e-afb1-0f168fe7fc4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.131186dc-3452-4f1e-b431-92fe5c88b79d 1G" returned: 0 in 0.566s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:49:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c7412109-080a-45fe-937d-99d0b9ad78b0 tempest-VolumesSnapshotListTestJSON-1215637245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-886ca293-ed1b-48f4-b119-25dca904f852.265234e6-ee00-4b8e-afb1-0f168fe7fc4e -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.131186dc-3452-4f1e-b431-92fe5c88b79d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:49:12 devstack sudo[107816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-886ca293-ed1b-48f4-b119-25dca904f852.265234e6-ee00-4b8e-afb1-0f168fe7fc4e -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.131186dc-3452-4f1e-b431-92fe5c88b79d Aug 11 04:49:12 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:49:13 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-7477d7c3-64d8-4058-a8c0-b2f63fc9a918 tempest-AttachVolumeTestJSON-730164755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:49:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7477d7c3-64d8-4058-a8c0-b2f63fc9a918 tempest-AttachVolumeTestJSON-730164755 None] Flow 'volume_create_manager' (18f3fb3f-eeb0-4be2-aad3-10b6439e0eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:49:13 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root Aug 11 04:49:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7477d7c3-64d8-4058-a8c0-b2f63fc9a918 tempest-AttachVolumeTestJSON-730164755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d61f8667-49ea-4d41-af4e-5a53866b92fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:49:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c7412109-080a-45fe-937d-99d0b9ad78b0 tempest-VolumesSnapshotListTestJSON-1215637245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-886ca293-ed1b-48f4-b119-25dca904f852.265234e6-ee00-4b8e-afb1-0f168fe7fc4e -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.131186dc-3452-4f1e-b431-92fe5c88b79d" returned: 0 in 0.364s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:49:13 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-c7412109-080a-45fe-937d-99d0b9ad78b0 tempest-VolumesSnapshotListTestJSON-1215637245 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.131186dc-3452-4f1e-b431-92fe5c88b79d is being set with open permissions: ugo+rw Aug 11 04:49:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c7412109-080a-45fe-937d-99d0b9ad78b0 tempest-VolumesSnapshotListTestJSON-1215637245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.131186dc-3452-4f1e-b431-92fe5c88b79d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:49:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7477d7c3-64d8-4058-a8c0-b2f63fc9a918 tempest-AttachVolumeTestJSON-730164755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d61f8667-49ea-4d41-af4e-5a53866b92fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:49:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-436046491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00686a76-d01d-4ab6-a3d4-3f7ef5197598,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a58fe74906a46998000d372b02d8357',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:49:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:49:13Z,use_quota=True,user_id='fa0a9a5edf7947059442f3da72a35ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:49:13 devstack sudo[107824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.131186dc-3452-4f1e-b431-92fe5c88b79d Aug 11 04:49:13 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:49:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7477d7c3-64d8-4058-a8c0-b2f63fc9a918 tempest-AttachVolumeTestJSON-730164755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb0e8c3c-594b-45fa-8716-e81cb45239a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:49:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7477d7c3-64d8-4058-a8c0-b2f63fc9a918 tempest-AttachVolumeTestJSON-730164755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb0e8c3c-594b-45fa-8716-e81cb45239a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:49:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7477d7c3-64d8-4058-a8c0-b2f63fc9a918 tempest-AttachVolumeTestJSON-730164755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa0a69d6-7afb-439c-a4b6-77ff7d4b96bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:49:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7477d7c3-64d8-4058-a8c0-b2f63fc9a918 tempest-AttachVolumeTestJSON-730164755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa0a69d6-7afb-439c-a4b6-77ff7d4b96bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00686a76-d01d-4ab6-a3d4-3f7ef5197598', 'volume_name': 'volume-00686a76-d01d-4ab6-a3d4-3f7ef5197598', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:49:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7477d7c3-64d8-4058-a8c0-b2f63fc9a918 tempest-AttachVolumeTestJSON-730164755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96f38229-a7b7-4595-94ca-940f4e8fa6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:49:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7477d7c3-64d8-4058-a8c0-b2f63fc9a918 tempest-AttachVolumeTestJSON-730164755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96f38229-a7b7-4595-94ca-940f4e8fa6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:49:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7477d7c3-64d8-4058-a8c0-b2f63fc9a918 tempest-AttachVolumeTestJSON-730164755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (388c9276-b46a-4268-8594-737578eeddc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:49:13 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-7477d7c3-64d8-4058-a8c0-b2f63fc9a918 tempest-AttachVolumeTestJSON-730164755 None] Volume 00686a76-d01d-4ab6-a3d4-3f7ef5197598: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00686a76-d01d-4ab6-a3d4-3f7ef5197598', 'volume_size': 1} Aug 11 04:49:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7477d7c3-64d8-4058-a8c0-b2f63fc9a918 tempest-AttachVolumeTestJSON-730164755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:49:13 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root Aug 11 04:49:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c7412109-080a-45fe-937d-99d0b9ad78b0 tempest-VolumesSnapshotListTestJSON-1215637245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.131186dc-3452-4f1e-b431-92fe5c88b79d" returned: 0 in 0.360s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:49:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c7412109-080a-45fe-937d-99d0b9ad78b0 tempest-VolumesSnapshotListTestJSON-1215637245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.888s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:49:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7477d7c3-64d8-4058-a8c0-b2f63fc9a918 tempest-AttachVolumeTestJSON-730164755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.325s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:49:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7477d7c3-64d8-4058-a8c0-b2f63fc9a918 tempest-AttachVolumeTestJSON-730164755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:49:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-436046491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00686a76-d01d-4ab6-a3d4-3f7ef5197598,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a58fe74906a46998000d372b02d8357',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:49:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:49:13Z,use_quota=True,user_id='fa0a9a5edf7947059442f3da72a35ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:49:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-7477d7c3-64d8-4058-a8c0-b2f63fc9a918 tempest-AttachVolumeTestJSON-730164755 None] Creating volume 00686a76-d01d-4ab6-a3d4-3f7ef5197598 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:49:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7477d7c3-64d8-4058-a8c0-b2f63fc9a918 tempest-AttachVolumeTestJSON-730164755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:49:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7477d7c3-64d8-4058-a8c0-b2f63fc9a918 tempest-AttachVolumeTestJSON-730164755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:49:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7477d7c3-64d8-4058-a8c0-b2f63fc9a918 tempest-AttachVolumeTestJSON-730164755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:49:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7477d7c3-64d8-4058-a8c0-b2f63fc9a918 tempest-AttachVolumeTestJSON-730164755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:49:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7477d7c3-64d8-4058-a8c0-b2f63fc9a918 tempest-AttachVolumeTestJSON-730164755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:49:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7477d7c3-64d8-4058-a8c0-b2f63fc9a918 tempest-AttachVolumeTestJSON-730164755 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:49:13 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-7477d7c3-64d8-4058-a8c0-b2f63fc9a918 tempest-AttachVolumeTestJSON-730164755 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:49:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7477d7c3-64d8-4058-a8c0-b2f63fc9a918 tempest-AttachVolumeTestJSON-730164755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-00686a76-d01d-4ab6-a3d4-3f7ef5197598 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:49:13 devstack sudo[107827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-00686a76-d01d-4ab6-a3d4-3f7ef5197598 1073741824 Aug 11 04:49:13 devstack sudo[107827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:49:13 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-c7412109-080a-45fe-937d-99d0b9ad78b0 tempest-VolumesSnapshotListTestJSON-1215637245 None] Create snapshot completed successfully Aug 11 04:49:14 devstack sudo[107827]: pam_unix(sudo:session): session closed for user root Aug 11 04:49:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7477d7c3-64d8-4058-a8c0-b2f63fc9a918 tempest-AttachVolumeTestJSON-730164755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-00686a76-d01d-4ab6-a3d4-3f7ef5197598 1073741824" returned: 0 in 0.581s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:49:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7477d7c3-64d8-4058-a8c0-b2f63fc9a918 tempest-AttachVolumeTestJSON-730164755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-00686a76-d01d-4ab6-a3d4-3f7ef5197598 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:49:14 devstack sudo[107833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-00686a76-d01d-4ab6-a3d4-3f7ef5197598 Aug 11 04:49:14 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:49:14 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root Aug 11 04:49:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7477d7c3-64d8-4058-a8c0-b2f63fc9a918 tempest-AttachVolumeTestJSON-730164755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-00686a76-d01d-4ab6-a3d4-3f7ef5197598" returned: 0 in 0.292s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:49:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7477d7c3-64d8-4058-a8c0-b2f63fc9a918 tempest-AttachVolumeTestJSON-730164755 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:49:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7477d7c3-64d8-4058-a8c0-b2f63fc9a918 tempest-AttachVolumeTestJSON-730164755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:49:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7477d7c3-64d8-4058-a8c0-b2f63fc9a918 tempest-AttachVolumeTestJSON-730164755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (388c9276-b46a-4268-8594-737578eeddc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00686a76-d01d-4ab6-a3d4-3f7ef5197598', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:49:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7477d7c3-64d8-4058-a8c0-b2f63fc9a918 tempest-AttachVolumeTestJSON-730164755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af5799f2-44b7-4571-a8e1-9d34d5be8fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:49:14 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-7477d7c3-64d8-4058-a8c0-b2f63fc9a918 tempest-AttachVolumeTestJSON-730164755 None] Volume volume-00686a76-d01d-4ab6-a3d4-3f7ef5197598 (00686a76-d01d-4ab6-a3d4-3f7ef5197598): created successfully Aug 11 04:49:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7477d7c3-64d8-4058-a8c0-b2f63fc9a918 tempest-AttachVolumeTestJSON-730164755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af5799f2-44b7-4571-a8e1-9d34d5be8fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:49:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7477d7c3-64d8-4058-a8c0-b2f63fc9a918 tempest-AttachVolumeTestJSON-730164755 None] Flow 'volume_create_manager' (18f3fb3f-eeb0-4be2-aad3-10b6439e0eee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:49:14 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-7477d7c3-64d8-4058-a8c0-b2f63fc9a918 tempest-AttachVolumeTestJSON-730164755 None] Created volume successfully. Aug 11 04:49:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f96fb279-71f6-4e4a-858a-00dbb6070d5b tempest-VolumesSnapshotListTestJSON-1215637245 None] Acquiring lock "cinder-131186dc-3452-4f1e-b431-92fe5c88b79d-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:49:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f96fb279-71f6-4e4a-858a-00dbb6070d5b tempest-VolumesSnapshotListTestJSON-1215637245 None] Lock "cinder-131186dc-3452-4f1e-b431-92fe5c88b79d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:49:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f96fb279-71f6-4e4a-858a-00dbb6070d5b tempest-VolumesSnapshotListTestJSON-1215637245 None] Acquiring lock "cinder-quobyte-886ca293-ed1b-48f4-b119-25dca904f852" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:49:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f96fb279-71f6-4e4a-858a-00dbb6070d5b tempest-VolumesSnapshotListTestJSON-1215637245 None] Lock "cinder-quobyte-886ca293-ed1b-48f4-b119-25dca904f852" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:49:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f96fb279-71f6-4e4a-858a-00dbb6070d5b tempest-VolumesSnapshotListTestJSON-1215637245 None] Acquiring lock "cinder-quobyte-131186dc-3452-4f1e-b431-92fe5c88b79d" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:49:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f96fb279-71f6-4e4a-858a-00dbb6070d5b tempest-VolumesSnapshotListTestJSON-1215637245 None] Lock "cinder-quobyte-131186dc-3452-4f1e-b431-92fe5c88b79d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:49:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-f96fb279-71f6-4e4a-858a-00dbb6070d5b tempest-VolumesSnapshotListTestJSON-1215637245 None] Deleting offline snapshot 131186dc-3452-4f1e-b431-92fe5c88b79d of volume 886ca293-ed1b-48f4-b119-25dca904f852 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 04:49:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-f96fb279-71f6-4e4a-858a-00dbb6070d5b tempest-VolumesSnapshotListTestJSON-1215637245 None] snapshot_file for this snap is: volume-886ca293-ed1b-48f4-b119-25dca904f852.131186dc-3452-4f1e-b431-92fe5c88b79d {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 04:49:14 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[301db9a1-e650-484a-bc05-c025c3a9c3d1]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:49:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f96fb279-71f6-4e4a-858a-00dbb6070d5b tempest-VolumesSnapshotListTestJSON-1215637245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.131186dc-3452-4f1e-b431-92fe5c88b79d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:49:15 devstack sudo[107836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.131186dc-3452-4f1e-b431-92fe5c88b79d Aug 11 04:49:15 devstack sudo[107836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:49:15 devstack sudo[107836]: pam_unix(sudo:session): session closed for user root Aug 11 04:49:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f96fb279-71f6-4e4a-858a-00dbb6070d5b tempest-VolumesSnapshotListTestJSON-1215637245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.131186dc-3452-4f1e-b431-92fe5c88b79d" returned: 0 in 0.396s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:49:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-f96fb279-71f6-4e4a-858a-00dbb6070d5b tempest-VolumesSnapshotListTestJSON-1215637245 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-886ca293-ed1b-48f4-b119-25dca904f852(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:49:15 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d59bcd4-c669-48bd-a8e5-e27222276957]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:49:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f96fb279-71f6-4e4a-858a-00dbb6070d5b tempest-VolumesSnapshotListTestJSON-1215637245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.265234e6-ee00-4b8e-afb1-0f168fe7fc4e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:49:15 devstack sudo[107845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.265234e6-ee00-4b8e-afb1-0f168fe7fc4e Aug 11 04:49:15 devstack sudo[107845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:49:15 devstack sudo[107845]: pam_unix(sudo:session): session closed for user root Aug 11 04:49:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f96fb279-71f6-4e4a-858a-00dbb6070d5b tempest-VolumesSnapshotListTestJSON-1215637245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.265234e6-ee00-4b8e-afb1-0f168fe7fc4e" returned: 0 in 0.422s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:49:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-f96fb279-71f6-4e4a-858a-00dbb6070d5b tempest-VolumesSnapshotListTestJSON-1215637245 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-886ca293-ed1b-48f4-b119-25dca904f852(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:49:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f96fb279-71f6-4e4a-858a-00dbb6070d5b tempest-VolumesSnapshotListTestJSON-1215637245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.131186dc-3452-4f1e-b431-92fe5c88b79d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:49:15 devstack sudo[107868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.131186dc-3452-4f1e-b431-92fe5c88b79d Aug 11 04:49:15 devstack sudo[107868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:49:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-6cd818e3-f2d3-4e68-ae0c-d2be36ab0fbd req-b4dcb43b-9be0-42ba-a3bd-b92b05a26455 tempest-AttachVolumeTestJSON-730164755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:49:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-6cd818e3-f2d3-4e68-ae0c-d2be36ab0fbd req-b4dcb43b-9be0-42ba-a3bd-b92b05a26455 tempest-AttachVolumeTestJSON-730164755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:49:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-6cd818e3-f2d3-4e68-ae0c-d2be36ab0fbd req-b4dcb43b-9be0-42ba-a3bd-b92b05a26455 tempest-AttachVolumeTestJSON-730164755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:49:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-6cd818e3-f2d3-4e68-ae0c-d2be36ab0fbd req-b4dcb43b-9be0-42ba-a3bd-b92b05a26455 tempest-AttachVolumeTestJSON-730164755 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd', 'name': 'volume-00686a76-d01d-4ab6-a3d4-3f7ef5197598', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '576c0243-abcb-4b3c-b0c3-2c9293d019bc', 'enforce_multipath': True} {{(pid=94472) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 11 04:49:16 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-6cd818e3-f2d3-4e68-ae0c-d2be36ab0fbd req-b4dcb43b-9be0-42ba-a3bd-b92b05a26455 tempest-AttachVolumeTestJSON-730164755 None] attachment_update completed successfully. Aug 11 04:49:16 devstack sudo[107868]: pam_unix(sudo:session): session closed for user root Aug 11 04:49:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f96fb279-71f6-4e4a-858a-00dbb6070d5b tempest-VolumesSnapshotListTestJSON-1215637245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.131186dc-3452-4f1e-b431-92fe5c88b79d" returned: 0 in 0.642s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:49:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f96fb279-71f6-4e4a-858a-00dbb6070d5b tempest-VolumesSnapshotListTestJSON-1215637245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.131186dc-3452-4f1e-b431-92fe5c88b79d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:49:16 devstack sudo[107948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.131186dc-3452-4f1e-b431-92fe5c88b79d Aug 11 04:49:16 devstack sudo[107948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:49:16 devstack sudo[107948]: pam_unix(sudo:session): session closed for user root Aug 11 04:49:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f96fb279-71f6-4e4a-858a-00dbb6070d5b tempest-VolumesSnapshotListTestJSON-1215637245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.131186dc-3452-4f1e-b431-92fe5c88b79d" returned: 0 in 0.284s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:49:16 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f96fb279-71f6-4e4a-858a-00dbb6070d5b tempest-VolumesSnapshotListTestJSON-1215637245 None] Lock "cinder-quobyte-131186dc-3452-4f1e-b431-92fe5c88b79d" released by "_delete_snapshot" :: held 1.882s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:49:16 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f96fb279-71f6-4e4a-858a-00dbb6070d5b tempest-VolumesSnapshotListTestJSON-1215637245 None] Lock "cinder-quobyte-886ca293-ed1b-48f4-b119-25dca904f852" released by "delete_snapshot" :: held 1.907s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:49:16 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-f96fb279-71f6-4e4a-858a-00dbb6070d5b tempest-VolumesSnapshotListTestJSON-1215637245 None] Created reservations ['f446e06b-341e-460f-940a-c58212eda2cc', 'd55f7cfb-fe5d-458a-a0ab-71d3af19dc6a', '0b465ed0-2789-47fd-a12d-9a4312928329', '752f27ab-fb4a-482e-b7ec-780a9e5d8014'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:49:16 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-f96fb279-71f6-4e4a-858a-00dbb6070d5b tempest-VolumesSnapshotListTestJSON-1215637245 None] Delete snapshot completed successfully. Aug 11 04:49:16 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f96fb279-71f6-4e4a-858a-00dbb6070d5b tempest-VolumesSnapshotListTestJSON-1215637245 None] Lock "cinder-131186dc-3452-4f1e-b431-92fe5c88b79d-delete_snapshot" released by "delete_snapshot" :: held 2.097s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:49:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fc813008-b18d-465c-bf20-15838407f0a5 tempest-VolumesSnapshotListTestJSON-1215637245 None] Acquiring lock "cinder-265234e6-ee00-4b8e-afb1-0f168fe7fc4e-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:49:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fc813008-b18d-465c-bf20-15838407f0a5 tempest-VolumesSnapshotListTestJSON-1215637245 None] Lock "cinder-265234e6-ee00-4b8e-afb1-0f168fe7fc4e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:49:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fc813008-b18d-465c-bf20-15838407f0a5 tempest-VolumesSnapshotListTestJSON-1215637245 None] Acquiring lock "cinder-quobyte-886ca293-ed1b-48f4-b119-25dca904f852" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:49:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fc813008-b18d-465c-bf20-15838407f0a5 tempest-VolumesSnapshotListTestJSON-1215637245 None] Lock "cinder-quobyte-886ca293-ed1b-48f4-b119-25dca904f852" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:49:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fc813008-b18d-465c-bf20-15838407f0a5 tempest-VolumesSnapshotListTestJSON-1215637245 None] Acquiring lock "cinder-quobyte-265234e6-ee00-4b8e-afb1-0f168fe7fc4e" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:49:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fc813008-b18d-465c-bf20-15838407f0a5 tempest-VolumesSnapshotListTestJSON-1215637245 None] Lock "cinder-quobyte-265234e6-ee00-4b8e-afb1-0f168fe7fc4e" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:49:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-fc813008-b18d-465c-bf20-15838407f0a5 tempest-VolumesSnapshotListTestJSON-1215637245 None] Deleting offline snapshot 265234e6-ee00-4b8e-afb1-0f168fe7fc4e of volume 886ca293-ed1b-48f4-b119-25dca904f852 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 04:49:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-fc813008-b18d-465c-bf20-15838407f0a5 tempest-VolumesSnapshotListTestJSON-1215637245 None] snapshot_file for this snap is: volume-886ca293-ed1b-48f4-b119-25dca904f852.265234e6-ee00-4b8e-afb1-0f168fe7fc4e {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 04:49:17 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f43f691-0196-4b2d-b01d-b117732c43e4]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:49:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fc813008-b18d-465c-bf20-15838407f0a5 tempest-VolumesSnapshotListTestJSON-1215637245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.265234e6-ee00-4b8e-afb1-0f168fe7fc4e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:49:17 devstack sudo[108293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.265234e6-ee00-4b8e-afb1-0f168fe7fc4e Aug 11 04:49:17 devstack sudo[108293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:49:17 devstack sudo[108293]: pam_unix(sudo:session): session closed for user root Aug 11 04:49:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fc813008-b18d-465c-bf20-15838407f0a5 tempest-VolumesSnapshotListTestJSON-1215637245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.265234e6-ee00-4b8e-afb1-0f168fe7fc4e" returned: 0 in 0.415s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:49:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-fc813008-b18d-465c-bf20-15838407f0a5 tempest-VolumesSnapshotListTestJSON-1215637245 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-886ca293-ed1b-48f4-b119-25dca904f852(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:49:17 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[89adf1f1-278a-4167-9de3-dde2485b2a8b]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:49:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fc813008-b18d-465c-bf20-15838407f0a5 tempest-VolumesSnapshotListTestJSON-1215637245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.8a04d140-8ce6-4a7c-941c-7d416e64bd21 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:49:17 devstack sudo[108299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.8a04d140-8ce6-4a7c-941c-7d416e64bd21 Aug 11 04:49:17 devstack sudo[108299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:49:17 devstack sudo[108299]: pam_unix(sudo:session): session closed for user root Aug 11 04:49:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fc813008-b18d-465c-bf20-15838407f0a5 tempest-VolumesSnapshotListTestJSON-1215637245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.8a04d140-8ce6-4a7c-941c-7d416e64bd21" returned: 0 in 0.372s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:49:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-fc813008-b18d-465c-bf20-15838407f0a5 tempest-VolumesSnapshotListTestJSON-1215637245 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-886ca293-ed1b-48f4-b119-25dca904f852(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:49:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fc813008-b18d-465c-bf20-15838407f0a5 tempest-VolumesSnapshotListTestJSON-1215637245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.265234e6-ee00-4b8e-afb1-0f168fe7fc4e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:49:17 devstack sudo[108304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.265234e6-ee00-4b8e-afb1-0f168fe7fc4e Aug 11 04:49:17 devstack sudo[108304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:49:18 devstack sudo[108304]: pam_unix(sudo:session): session closed for user root Aug 11 04:49:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fc813008-b18d-465c-bf20-15838407f0a5 tempest-VolumesSnapshotListTestJSON-1215637245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.265234e6-ee00-4b8e-afb1-0f168fe7fc4e" returned: 0 in 0.495s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:49:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fc813008-b18d-465c-bf20-15838407f0a5 tempest-VolumesSnapshotListTestJSON-1215637245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.265234e6-ee00-4b8e-afb1-0f168fe7fc4e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:49:18 devstack sudo[108312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.265234e6-ee00-4b8e-afb1-0f168fe7fc4e Aug 11 04:49:18 devstack sudo[108312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:49:18 devstack sudo[108312]: pam_unix(sudo:session): session closed for user root Aug 11 04:49:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fc813008-b18d-465c-bf20-15838407f0a5 tempest-VolumesSnapshotListTestJSON-1215637245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.265234e6-ee00-4b8e-afb1-0f168fe7fc4e" returned: 0 in 0.297s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:49:18 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fc813008-b18d-465c-bf20-15838407f0a5 tempest-VolumesSnapshotListTestJSON-1215637245 None] Lock "cinder-quobyte-265234e6-ee00-4b8e-afb1-0f168fe7fc4e" released by "_delete_snapshot" :: held 1.692s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:49:18 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fc813008-b18d-465c-bf20-15838407f0a5 tempest-VolumesSnapshotListTestJSON-1215637245 None] Lock "cinder-quobyte-886ca293-ed1b-48f4-b119-25dca904f852" released by "delete_snapshot" :: held 1.721s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:49:18 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-fc813008-b18d-465c-bf20-15838407f0a5 tempest-VolumesSnapshotListTestJSON-1215637245 None] Created reservations ['dc0241cf-e279-47c0-a9db-4baecdd138d8', '35997bbf-6550-4a76-bd3a-f207fd55cfbd', 'ec080d2b-6f15-453a-8f7d-8bd8767ec17c', '2acb4521-d5c3-4301-92a2-ce26a2efc8c3'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:49:18 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-fc813008-b18d-465c-bf20-15838407f0a5 tempest-VolumesSnapshotListTestJSON-1215637245 None] Delete snapshot completed successfully. Aug 11 04:49:18 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fc813008-b18d-465c-bf20-15838407f0a5 tempest-VolumesSnapshotListTestJSON-1215637245 None] Lock "cinder-265234e6-ee00-4b8e-afb1-0f168fe7fc4e-delete_snapshot" released by "delete_snapshot" :: held 1.882s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:49:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2a2d02fc-9bf4-4e5d-9864-b9074b215cdc tempest-VolumesSnapshotListTestJSON-1215637245 None] Acquiring lock "cinder-8a04d140-8ce6-4a7c-941c-7d416e64bd21-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:49:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2a2d02fc-9bf4-4e5d-9864-b9074b215cdc tempest-VolumesSnapshotListTestJSON-1215637245 None] Lock "cinder-8a04d140-8ce6-4a7c-941c-7d416e64bd21-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:49:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2a2d02fc-9bf4-4e5d-9864-b9074b215cdc tempest-VolumesSnapshotListTestJSON-1215637245 None] Acquiring lock "cinder-quobyte-886ca293-ed1b-48f4-b119-25dca904f852" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:49:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2a2d02fc-9bf4-4e5d-9864-b9074b215cdc tempest-VolumesSnapshotListTestJSON-1215637245 None] Lock "cinder-quobyte-886ca293-ed1b-48f4-b119-25dca904f852" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:49:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2a2d02fc-9bf4-4e5d-9864-b9074b215cdc tempest-VolumesSnapshotListTestJSON-1215637245 None] Acquiring lock "cinder-quobyte-8a04d140-8ce6-4a7c-941c-7d416e64bd21" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:49:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2a2d02fc-9bf4-4e5d-9864-b9074b215cdc tempest-VolumesSnapshotListTestJSON-1215637245 None] Lock "cinder-quobyte-8a04d140-8ce6-4a7c-941c-7d416e64bd21" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:49:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-2a2d02fc-9bf4-4e5d-9864-b9074b215cdc tempest-VolumesSnapshotListTestJSON-1215637245 None] Deleting offline snapshot 8a04d140-8ce6-4a7c-941c-7d416e64bd21 of volume 886ca293-ed1b-48f4-b119-25dca904f852 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 04:49:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-2a2d02fc-9bf4-4e5d-9864-b9074b215cdc tempest-VolumesSnapshotListTestJSON-1215637245 None] snapshot_file for this snap is: volume-886ca293-ed1b-48f4-b119-25dca904f852.8a04d140-8ce6-4a7c-941c-7d416e64bd21 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 04:49:19 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[95faed64-7179-4f95-bc1b-031faeb4a692]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:49:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2a2d02fc-9bf4-4e5d-9864-b9074b215cdc tempest-VolumesSnapshotListTestJSON-1215637245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.8a04d140-8ce6-4a7c-941c-7d416e64bd21 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:49:19 devstack sudo[108322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.8a04d140-8ce6-4a7c-941c-7d416e64bd21 Aug 11 04:49:19 devstack sudo[108322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:49:19 devstack sudo[108322]: pam_unix(sudo:session): session closed for user root Aug 11 04:49:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2a2d02fc-9bf4-4e5d-9864-b9074b215cdc tempest-VolumesSnapshotListTestJSON-1215637245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.8a04d140-8ce6-4a7c-941c-7d416e64bd21" returned: 0 in 0.383s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:49:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-2a2d02fc-9bf4-4e5d-9864-b9074b215cdc tempest-VolumesSnapshotListTestJSON-1215637245 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-886ca293-ed1b-48f4-b119-25dca904f852(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:49:19 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbd923e-607c-4c1e-9669-8a155e3d9b0e]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:49:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2a2d02fc-9bf4-4e5d-9864-b9074b215cdc tempest-VolumesSnapshotListTestJSON-1215637245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:49:19 devstack sudo[108327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852 Aug 11 04:49:19 devstack sudo[108327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:49:20 devstack sudo[108327]: pam_unix(sudo:session): session closed for user root Aug 11 04:49:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2a2d02fc-9bf4-4e5d-9864-b9074b215cdc tempest-VolumesSnapshotListTestJSON-1215637245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852" returned: 0 in 0.600s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:49:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2a2d02fc-9bf4-4e5d-9864-b9074b215cdc tempest-VolumesSnapshotListTestJSON-1215637245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.8a04d140-8ce6-4a7c-941c-7d416e64bd21 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:49:20 devstack sudo[108332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.8a04d140-8ce6-4a7c-941c-7d416e64bd21 Aug 11 04:49:20 devstack sudo[108332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:49:20 devstack sudo[108332]: pam_unix(sudo:session): session closed for user root Aug 11 04:49:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2a2d02fc-9bf4-4e5d-9864-b9074b215cdc tempest-VolumesSnapshotListTestJSON-1215637245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.8a04d140-8ce6-4a7c-941c-7d416e64bd21" returned: 0 in 0.376s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:49:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2a2d02fc-9bf4-4e5d-9864-b9074b215cdc tempest-VolumesSnapshotListTestJSON-1215637245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.8a04d140-8ce6-4a7c-941c-7d416e64bd21 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:49:20 devstack sudo[108337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.8a04d140-8ce6-4a7c-941c-7d416e64bd21 Aug 11 04:49:20 devstack sudo[108337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:49:21 devstack sudo[108337]: pam_unix(sudo:session): session closed for user root Aug 11 04:49:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2a2d02fc-9bf4-4e5d-9864-b9074b215cdc tempest-VolumesSnapshotListTestJSON-1215637245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852.8a04d140-8ce6-4a7c-941c-7d416e64bd21" returned: 0 in 0.299s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:49:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2a2d02fc-9bf4-4e5d-9864-b9074b215cdc tempest-VolumesSnapshotListTestJSON-1215637245 None] Lock "cinder-quobyte-8a04d140-8ce6-4a7c-941c-7d416e64bd21" released by "_delete_snapshot" :: held 1.828s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:49:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2a2d02fc-9bf4-4e5d-9864-b9074b215cdc tempest-VolumesSnapshotListTestJSON-1215637245 None] Lock "cinder-quobyte-886ca293-ed1b-48f4-b119-25dca904f852" released by "delete_snapshot" :: held 1.859s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:49:21 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-2a2d02fc-9bf4-4e5d-9864-b9074b215cdc tempest-VolumesSnapshotListTestJSON-1215637245 None] Created reservations ['baad88fe-2fe0-4eff-9cfb-7f24746e5929', 'd3c5e47b-5c97-4543-8b88-f5e840f8de6c', '41831859-1fa2-4411-b156-b6a597832b61', 'dec55aef-09d8-422a-93df-8610217858c5'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:49:21 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-2a2d02fc-9bf4-4e5d-9864-b9074b215cdc tempest-VolumesSnapshotListTestJSON-1215637245 None] Delete snapshot completed successfully. Aug 11 04:49:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2a2d02fc-9bf4-4e5d-9864-b9074b215cdc tempest-VolumesSnapshotListTestJSON-1215637245 None] Lock "cinder-8a04d140-8ce6-4a7c-941c-7d416e64bd21-delete_snapshot" released by "delete_snapshot" :: held 2.033s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:49:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-369d79ed-ab16-4e27-a49c-514e149186fb tempest-VolumesSnapshotListTestJSON-1215637245 None] Acquiring lock "cinder-886ca293-ed1b-48f4-b119-25dca904f852-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:49:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-369d79ed-ab16-4e27-a49c-514e149186fb tempest-VolumesSnapshotListTestJSON-1215637245 None] Lock "cinder-886ca293-ed1b-48f4-b119-25dca904f852-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:49:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-369d79ed-ab16-4e27-a49c-514e149186fb tempest-VolumesSnapshotListTestJSON-1215637245 None] Acquiring lock "cinder-quobyte-886ca293-ed1b-48f4-b119-25dca904f852" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:49:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-369d79ed-ab16-4e27-a49c-514e149186fb tempest-VolumesSnapshotListTestJSON-1215637245 None] Lock "cinder-quobyte-886ca293-ed1b-48f4-b119-25dca904f852" acquired by "delete_volume" :: waited 0.015s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:49:21 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[69eeeb1f-83cb-41ef-9cd5-2ee34268c7d4]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:49:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-369d79ed-ab16-4e27-a49c-514e149186fb tempest-VolumesSnapshotListTestJSON-1215637245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:49:21 devstack sudo[108340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852 Aug 11 04:49:21 devstack sudo[108340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:49:22 devstack sudo[108340]: pam_unix(sudo:session): session closed for user root Aug 11 04:49:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-369d79ed-ab16-4e27-a49c-514e149186fb tempest-VolumesSnapshotListTestJSON-1215637245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852" returned: 0 in 0.563s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:49:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-369d79ed-ab16-4e27-a49c-514e149186fb tempest-VolumesSnapshotListTestJSON-1215637245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:49:22 devstack sudo[108381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852 Aug 11 04:49:22 devstack sudo[108381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:49:22 devstack sudo[108381]: pam_unix(sudo:session): session closed for user root Aug 11 04:49:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-369d79ed-ab16-4e27-a49c-514e149186fb tempest-VolumesSnapshotListTestJSON-1215637245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-886ca293-ed1b-48f4-b119-25dca904f852" returned: 0 in 0.402s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:49:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-369d79ed-ab16-4e27-a49c-514e149186fb tempest-VolumesSnapshotListTestJSON-1215637245 None] Lock "cinder-quobyte-886ca293-ed1b-48f4-b119-25dca904f852" released by "delete_volume" :: held 1.057s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:49:22 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-369d79ed-ab16-4e27-a49c-514e149186fb tempest-VolumesSnapshotListTestJSON-1215637245 None] Created reservations ['b5325bb5-3860-4b79-a381-f916818287d7', '6a9a3299-6a8e-4a51-8bc1-a4f25c75de39', '890fa2b5-04a5-4628-a233-7c200a4af254', 'db7ef7f9-3def-42a7-b892-03cee40262b4'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:49:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-369d79ed-ab16-4e27-a49c-514e149186fb tempest-VolumesSnapshotListTestJSON-1215637245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:49:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-369d79ed-ab16-4e27-a49c-514e149186fb tempest-VolumesSnapshotListTestJSON-1215637245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:49:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-369d79ed-ab16-4e27-a49c-514e149186fb tempest-VolumesSnapshotListTestJSON-1215637245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:49:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-369d79ed-ab16-4e27-a49c-514e149186fb tempest-VolumesSnapshotListTestJSON-1215637245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:49:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-369d79ed-ab16-4e27-a49c-514e149186fb tempest-VolumesSnapshotListTestJSON-1215637245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:49:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-369d79ed-ab16-4e27-a49c-514e149186fb tempest-VolumesSnapshotListTestJSON-1215637245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:49:22 devstack sudo[108456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:49:22 devstack sudo[108456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:49:23 devstack sudo[108456]: pam_unix(sudo:session): session closed for user root Aug 11 04:49:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-369d79ed-ab16-4e27-a49c-514e149186fb tempest-VolumesSnapshotListTestJSON-1215637245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.391s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:49:23 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-369d79ed-ab16-4e27-a49c-514e149186fb tempest-VolumesSnapshotListTestJSON-1215637245 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:49:23 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-369d79ed-ab16-4e27-a49c-514e149186fb tempest-VolumesSnapshotListTestJSON-1215637245 None] Deleted volume successfully. Aug 11 04:49:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-369d79ed-ab16-4e27-a49c-514e149186fb tempest-VolumesSnapshotListTestJSON-1215637245 None] Lock "cinder-886ca293-ed1b-48f4-b119-25dca904f852-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:49:26 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb1a3c09-4266-4498-bfdf-20415e6ad61a tempest-TestImageHashVerification-1250488565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:49:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cb1a3c09-4266-4498-bfdf-20415e6ad61a tempest-TestImageHashVerification-1250488565 None] Flow 'volume_create_manager' (bd4b943e-0f02-4eb1-ac43-188b1fa4a634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:49:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cb1a3c09-4266-4498-bfdf-20415e6ad61a tempest-TestImageHashVerification-1250488565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aa2ce36-df64-45e8-94c6-e865f286d3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:49:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cb1a3c09-4266-4498-bfdf-20415e6ad61a tempest-TestImageHashVerification-1250488565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aa2ce36-df64-45e8-94c6-e865f286d3a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:49:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-694155067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a56fa951-393c-4538-999b-6bfcd88a0e7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d13f8b910d64b669d585ca20f583d5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:49:27Z,use_quota=True,user_id='95defcedac184e5b89568dff7f9987d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:49:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cb1a3c09-4266-4498-bfdf-20415e6ad61a tempest-TestImageHashVerification-1250488565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec1dc155-152d-4227-8a45-852286fd118d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:49:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cb1a3c09-4266-4498-bfdf-20415e6ad61a tempest-TestImageHashVerification-1250488565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec1dc155-152d-4227-8a45-852286fd118d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:49:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cb1a3c09-4266-4498-bfdf-20415e6ad61a tempest-TestImageHashVerification-1250488565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c2d4545-e0d8-4137-828e-b2b3a05b749a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:49:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cb1a3c09-4266-4498-bfdf-20415e6ad61a tempest-TestImageHashVerification-1250488565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c2d4545-e0d8-4137-828e-b2b3a05b749a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a56fa951-393c-4538-999b-6bfcd88a0e7f', 'volume_name': 'volume-a56fa951-393c-4538-999b-6bfcd88a0e7f', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:49:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cb1a3c09-4266-4498-bfdf-20415e6ad61a tempest-TestImageHashVerification-1250488565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09955614-41d7-4d17-9000-6e506a402546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:49:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cb1a3c09-4266-4498-bfdf-20415e6ad61a tempest-TestImageHashVerification-1250488565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09955614-41d7-4d17-9000-6e506a402546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:49:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cb1a3c09-4266-4498-bfdf-20415e6ad61a tempest-TestImageHashVerification-1250488565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75a026a8-9f7a-4f50-bab4-55eee3f2412b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:49:26 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-cb1a3c09-4266-4498-bfdf-20415e6ad61a tempest-TestImageHashVerification-1250488565 None] Volume a56fa951-393c-4538-999b-6bfcd88a0e7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a56fa951-393c-4538-999b-6bfcd88a0e7f', 'volume_size': 1} Aug 11 04:49:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-cb1a3c09-4266-4498-bfdf-20415e6ad61a tempest-TestImageHashVerification-1250488565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:49:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-cb1a3c09-4266-4498-bfdf-20415e6ad61a tempest-TestImageHashVerification-1250488565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:49:26 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-cb1a3c09-4266-4498-bfdf-20415e6ad61a tempest-TestImageHashVerification-1250488565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:49:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-694155067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a56fa951-393c-4538-999b-6bfcd88a0e7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d13f8b910d64b669d585ca20f583d5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:49:27Z,use_quota=True,user_id='95defcedac184e5b89568dff7f9987d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:49:26 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-cb1a3c09-4266-4498-bfdf-20415e6ad61a tempest-TestImageHashVerification-1250488565 None] Creating volume a56fa951-393c-4538-999b-6bfcd88a0e7f {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:49:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-cb1a3c09-4266-4498-bfdf-20415e6ad61a tempest-TestImageHashVerification-1250488565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:49:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-cb1a3c09-4266-4498-bfdf-20415e6ad61a tempest-TestImageHashVerification-1250488565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:49:26 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-cb1a3c09-4266-4498-bfdf-20415e6ad61a tempest-TestImageHashVerification-1250488565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:49:26 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-cb1a3c09-4266-4498-bfdf-20415e6ad61a tempest-TestImageHashVerification-1250488565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:49:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-cb1a3c09-4266-4498-bfdf-20415e6ad61a tempest-TestImageHashVerification-1250488565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:49:26 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-cb1a3c09-4266-4498-bfdf-20415e6ad61a tempest-TestImageHashVerification-1250488565 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:49:26 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-cb1a3c09-4266-4498-bfdf-20415e6ad61a tempest-TestImageHashVerification-1250488565 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:49:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cb1a3c09-4266-4498-bfdf-20415e6ad61a tempest-TestImageHashVerification-1250488565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a56fa951-393c-4538-999b-6bfcd88a0e7f 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:49:26 devstack sudo[108874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a56fa951-393c-4538-999b-6bfcd88a0e7f 1073741824 Aug 11 04:49:26 devstack sudo[108874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:49:27 devstack sudo[108874]: pam_unix(sudo:session): session closed for user root Aug 11 04:49:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cb1a3c09-4266-4498-bfdf-20415e6ad61a tempest-TestImageHashVerification-1250488565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a56fa951-393c-4538-999b-6bfcd88a0e7f 1073741824" returned: 0 in 0.628s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:49:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cb1a3c09-4266-4498-bfdf-20415e6ad61a tempest-TestImageHashVerification-1250488565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a56fa951-393c-4538-999b-6bfcd88a0e7f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:49:27 devstack sudo[108883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a56fa951-393c-4538-999b-6bfcd88a0e7f Aug 11 04:49:27 devstack sudo[108883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:49:27 devstack sudo[108883]: pam_unix(sudo:session): session closed for user root Aug 11 04:49:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cb1a3c09-4266-4498-bfdf-20415e6ad61a tempest-TestImageHashVerification-1250488565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a56fa951-393c-4538-999b-6bfcd88a0e7f" returned: 0 in 0.288s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:49:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-cb1a3c09-4266-4498-bfdf-20415e6ad61a tempest-TestImageHashVerification-1250488565 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:49:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-cb1a3c09-4266-4498-bfdf-20415e6ad61a tempest-TestImageHashVerification-1250488565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:49:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cb1a3c09-4266-4498-bfdf-20415e6ad61a tempest-TestImageHashVerification-1250488565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75a026a8-9f7a-4f50-bab4-55eee3f2412b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a56fa951-393c-4538-999b-6bfcd88a0e7f', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:49:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cb1a3c09-4266-4498-bfdf-20415e6ad61a tempest-TestImageHashVerification-1250488565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e5909bc-dabc-4769-8431-db00488d96b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:49:27 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-cb1a3c09-4266-4498-bfdf-20415e6ad61a tempest-TestImageHashVerification-1250488565 None] Volume volume-a56fa951-393c-4538-999b-6bfcd88a0e7f (a56fa951-393c-4538-999b-6bfcd88a0e7f): created successfully Aug 11 04:49:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cb1a3c09-4266-4498-bfdf-20415e6ad61a tempest-TestImageHashVerification-1250488565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e5909bc-dabc-4769-8431-db00488d96b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:49:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cb1a3c09-4266-4498-bfdf-20415e6ad61a tempest-TestImageHashVerification-1250488565 None] Flow 'volume_create_manager' (bd4b943e-0f02-4eb1-ac43-188b1fa4a634) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:49:27 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-cb1a3c09-4266-4498-bfdf-20415e6ad61a tempest-TestImageHashVerification-1250488565 None] Created volume successfully. Aug 11 04:49:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-de1b6a6e-5727-4cf7-a468-d2b681401912 tempest-TestImageHashVerification-1250488565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:49:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-de1b6a6e-5727-4cf7-a468-d2b681401912 tempest-TestImageHashVerification-1250488565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:49:29 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da5c650-7015-4d75-96c8-e5b466cc50a4]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:49:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-de1b6a6e-5727-4cf7-a468-d2b681401912 tempest-TestImageHashVerification-1250488565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a56fa951-393c-4538-999b-6bfcd88a0e7f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:49:30 devstack sudo[108887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a56fa951-393c-4538-999b-6bfcd88a0e7f Aug 11 04:49:30 devstack sudo[108887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:49:30 devstack sudo[108887]: pam_unix(sudo:session): session closed for user root Aug 11 04:49:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-de1b6a6e-5727-4cf7-a468-d2b681401912 tempest-TestImageHashVerification-1250488565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a56fa951-393c-4538-999b-6bfcd88a0e7f" returned: 0 in 0.474s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:49:30 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec684e54-45b9-42c4-ae57-4bde74520e02]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:49:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-de1b6a6e-5727-4cf7-a468-d2b681401912 tempest-TestImageHashVerification-1250488565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a56fa951-393c-4538-999b-6bfcd88a0e7f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:49:30 devstack sudo[108892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a56fa951-393c-4538-999b-6bfcd88a0e7f Aug 11 04:49:30 devstack sudo[108892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:49:30 devstack sudo[108892]: pam_unix(sudo:session): session closed for user root Aug 11 04:49:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-de1b6a6e-5727-4cf7-a468-d2b681401912 tempest-TestImageHashVerification-1250488565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a56fa951-393c-4538-999b-6bfcd88a0e7f" returned: 0 in 0.411s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:49:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-de1b6a6e-5727-4cf7-a468-d2b681401912 tempest-TestImageHashVerification-1250488565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a56fa951-393c-4538-999b-6bfcd88a0e7f /opt/stack/data/cinder/conversion/a56fa951-393c-4538-999b-6bfcd88a0e7f.temp_image.79831832-ac1c-457a-aae2-38e9eb0e546fezfr2nlx.img {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:49:30 devstack sudo[108897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a56fa951-393c-4538-999b-6bfcd88a0e7f /opt/stack/data/cinder/conversion/a56fa951-393c-4538-999b-6bfcd88a0e7f.temp_image.79831832-ac1c-457a-aae2-38e9eb0e546fezfr2nlx.img Aug 11 04:49:30 devstack sudo[108897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:49:36 devstack sudo[108897]: pam_unix(sudo:session): session closed for user root Aug 11 04:49:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-de1b6a6e-5727-4cf7-a468-d2b681401912 tempest-TestImageHashVerification-1250488565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a56fa951-393c-4538-999b-6bfcd88a0e7f /opt/stack/data/cinder/conversion/a56fa951-393c-4538-999b-6bfcd88a0e7f.temp_image.79831832-ac1c-457a-aae2-38e9eb0e546fezfr2nlx.img" returned: 0 in 6.095s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:49:36 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[60aa33e3-7783-4b6a-b0d6-08d568096a9d]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:49:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-de1b6a6e-5727-4cf7-a468-d2b681401912 tempest-TestImageHashVerification-1250488565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a56fa951-393c-4538-999b-6bfcd88a0e7f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:49:37 devstack sudo[108912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a56fa951-393c-4538-999b-6bfcd88a0e7f Aug 11 04:49:37 devstack sudo[108912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:49:37 devstack sudo[108912]: pam_unix(sudo:session): session closed for user root Aug 11 04:49:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-de1b6a6e-5727-4cf7-a468-d2b681401912 tempest-TestImageHashVerification-1250488565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a56fa951-393c-4538-999b-6bfcd88a0e7f" returned: 0 in 0.669s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:49:37 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-de1b6a6e-5727-4cf7-a468-d2b681401912 tempest-TestImageHashVerification-1250488565 None] Image conversion details: src /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a56fa951-393c-4538-999b-6bfcd88a0e7f, size 1024.00 MB, duration 6.10 sec, destination /opt/stack/data/cinder/conversion/a56fa951-393c-4538-999b-6bfcd88a0e7f.temp_image.79831832-ac1c-457a-aae2-38e9eb0e546fezfr2nlx.img {{(pid=94472) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 11 04:49:37 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-de1b6a6e-5727-4cf7-a468-d2b681401912 tempest-TestImageHashVerification-1250488565 None] Converted 1024.00 MB image at 167.91 MB/s Aug 11 04:49:37 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-de1b6a6e-5727-4cf7-a468-d2b681401912 tempest-TestImageHashVerification-1250488565 None] 79831832-ac1c-457a-aae2-38e9eb0e546f was raw, no need to convert to raw {{(pid=94472) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 11 04:49:37 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:INSERT=12,cinder:UPDATE=56,cinder:SELECT=46,cinder:DELETE=5 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:49:47 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=54,cinder:INSERT=16,cinder:UPDATE=52,cinder:DELETE=4 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:49:49 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-06e9b848-fda3-4dec-b6a9-af37af0b4c06 req-91c5f685-224a-448a-a3d7-d4e9b8438ce2 tempest-AttachVolumeTestJSON-730164755 None] Terminate volume connection completed successfully. Aug 11 04:49:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-06e9b848-fda3-4dec-b6a9-af37af0b4c06 req-91c5f685-224a-448a-a3d7-d4e9b8438ce2 tempest-AttachVolumeTestJSON-730164755 None] Deleting attachment 576c0243-abcb-4b3c-b0c3-2c9293d019bc. {{(pid=94472) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 11 04:49:58 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 04:49:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:49:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:49:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:49:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:49:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:49:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:49:58 devstack sudo[109086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:49:58 devstack sudo[109086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:49:58 devstack sudo[109086]: pam_unix(sudo:session): session closed for user root Aug 11 04:49:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.354s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:49:58 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:49:58 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running periodic task VolumeManager._thread_info {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 04:49:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] thread count: 28 {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 11 04:49:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] thread info: [<_MainThread(MainThread, started 133315846115456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 11 04:49:59 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=2 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:50:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-de1b6a6e-5727-4cf7-a468-d2b681401912 tempest-TestImageHashVerification-1250488565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 34.522s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:50:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-de1b6a6e-5727-4cf7-a468-d2b681401912 tempest-TestImageHashVerification-1250488565 None] Uploaded volume to glance image-id: 79831832-ac1c-457a-aae2-38e9eb0e546f. {{(pid=94472) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 11 04:50:04 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-de1b6a6e-5727-4cf7-a468-d2b681401912 tempest-TestImageHashVerification-1250488565 None] Copy volume to image completed successfully. Aug 11 04:50:05 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f3f9ce50-a218-4fe6-bf43-e311f1baa9a5 tempest-TestImageHashVerification-1250488565 None] Acquiring lock "cinder-a56fa951-393c-4538-999b-6bfcd88a0e7f-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:50:05 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f3f9ce50-a218-4fe6-bf43-e311f1baa9a5 tempest-TestImageHashVerification-1250488565 None] Lock "cinder-a56fa951-393c-4538-999b-6bfcd88a0e7f-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:50:05 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f3f9ce50-a218-4fe6-bf43-e311f1baa9a5 tempest-TestImageHashVerification-1250488565 None] Acquiring lock "cinder-quobyte-a56fa951-393c-4538-999b-6bfcd88a0e7f" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:50:05 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f3f9ce50-a218-4fe6-bf43-e311f1baa9a5 tempest-TestImageHashVerification-1250488565 None] Lock "cinder-quobyte-a56fa951-393c-4538-999b-6bfcd88a0e7f" acquired by "delete_volume" :: waited 0.016s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:50:05 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[117ecd3a-7649-4d06-9ffb-6bd8ac793aed]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:50:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f3f9ce50-a218-4fe6-bf43-e311f1baa9a5 tempest-TestImageHashVerification-1250488565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a56fa951-393c-4538-999b-6bfcd88a0e7f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:05 devstack sudo[109111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a56fa951-393c-4538-999b-6bfcd88a0e7f Aug 11 04:50:05 devstack sudo[109111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:06 devstack sudo[109111]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f3f9ce50-a218-4fe6-bf43-e311f1baa9a5 tempest-TestImageHashVerification-1250488565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a56fa951-393c-4538-999b-6bfcd88a0e7f" returned: 0 in 0.437s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f3f9ce50-a218-4fe6-bf43-e311f1baa9a5 tempest-TestImageHashVerification-1250488565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a56fa951-393c-4538-999b-6bfcd88a0e7f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:06 devstack sudo[109116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a56fa951-393c-4538-999b-6bfcd88a0e7f Aug 11 04:50:06 devstack sudo[109116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:06 devstack sudo[109116]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f3f9ce50-a218-4fe6-bf43-e311f1baa9a5 tempest-TestImageHashVerification-1250488565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a56fa951-393c-4538-999b-6bfcd88a0e7f" returned: 0 in 0.518s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:06 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f3f9ce50-a218-4fe6-bf43-e311f1baa9a5 tempest-TestImageHashVerification-1250488565 None] Lock "cinder-quobyte-a56fa951-393c-4538-999b-6bfcd88a0e7f" released by "delete_volume" :: held 1.034s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:50:06 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-f3f9ce50-a218-4fe6-bf43-e311f1baa9a5 tempest-TestImageHashVerification-1250488565 None] Created reservations ['9288548e-8825-4954-8b37-fa8d9235ba55', 'f65b118c-bddd-4786-8192-ff97e9e7e14c', '2baebd85-48ca-4b80-9b40-14c92e7cf961', 'af58f860-891a-456d-80ef-26c0d247e756'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:50:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f3f9ce50-a218-4fe6-bf43-e311f1baa9a5 tempest-TestImageHashVerification-1250488565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:50:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f3f9ce50-a218-4fe6-bf43-e311f1baa9a5 tempest-TestImageHashVerification-1250488565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:50:06 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f3f9ce50-a218-4fe6-bf43-e311f1baa9a5 tempest-TestImageHashVerification-1250488565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:50:06 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f3f9ce50-a218-4fe6-bf43-e311f1baa9a5 tempest-TestImageHashVerification-1250488565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:50:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f3f9ce50-a218-4fe6-bf43-e311f1baa9a5 tempest-TestImageHashVerification-1250488565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:50:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f3f9ce50-a218-4fe6-bf43-e311f1baa9a5 tempest-TestImageHashVerification-1250488565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:06 devstack sudo[109147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:50:06 devstack sudo[109147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:07 devstack sudo[109147]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f3f9ce50-a218-4fe6-bf43-e311f1baa9a5 tempest-TestImageHashVerification-1250488565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.500s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:07 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-f3f9ce50-a218-4fe6-bf43-e311f1baa9a5 tempest-TestImageHashVerification-1250488565 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:50:07 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-f3f9ce50-a218-4fe6-bf43-e311f1baa9a5 tempest-TestImageHashVerification-1250488565 None] Deleted volume successfully. Aug 11 04:50:07 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f3f9ce50-a218-4fe6-bf43-e311f1baa9a5 tempest-TestImageHashVerification-1250488565 None] Lock "cinder-a56fa951-393c-4538-999b-6bfcd88a0e7f-delete_volume" released by "delete_volume" :: held 1.872s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:50:16 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=5,cinder:UPDATE=8,cinder:INSERT=3 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:50:17 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:50:20 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-7179f51e-ef47-412a-af1d-fb83c2dc80bd tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:50:21 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7179f51e-ef47-412a-af1d-fb83c2dc80bd tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Flow 'volume_create_manager' (a0432de4-e6b3-45ff-bbb8-d168577bde71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:50:21 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7179f51e-ef47-412a-af1d-fb83c2dc80bd tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34c1f82c-9ad8-4d20-827a-718e2432cde9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:50:21 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7179f51e-ef47-412a-af1d-fb83c2dc80bd tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34c1f82c-9ad8-4d20-827a-718e2432cde9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1209629590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38b93c3e-12d0-4e23-8f5e-e7b48d9cdacb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2aeef6d30c4fd4b8e5c36aed747763',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:50:21Z,use_quota=True,user_id='3719f99cf10d4d1db62ed9ab0dd070fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:50:21 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7179f51e-ef47-412a-af1d-fb83c2dc80bd tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (060d436f-93f9-4dfc-948c-77623749196d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:50:21 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7179f51e-ef47-412a-af1d-fb83c2dc80bd tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (060d436f-93f9-4dfc-948c-77623749196d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:50:21 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7179f51e-ef47-412a-af1d-fb83c2dc80bd tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (893f63f1-8e7a-4e9b-a042-b31ba3264b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:50:21 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7179f51e-ef47-412a-af1d-fb83c2dc80bd tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (893f63f1-8e7a-4e9b-a042-b31ba3264b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38b93c3e-12d0-4e23-8f5e-e7b48d9cdacb', 'volume_name': 'volume-38b93c3e-12d0-4e23-8f5e-e7b48d9cdacb', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:50:21 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7179f51e-ef47-412a-af1d-fb83c2dc80bd tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecb78562-eb9f-41b7-b709-a74ade7c671e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:50:21 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7179f51e-ef47-412a-af1d-fb83c2dc80bd tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecb78562-eb9f-41b7-b709-a74ade7c671e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:50:21 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7179f51e-ef47-412a-af1d-fb83c2dc80bd tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa3c333b-c742-4f1a-9cc2-1c8af156f170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:50:21 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-7179f51e-ef47-412a-af1d-fb83c2dc80bd tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Volume 38b93c3e-12d0-4e23-8f5e-e7b48d9cdacb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38b93c3e-12d0-4e23-8f5e-e7b48d9cdacb', 'volume_size': 1} Aug 11 04:50:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7179f51e-ef47-412a-af1d-fb83c2dc80bd tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:50:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7179f51e-ef47-412a-af1d-fb83c2dc80bd tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:50:21 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7179f51e-ef47-412a-af1d-fb83c2dc80bd tempest-CreateVolumesFromSourceVolumeTest-677127951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1209629590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38b93c3e-12d0-4e23-8f5e-e7b48d9cdacb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2aeef6d30c4fd4b8e5c36aed747763',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:50:21Z,use_quota=True,user_id='3719f99cf10d4d1db62ed9ab0dd070fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:50:21 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-7179f51e-ef47-412a-af1d-fb83c2dc80bd tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Creating volume 38b93c3e-12d0-4e23-8f5e-e7b48d9cdacb {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:50:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7179f51e-ef47-412a-af1d-fb83c2dc80bd tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:50:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7179f51e-ef47-412a-af1d-fb83c2dc80bd tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:50:21 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7179f51e-ef47-412a-af1d-fb83c2dc80bd tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:50:21 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7179f51e-ef47-412a-af1d-fb83c2dc80bd tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:50:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7179f51e-ef47-412a-af1d-fb83c2dc80bd tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:50:21 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7179f51e-ef47-412a-af1d-fb83c2dc80bd tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:50:21 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-7179f51e-ef47-412a-af1d-fb83c2dc80bd tempest-CreateVolumesFromSourceVolumeTest-677127951 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:50:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7179f51e-ef47-412a-af1d-fb83c2dc80bd tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-38b93c3e-12d0-4e23-8f5e-e7b48d9cdacb 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:21 devstack sudo[109255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-38b93c3e-12d0-4e23-8f5e-e7b48d9cdacb 1073741824 Aug 11 04:50:21 devstack sudo[109255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:21 devstack sudo[109255]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7179f51e-ef47-412a-af1d-fb83c2dc80bd tempest-CreateVolumesFromSourceVolumeTest-677127951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-38b93c3e-12d0-4e23-8f5e-e7b48d9cdacb 1073741824" returned: 0 in 0.453s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7179f51e-ef47-412a-af1d-fb83c2dc80bd tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-38b93c3e-12d0-4e23-8f5e-e7b48d9cdacb {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:21 devstack sudo[109262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-38b93c3e-12d0-4e23-8f5e-e7b48d9cdacb Aug 11 04:50:21 devstack sudo[109262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:21 devstack sudo[109262]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7179f51e-ef47-412a-af1d-fb83c2dc80bd tempest-CreateVolumesFromSourceVolumeTest-677127951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-38b93c3e-12d0-4e23-8f5e-e7b48d9cdacb" returned: 0 in 0.255s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:21 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7179f51e-ef47-412a-af1d-fb83c2dc80bd tempest-CreateVolumesFromSourceVolumeTest-677127951 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:50:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7179f51e-ef47-412a-af1d-fb83c2dc80bd tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:50:21 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7179f51e-ef47-412a-af1d-fb83c2dc80bd tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa3c333b-c742-4f1a-9cc2-1c8af156f170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38b93c3e-12d0-4e23-8f5e-e7b48d9cdacb', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:50:21 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7179f51e-ef47-412a-af1d-fb83c2dc80bd tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bde088e-9121-4c8d-8772-911691471801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:50:21 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-7179f51e-ef47-412a-af1d-fb83c2dc80bd tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Volume volume-38b93c3e-12d0-4e23-8f5e-e7b48d9cdacb (38b93c3e-12d0-4e23-8f5e-e7b48d9cdacb): created successfully Aug 11 04:50:21 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7179f51e-ef47-412a-af1d-fb83c2dc80bd tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bde088e-9121-4c8d-8772-911691471801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:50:21 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7179f51e-ef47-412a-af1d-fb83c2dc80bd tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Flow 'volume_create_manager' (a0432de4-e6b3-45ff-bbb8-d168577bde71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:50:21 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-7179f51e-ef47-412a-af1d-fb83c2dc80bd tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Created volume successfully. Aug 11 04:50:22 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-45de744c-45e7-4f05-a1b1-aa9a708fcde1 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:50:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-45de744c-45e7-4f05-a1b1-aa9a708fcde1 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Flow 'volume_create_manager' (8aebc618-c168-4538-b488-e749f2842e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:50:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-45de744c-45e7-4f05-a1b1-aa9a708fcde1 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e6e228e-f564-452a-b784-0ed9669ba481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:50:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-45de744c-45e7-4f05-a1b1-aa9a708fcde1 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e6e228e-f564-452a-b784-0ed9669ba481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:50:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-765759019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=520240ce-7378-4a68-ac39-83b1d8f158d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2aeef6d30c4fd4b8e5c36aed747763',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:50:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:50:22Z,use_quota=True,user_id='3719f99cf10d4d1db62ed9ab0dd070fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:50:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-45de744c-45e7-4f05-a1b1-aa9a708fcde1 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4c7f15e-805a-463c-a375-33eaa265a3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:50:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-45de744c-45e7-4f05-a1b1-aa9a708fcde1 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4c7f15e-805a-463c-a375-33eaa265a3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:50:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-45de744c-45e7-4f05-a1b1-aa9a708fcde1 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dcbac26-c493-4766-be6b-1b031e2c4968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:50:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-45de744c-45e7-4f05-a1b1-aa9a708fcde1 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dcbac26-c493-4766-be6b-1b031e2c4968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '520240ce-7378-4a68-ac39-83b1d8f158d7', 'volume_name': 'volume-520240ce-7378-4a68-ac39-83b1d8f158d7', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:50:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-45de744c-45e7-4f05-a1b1-aa9a708fcde1 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (292fd10e-277f-4b6f-a7b4-279158cf625d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:50:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-45de744c-45e7-4f05-a1b1-aa9a708fcde1 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (292fd10e-277f-4b6f-a7b4-279158cf625d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:50:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-45de744c-45e7-4f05-a1b1-aa9a708fcde1 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e9c550c-a7b0-490d-9b02-efc509dfb21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:50:22 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-45de744c-45e7-4f05-a1b1-aa9a708fcde1 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Volume 520240ce-7378-4a68-ac39-83b1d8f158d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-520240ce-7378-4a68-ac39-83b1d8f158d7', 'volume_size': 1} Aug 11 04:50:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-45de744c-45e7-4f05-a1b1-aa9a708fcde1 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:50:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-45de744c-45e7-4f05-a1b1-aa9a708fcde1 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:50:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-45de744c-45e7-4f05-a1b1-aa9a708fcde1 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:50:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-765759019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=520240ce-7378-4a68-ac39-83b1d8f158d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2aeef6d30c4fd4b8e5c36aed747763',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:50:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:50:22Z,use_quota=True,user_id='3719f99cf10d4d1db62ed9ab0dd070fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:50:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-45de744c-45e7-4f05-a1b1-aa9a708fcde1 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Creating volume 520240ce-7378-4a68-ac39-83b1d8f158d7 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:50:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-45de744c-45e7-4f05-a1b1-aa9a708fcde1 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:50:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-45de744c-45e7-4f05-a1b1-aa9a708fcde1 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:50:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-45de744c-45e7-4f05-a1b1-aa9a708fcde1 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:50:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-45de744c-45e7-4f05-a1b1-aa9a708fcde1 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:50:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-45de744c-45e7-4f05-a1b1-aa9a708fcde1 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:50:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-45de744c-45e7-4f05-a1b1-aa9a708fcde1 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:50:22 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-45de744c-45e7-4f05-a1b1-aa9a708fcde1 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:50:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-45de744c-45e7-4f05-a1b1-aa9a708fcde1 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-520240ce-7378-4a68-ac39-83b1d8f158d7 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:22 devstack sudo[109280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-520240ce-7378-4a68-ac39-83b1d8f158d7 1073741824 Aug 11 04:50:22 devstack sudo[109280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:22 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-71fc80a9-268f-4bc4-acd7-c576937def17 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:50:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-71fc80a9-268f-4bc4-acd7-c576937def17 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Flow 'volume_create_manager' (884ac184-5c42-4265-b25e-0ac1b46c3406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:50:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-71fc80a9-268f-4bc4-acd7-c576937def17 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4db68947-142c-4860-9257-5c031ccec61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:50:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-71fc80a9-268f-4bc4-acd7-c576937def17 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4db68947-142c-4860-9257-5c031ccec61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:50:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-749467752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16a8921d-20c4-45cb-ae14-9b66b69ae2fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2aeef6d30c4fd4b8e5c36aed747763',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:50:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:50:23Z,use_quota=True,user_id='3719f99cf10d4d1db62ed9ab0dd070fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:50:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-71fc80a9-268f-4bc4-acd7-c576937def17 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7b80dcf-d7d6-46f9-bf1d-9c9cdca6ebdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:50:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-71fc80a9-268f-4bc4-acd7-c576937def17 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7b80dcf-d7d6-46f9-bf1d-9c9cdca6ebdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:50:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-71fc80a9-268f-4bc4-acd7-c576937def17 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf43302c-660f-4417-9a8b-c98707f37847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:50:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-71fc80a9-268f-4bc4-acd7-c576937def17 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf43302c-660f-4417-9a8b-c98707f37847) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16a8921d-20c4-45cb-ae14-9b66b69ae2fd', 'volume_name': 'volume-16a8921d-20c4-45cb-ae14-9b66b69ae2fd', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:50:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-71fc80a9-268f-4bc4-acd7-c576937def17 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61921d0e-1d04-4f55-a819-bb8ff9a7732b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:50:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-71fc80a9-268f-4bc4-acd7-c576937def17 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61921d0e-1d04-4f55-a819-bb8ff9a7732b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:50:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-71fc80a9-268f-4bc4-acd7-c576937def17 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ebc0e2d-fdce-42ee-a83e-801e507580e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:50:22 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-71fc80a9-268f-4bc4-acd7-c576937def17 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Volume 16a8921d-20c4-45cb-ae14-9b66b69ae2fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16a8921d-20c4-45cb-ae14-9b66b69ae2fd', 'volume_size': 1} Aug 11 04:50:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-71fc80a9-268f-4bc4-acd7-c576937def17 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:50:23 devstack sudo[109280]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-45de744c-45e7-4f05-a1b1-aa9a708fcde1 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-520240ce-7378-4a68-ac39-83b1d8f158d7 1073741824" returned: 0 in 0.505s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-45de744c-45e7-4f05-a1b1-aa9a708fcde1 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-520240ce-7378-4a68-ac39-83b1d8f158d7 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:23 devstack sudo[109286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-520240ce-7378-4a68-ac39-83b1d8f158d7 Aug 11 04:50:23 devstack sudo[109286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:23 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c0ad275-90a1-4c1c-ad5b-0a689c3d02e2 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:50:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2c0ad275-90a1-4c1c-ad5b-0a689c3d02e2 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Flow 'volume_create_manager' (8184d6dd-bb9a-4c55-b381-14ce813c47c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:50:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2c0ad275-90a1-4c1c-ad5b-0a689c3d02e2 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26681e62-1a86-40b7-954a-01f4d4f7de0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:50:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2c0ad275-90a1-4c1c-ad5b-0a689c3d02e2 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26681e62-1a86-40b7-954a-01f4d4f7de0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:50:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-150034738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b04dcb4-7a2a-4d60-afb6-0166486ccd57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2aeef6d30c4fd4b8e5c36aed747763',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:50:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:50:23Z,use_quota=True,user_id='3719f99cf10d4d1db62ed9ab0dd070fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:50:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2c0ad275-90a1-4c1c-ad5b-0a689c3d02e2 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8a95fcf-f7d4-41ee-bf9a-405b9110f41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:50:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2c0ad275-90a1-4c1c-ad5b-0a689c3d02e2 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8a95fcf-f7d4-41ee-bf9a-405b9110f41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:50:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2c0ad275-90a1-4c1c-ad5b-0a689c3d02e2 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d6a446a-b2ce-4ecb-84cc-622f61c9ee32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:50:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2c0ad275-90a1-4c1c-ad5b-0a689c3d02e2 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d6a446a-b2ce-4ecb-84cc-622f61c9ee32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b04dcb4-7a2a-4d60-afb6-0166486ccd57', 'volume_name': 'volume-1b04dcb4-7a2a-4d60-afb6-0166486ccd57', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:50:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2c0ad275-90a1-4c1c-ad5b-0a689c3d02e2 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b77916a-7420-412d-a678-2f80af697eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:50:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2c0ad275-90a1-4c1c-ad5b-0a689c3d02e2 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b77916a-7420-412d-a678-2f80af697eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:50:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2c0ad275-90a1-4c1c-ad5b-0a689c3d02e2 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeac2cc2-b83b-49dc-8359-e4b2b8dbf95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:50:23 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-2c0ad275-90a1-4c1c-ad5b-0a689c3d02e2 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Volume 1b04dcb4-7a2a-4d60-afb6-0166486ccd57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b04dcb4-7a2a-4d60-afb6-0166486ccd57', 'volume_size': 1} Aug 11 04:50:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2c0ad275-90a1-4c1c-ad5b-0a689c3d02e2 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:50:23 devstack sudo[109286]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-45de744c-45e7-4f05-a1b1-aa9a708fcde1 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-520240ce-7378-4a68-ac39-83b1d8f158d7" returned: 0 in 0.272s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:23 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-45de744c-45e7-4f05-a1b1-aa9a708fcde1 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:50:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-45de744c-45e7-4f05-a1b1-aa9a708fcde1 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:50:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-71fc80a9-268f-4bc4-acd7-c576937def17 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.477s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:50:23 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-71fc80a9-268f-4bc4-acd7-c576937def17 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:50:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-749467752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16a8921d-20c4-45cb-ae14-9b66b69ae2fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2aeef6d30c4fd4b8e5c36aed747763',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:50:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:50:23Z,use_quota=True,user_id='3719f99cf10d4d1db62ed9ab0dd070fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:50:23 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-71fc80a9-268f-4bc4-acd7-c576937def17 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Creating volume 16a8921d-20c4-45cb-ae14-9b66b69ae2fd {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:50:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-71fc80a9-268f-4bc4-acd7-c576937def17 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:50:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-71fc80a9-268f-4bc4-acd7-c576937def17 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:50:23 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-71fc80a9-268f-4bc4-acd7-c576937def17 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:50:23 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-71fc80a9-268f-4bc4-acd7-c576937def17 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:50:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-71fc80a9-268f-4bc4-acd7-c576937def17 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:50:23 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-71fc80a9-268f-4bc4-acd7-c576937def17 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:50:23 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-71fc80a9-268f-4bc4-acd7-c576937def17 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:50:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-71fc80a9-268f-4bc4-acd7-c576937def17 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-16a8921d-20c4-45cb-ae14-9b66b69ae2fd 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-45de744c-45e7-4f05-a1b1-aa9a708fcde1 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e9c550c-a7b0-490d-9b02-efc509dfb21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-520240ce-7378-4a68-ac39-83b1d8f158d7', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:50:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-45de744c-45e7-4f05-a1b1-aa9a708fcde1 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a15108aa-e4b5-4c82-826e-43535aa64d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:50:23 devstack sudo[109290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-16a8921d-20c4-45cb-ae14-9b66b69ae2fd 1073741824 Aug 11 04:50:23 devstack sudo[109290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:23 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-45de744c-45e7-4f05-a1b1-aa9a708fcde1 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Volume volume-520240ce-7378-4a68-ac39-83b1d8f158d7 (520240ce-7378-4a68-ac39-83b1d8f158d7): created successfully Aug 11 04:50:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-45de744c-45e7-4f05-a1b1-aa9a708fcde1 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a15108aa-e4b5-4c82-826e-43535aa64d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:50:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-45de744c-45e7-4f05-a1b1-aa9a708fcde1 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Flow 'volume_create_manager' (8aebc618-c168-4538-b488-e749f2842e17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:50:23 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-45de744c-45e7-4f05-a1b1-aa9a708fcde1 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Created volume successfully. Aug 11 04:50:23 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8c5c989-133b-4fd7-94d2-214328b7d52b tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:50:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f8c5c989-133b-4fd7-94d2-214328b7d52b tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Flow 'volume_create_manager' (6a5484ab-0517-48a8-9c55-60b08b509ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:50:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f8c5c989-133b-4fd7-94d2-214328b7d52b tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f539b58-4c1a-42f3-add9-d7d80ffbb2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:50:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f8c5c989-133b-4fd7-94d2-214328b7d52b tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f539b58-4c1a-42f3-add9-d7d80ffbb2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:50:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-922951031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de9a13a3-687d-468d-a06c-60b1bcc2075e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2aeef6d30c4fd4b8e5c36aed747763',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:50:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:50:24Z,use_quota=True,user_id='3719f99cf10d4d1db62ed9ab0dd070fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:50:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f8c5c989-133b-4fd7-94d2-214328b7d52b tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (119eac44-c574-458c-a69e-035ba00babbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:50:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f8c5c989-133b-4fd7-94d2-214328b7d52b tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (119eac44-c574-458c-a69e-035ba00babbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:50:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f8c5c989-133b-4fd7-94d2-214328b7d52b tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (898f9062-cac0-4d65-bd50-92795124c120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:50:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f8c5c989-133b-4fd7-94d2-214328b7d52b tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (898f9062-cac0-4d65-bd50-92795124c120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de9a13a3-687d-468d-a06c-60b1bcc2075e', 'volume_name': 'volume-de9a13a3-687d-468d-a06c-60b1bcc2075e', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:50:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f8c5c989-133b-4fd7-94d2-214328b7d52b tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12522ed6-4b65-44ec-b4c6-9ad4a965329a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:50:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f8c5c989-133b-4fd7-94d2-214328b7d52b tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12522ed6-4b65-44ec-b4c6-9ad4a965329a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:50:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f8c5c989-133b-4fd7-94d2-214328b7d52b tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e391454-63bd-4fad-a1bf-2e234c2a8ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:50:23 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-f8c5c989-133b-4fd7-94d2-214328b7d52b tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Volume de9a13a3-687d-468d-a06c-60b1bcc2075e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de9a13a3-687d-468d-a06c-60b1bcc2075e', 'volume_size': 1} Aug 11 04:50:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f8c5c989-133b-4fd7-94d2-214328b7d52b tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:50:23 devstack sudo[109290]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-71fc80a9-268f-4bc4-acd7-c576937def17 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-16a8921d-20c4-45cb-ae14-9b66b69ae2fd 1073741824" returned: 0 in 0.505s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-71fc80a9-268f-4bc4-acd7-c576937def17 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-16a8921d-20c4-45cb-ae14-9b66b69ae2fd {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:23 devstack sudo[109296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-16a8921d-20c4-45cb-ae14-9b66b69ae2fd Aug 11 04:50:23 devstack sudo[109296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:24 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a7f45cc-3186-46d4-9814-cb51869386bb tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:50:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1a7f45cc-3186-46d4-9814-cb51869386bb tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Flow 'volume_create_manager' (ffd49cad-91ad-429d-b24b-bbf1bc5471e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:50:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1a7f45cc-3186-46d4-9814-cb51869386bb tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f334f6f0-6157-4150-afed-ebdf3933b28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:50:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1a7f45cc-3186-46d4-9814-cb51869386bb tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f334f6f0-6157-4150-afed-ebdf3933b28b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:50:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-940220919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d7df348-86eb-4bb1-accb-4715e768f0af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2aeef6d30c4fd4b8e5c36aed747763',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:50:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:50:24Z,use_quota=True,user_id='3719f99cf10d4d1db62ed9ab0dd070fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:50:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1a7f45cc-3186-46d4-9814-cb51869386bb tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e25b187e-e3c6-4b4b-8e9f-e08d8ff5c30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:50:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1a7f45cc-3186-46d4-9814-cb51869386bb tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e25b187e-e3c6-4b4b-8e9f-e08d8ff5c30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:50:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1a7f45cc-3186-46d4-9814-cb51869386bb tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d452f38-94d4-4cf0-9b80-b0526e0543bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:50:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1a7f45cc-3186-46d4-9814-cb51869386bb tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d452f38-94d4-4cf0-9b80-b0526e0543bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d7df348-86eb-4bb1-accb-4715e768f0af', 'volume_name': 'volume-7d7df348-86eb-4bb1-accb-4715e768f0af', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:50:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1a7f45cc-3186-46d4-9814-cb51869386bb tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ba3fc2e-76fc-4472-a28f-038af5eb4f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:50:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1a7f45cc-3186-46d4-9814-cb51869386bb tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ba3fc2e-76fc-4472-a28f-038af5eb4f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:50:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1a7f45cc-3186-46d4-9814-cb51869386bb tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cf1b8b4-5783-4cab-a48d-996c48130c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:50:24 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-1a7f45cc-3186-46d4-9814-cb51869386bb tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Volume 7d7df348-86eb-4bb1-accb-4715e768f0af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d7df348-86eb-4bb1-accb-4715e768f0af', 'volume_size': 1} Aug 11 04:50:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1a7f45cc-3186-46d4-9814-cb51869386bb tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:50:24 devstack sudo[109296]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-71fc80a9-268f-4bc4-acd7-c576937def17 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-16a8921d-20c4-45cb-ae14-9b66b69ae2fd" returned: 0 in 0.264s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-71fc80a9-268f-4bc4-acd7-c576937def17 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:50:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-71fc80a9-268f-4bc4-acd7-c576937def17 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:50:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2c0ad275-90a1-4c1c-ad5b-0a689c3d02e2 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.878s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:50:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2c0ad275-90a1-4c1c-ad5b-0a689c3d02e2 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:50:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-150034738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b04dcb4-7a2a-4d60-afb6-0166486ccd57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2aeef6d30c4fd4b8e5c36aed747763',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:50:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:50:23Z,use_quota=True,user_id='3719f99cf10d4d1db62ed9ab0dd070fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:50:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-2c0ad275-90a1-4c1c-ad5b-0a689c3d02e2 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Creating volume 1b04dcb4-7a2a-4d60-afb6-0166486ccd57 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:50:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2c0ad275-90a1-4c1c-ad5b-0a689c3d02e2 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:50:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2c0ad275-90a1-4c1c-ad5b-0a689c3d02e2 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:50:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2c0ad275-90a1-4c1c-ad5b-0a689c3d02e2 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:50:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2c0ad275-90a1-4c1c-ad5b-0a689c3d02e2 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:50:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2c0ad275-90a1-4c1c-ad5b-0a689c3d02e2 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:50:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2c0ad275-90a1-4c1c-ad5b-0a689c3d02e2 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:50:24 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-2c0ad275-90a1-4c1c-ad5b-0a689c3d02e2 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:50:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2c0ad275-90a1-4c1c-ad5b-0a689c3d02e2 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1b04dcb4-7a2a-4d60-afb6-0166486ccd57 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-71fc80a9-268f-4bc4-acd7-c576937def17 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ebc0e2d-fdce-42ee-a83e-801e507580e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16a8921d-20c4-45cb-ae14-9b66b69ae2fd', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:50:24 devstack sudo[109299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1b04dcb4-7a2a-4d60-afb6-0166486ccd57 1073741824 Aug 11 04:50:24 devstack sudo[109299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-71fc80a9-268f-4bc4-acd7-c576937def17 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e587248-cc5f-4938-8ab1-b3ffac7e6198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:50:24 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-71fc80a9-268f-4bc4-acd7-c576937def17 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Volume volume-16a8921d-20c4-45cb-ae14-9b66b69ae2fd (16a8921d-20c4-45cb-ae14-9b66b69ae2fd): created successfully Aug 11 04:50:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-71fc80a9-268f-4bc4-acd7-c576937def17 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e587248-cc5f-4938-8ab1-b3ffac7e6198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:50:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-71fc80a9-268f-4bc4-acd7-c576937def17 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Flow 'volume_create_manager' (884ac184-5c42-4265-b25e-0ac1b46c3406) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:50:24 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-71fc80a9-268f-4bc4-acd7-c576937def17 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Created volume successfully. Aug 11 04:50:24 devstack sudo[109299]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2c0ad275-90a1-4c1c-ad5b-0a689c3d02e2 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1b04dcb4-7a2a-4d60-afb6-0166486ccd57 1073741824" returned: 0 in 0.417s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2c0ad275-90a1-4c1c-ad5b-0a689c3d02e2 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1b04dcb4-7a2a-4d60-afb6-0166486ccd57 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:24 devstack sudo[109310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1b04dcb4-7a2a-4d60-afb6-0166486ccd57 Aug 11 04:50:24 devstack sudo[109310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:24 devstack sudo[109310]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2c0ad275-90a1-4c1c-ad5b-0a689c3d02e2 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1b04dcb4-7a2a-4d60-afb6-0166486ccd57" returned: 0 in 0.251s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2c0ad275-90a1-4c1c-ad5b-0a689c3d02e2 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:50:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2c0ad275-90a1-4c1c-ad5b-0a689c3d02e2 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:50:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f8c5c989-133b-4fd7-94d2-214328b7d52b tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.166s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:50:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f8c5c989-133b-4fd7-94d2-214328b7d52b tempest-CreateVolumesFromSourceVolumeTest-677127951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:50:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-922951031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de9a13a3-687d-468d-a06c-60b1bcc2075e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2aeef6d30c4fd4b8e5c36aed747763',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:50:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:50:24Z,use_quota=True,user_id='3719f99cf10d4d1db62ed9ab0dd070fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:50:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-f8c5c989-133b-4fd7-94d2-214328b7d52b tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Creating volume de9a13a3-687d-468d-a06c-60b1bcc2075e {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:50:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f8c5c989-133b-4fd7-94d2-214328b7d52b tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:50:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f8c5c989-133b-4fd7-94d2-214328b7d52b tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:50:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f8c5c989-133b-4fd7-94d2-214328b7d52b tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:50:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f8c5c989-133b-4fd7-94d2-214328b7d52b tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:50:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f8c5c989-133b-4fd7-94d2-214328b7d52b tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:50:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f8c5c989-133b-4fd7-94d2-214328b7d52b tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:50:24 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-f8c5c989-133b-4fd7-94d2-214328b7d52b tempest-CreateVolumesFromSourceVolumeTest-677127951 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:50:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f8c5c989-133b-4fd7-94d2-214328b7d52b tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-de9a13a3-687d-468d-a06c-60b1bcc2075e 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2c0ad275-90a1-4c1c-ad5b-0a689c3d02e2 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeac2cc2-b83b-49dc-8359-e4b2b8dbf95a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b04dcb4-7a2a-4d60-afb6-0166486ccd57', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:50:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2c0ad275-90a1-4c1c-ad5b-0a689c3d02e2 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f936c43-f9f8-498b-9327-6b035a09f591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:50:24 devstack sudo[109313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-de9a13a3-687d-468d-a06c-60b1bcc2075e 1073741824 Aug 11 04:50:24 devstack sudo[109313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:24 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-2c0ad275-90a1-4c1c-ad5b-0a689c3d02e2 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Volume volume-1b04dcb4-7a2a-4d60-afb6-0166486ccd57 (1b04dcb4-7a2a-4d60-afb6-0166486ccd57): created successfully Aug 11 04:50:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2c0ad275-90a1-4c1c-ad5b-0a689c3d02e2 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f936c43-f9f8-498b-9327-6b035a09f591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:50:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2c0ad275-90a1-4c1c-ad5b-0a689c3d02e2 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Flow 'volume_create_manager' (8184d6dd-bb9a-4c55-b381-14ce813c47c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:50:24 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-2c0ad275-90a1-4c1c-ad5b-0a689c3d02e2 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Created volume successfully. Aug 11 04:50:25 devstack sudo[109313]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f8c5c989-133b-4fd7-94d2-214328b7d52b tempest-CreateVolumesFromSourceVolumeTest-677127951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-de9a13a3-687d-468d-a06c-60b1bcc2075e 1073741824" returned: 0 in 0.445s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f8c5c989-133b-4fd7-94d2-214328b7d52b tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-de9a13a3-687d-468d-a06c-60b1bcc2075e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:25 devstack sudo[109319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-de9a13a3-687d-468d-a06c-60b1bcc2075e Aug 11 04:50:25 devstack sudo[109319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:25 devstack sudo[109319]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f8c5c989-133b-4fd7-94d2-214328b7d52b tempest-CreateVolumesFromSourceVolumeTest-677127951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-de9a13a3-687d-468d-a06c-60b1bcc2075e" returned: 0 in 0.240s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:25 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f8c5c989-133b-4fd7-94d2-214328b7d52b tempest-CreateVolumesFromSourceVolumeTest-677127951 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:50:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f8c5c989-133b-4fd7-94d2-214328b7d52b tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:50:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1a7f45cc-3186-46d4-9814-cb51869386bb tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.543s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:50:25 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1a7f45cc-3186-46d4-9814-cb51869386bb tempest-CreateVolumesFromSourceVolumeTest-677127951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:50:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-940220919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d7df348-86eb-4bb1-accb-4715e768f0af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2aeef6d30c4fd4b8e5c36aed747763',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:50:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:50:24Z,use_quota=True,user_id='3719f99cf10d4d1db62ed9ab0dd070fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:50:25 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-1a7f45cc-3186-46d4-9814-cb51869386bb tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Creating volume 7d7df348-86eb-4bb1-accb-4715e768f0af {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:50:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1a7f45cc-3186-46d4-9814-cb51869386bb tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:50:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1a7f45cc-3186-46d4-9814-cb51869386bb tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:50:25 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1a7f45cc-3186-46d4-9814-cb51869386bb tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:50:25 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1a7f45cc-3186-46d4-9814-cb51869386bb tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:50:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1a7f45cc-3186-46d4-9814-cb51869386bb tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:50:25 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1a7f45cc-3186-46d4-9814-cb51869386bb tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:50:25 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-1a7f45cc-3186-46d4-9814-cb51869386bb tempest-CreateVolumesFromSourceVolumeTest-677127951 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:50:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1a7f45cc-3186-46d4-9814-cb51869386bb tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7d7df348-86eb-4bb1-accb-4715e768f0af 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:25 devstack sudo[109322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7d7df348-86eb-4bb1-accb-4715e768f0af 1073741824 Aug 11 04:50:25 devstack sudo[109322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:25 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f8c5c989-133b-4fd7-94d2-214328b7d52b tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e391454-63bd-4fad-a1bf-2e234c2a8ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de9a13a3-687d-468d-a06c-60b1bcc2075e', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:50:25 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f8c5c989-133b-4fd7-94d2-214328b7d52b tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f8e1a5f-cf97-4105-a64a-85835b55d134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:50:25 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-f8c5c989-133b-4fd7-94d2-214328b7d52b tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Volume volume-de9a13a3-687d-468d-a06c-60b1bcc2075e (de9a13a3-687d-468d-a06c-60b1bcc2075e): created successfully Aug 11 04:50:25 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f8c5c989-133b-4fd7-94d2-214328b7d52b tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f8e1a5f-cf97-4105-a64a-85835b55d134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:50:25 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f8c5c989-133b-4fd7-94d2-214328b7d52b tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Flow 'volume_create_manager' (6a5484ab-0517-48a8-9c55-60b08b509ec5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:50:25 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-f8c5c989-133b-4fd7-94d2-214328b7d52b tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Created volume successfully. Aug 11 04:50:26 devstack sudo[109322]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1a7f45cc-3186-46d4-9814-cb51869386bb tempest-CreateVolumesFromSourceVolumeTest-677127951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7d7df348-86eb-4bb1-accb-4715e768f0af 1073741824" returned: 0 in 0.424s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1a7f45cc-3186-46d4-9814-cb51869386bb tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7d7df348-86eb-4bb1-accb-4715e768f0af {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:26 devstack sudo[109328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7d7df348-86eb-4bb1-accb-4715e768f0af Aug 11 04:50:26 devstack sudo[109328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:26 devstack sudo[109328]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1a7f45cc-3186-46d4-9814-cb51869386bb tempest-CreateVolumesFromSourceVolumeTest-677127951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7d7df348-86eb-4bb1-accb-4715e768f0af" returned: 0 in 0.246s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:26 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1a7f45cc-3186-46d4-9814-cb51869386bb tempest-CreateVolumesFromSourceVolumeTest-677127951 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:50:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1a7f45cc-3186-46d4-9814-cb51869386bb tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:50:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1a7f45cc-3186-46d4-9814-cb51869386bb tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cf1b8b4-5783-4cab-a48d-996c48130c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d7df348-86eb-4bb1-accb-4715e768f0af', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:50:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1a7f45cc-3186-46d4-9814-cb51869386bb tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95b6f4b3-dc94-4901-955a-41c28d781109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:50:26 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-1a7f45cc-3186-46d4-9814-cb51869386bb tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Volume volume-7d7df348-86eb-4bb1-accb-4715e768f0af (7d7df348-86eb-4bb1-accb-4715e768f0af): created successfully Aug 11 04:50:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1a7f45cc-3186-46d4-9814-cb51869386bb tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95b6f4b3-dc94-4901-955a-41c28d781109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:50:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1a7f45cc-3186-46d4-9814-cb51869386bb tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Flow 'volume_create_manager' (ffd49cad-91ad-429d-b24b-bbf1bc5471e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:50:26 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-1a7f45cc-3186-46d4-9814-cb51869386bb tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Created volume successfully. Aug 11 04:50:27 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bc940cbb-df7c-44a7-b6d1-78c9b0bb2694 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Acquiring lock "cinder-7d7df348-86eb-4bb1-accb-4715e768f0af-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:50:27 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bc940cbb-df7c-44a7-b6d1-78c9b0bb2694 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "cinder-7d7df348-86eb-4bb1-accb-4715e768f0af-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:50:27 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bc940cbb-df7c-44a7-b6d1-78c9b0bb2694 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Acquiring lock "cinder-quobyte-7d7df348-86eb-4bb1-accb-4715e768f0af" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:50:27 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bc940cbb-df7c-44a7-b6d1-78c9b0bb2694 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "cinder-quobyte-7d7df348-86eb-4bb1-accb-4715e768f0af" acquired by "delete_volume" :: waited 0.016s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:50:27 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5196067-6d7a-4167-ba21-25548f9768d1]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:50:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bc940cbb-df7c-44a7-b6d1-78c9b0bb2694 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7d7df348-86eb-4bb1-accb-4715e768f0af {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:27 devstack sudo[109331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7d7df348-86eb-4bb1-accb-4715e768f0af Aug 11 04:50:27 devstack sudo[109331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:27 devstack sudo[109331]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bc940cbb-df7c-44a7-b6d1-78c9b0bb2694 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7d7df348-86eb-4bb1-accb-4715e768f0af" returned: 0 in 0.356s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bc940cbb-df7c-44a7-b6d1-78c9b0bb2694 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7d7df348-86eb-4bb1-accb-4715e768f0af {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:27 devstack sudo[109336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7d7df348-86eb-4bb1-accb-4715e768f0af Aug 11 04:50:27 devstack sudo[109336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:28 devstack sudo[109336]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bc940cbb-df7c-44a7-b6d1-78c9b0bb2694 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7d7df348-86eb-4bb1-accb-4715e768f0af" returned: 0 in 0.250s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:28 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bc940cbb-df7c-44a7-b6d1-78c9b0bb2694 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "cinder-quobyte-7d7df348-86eb-4bb1-accb-4715e768f0af" released by "delete_volume" :: held 0.647s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:50:28 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-bc940cbb-df7c-44a7-b6d1-78c9b0bb2694 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Created reservations ['92eff477-4113-42c5-bb9b-68e57cd5a990', 'f84489bc-10a7-4724-a3ee-527619b51ce5', 'cd022a3a-6b63-4d5e-8e58-41af59aadd3b', '42af9524-1de4-4e37-87d2-ae1f191e3206'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:50:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bc940cbb-df7c-44a7-b6d1-78c9b0bb2694 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:50:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bc940cbb-df7c-44a7-b6d1-78c9b0bb2694 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:50:28 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-bc940cbb-df7c-44a7-b6d1-78c9b0bb2694 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:50:28 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-bc940cbb-df7c-44a7-b6d1-78c9b0bb2694 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:50:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bc940cbb-df7c-44a7-b6d1-78c9b0bb2694 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:50:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bc940cbb-df7c-44a7-b6d1-78c9b0bb2694 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:28 devstack sudo[109339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:50:28 devstack sudo[109339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:28 devstack sudo[109339]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bc940cbb-df7c-44a7-b6d1-78c9b0bb2694 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.259s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:28 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-bc940cbb-df7c-44a7-b6d1-78c9b0bb2694 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:50:28 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-bc940cbb-df7c-44a7-b6d1-78c9b0bb2694 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Deleted volume successfully. Aug 11 04:50:28 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bc940cbb-df7c-44a7-b6d1-78c9b0bb2694 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "cinder-7d7df348-86eb-4bb1-accb-4715e768f0af-delete_volume" released by "delete_volume" :: held 1.106s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:50:28 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9f37c11a-df27-4f97-8d95-bf6fb069ca15 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Acquiring lock "cinder-de9a13a3-687d-468d-a06c-60b1bcc2075e-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:50:28 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9f37c11a-df27-4f97-8d95-bf6fb069ca15 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "cinder-de9a13a3-687d-468d-a06c-60b1bcc2075e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:50:28 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9f37c11a-df27-4f97-8d95-bf6fb069ca15 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Acquiring lock "cinder-quobyte-de9a13a3-687d-468d-a06c-60b1bcc2075e" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:50:28 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9f37c11a-df27-4f97-8d95-bf6fb069ca15 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "cinder-quobyte-de9a13a3-687d-468d-a06c-60b1bcc2075e" acquired by "delete_volume" :: waited 0.020s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:50:28 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[452bdb8b-93e7-4e7e-8382-96e0f1317b2a]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:50:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9f37c11a-df27-4f97-8d95-bf6fb069ca15 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-de9a13a3-687d-468d-a06c-60b1bcc2075e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:28 devstack sudo[109342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-de9a13a3-687d-468d-a06c-60b1bcc2075e Aug 11 04:50:28 devstack sudo[109342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:29 devstack sudo[109342]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9f37c11a-df27-4f97-8d95-bf6fb069ca15 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-de9a13a3-687d-468d-a06c-60b1bcc2075e" returned: 0 in 0.380s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9f37c11a-df27-4f97-8d95-bf6fb069ca15 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-de9a13a3-687d-468d-a06c-60b1bcc2075e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:29 devstack sudo[109347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-de9a13a3-687d-468d-a06c-60b1bcc2075e Aug 11 04:50:29 devstack sudo[109347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:29 devstack sudo[109347]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9f37c11a-df27-4f97-8d95-bf6fb069ca15 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-de9a13a3-687d-468d-a06c-60b1bcc2075e" returned: 0 in 0.254s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:29 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9f37c11a-df27-4f97-8d95-bf6fb069ca15 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "cinder-quobyte-de9a13a3-687d-468d-a06c-60b1bcc2075e" released by "delete_volume" :: held 0.686s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:50:29 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-9f37c11a-df27-4f97-8d95-bf6fb069ca15 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Created reservations ['5acf6374-6136-47d3-95a2-2b646270c490', '0f80ad9f-a34e-4945-97cb-85c1ed5d9774', 'e31c6797-a997-4998-be67-7693c7e37f85', '42a06ad2-6608-4375-89fe-93b37d490aba'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:50:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9f37c11a-df27-4f97-8d95-bf6fb069ca15 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:50:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9f37c11a-df27-4f97-8d95-bf6fb069ca15 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:50:29 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9f37c11a-df27-4f97-8d95-bf6fb069ca15 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:50:29 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9f37c11a-df27-4f97-8d95-bf6fb069ca15 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:50:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9f37c11a-df27-4f97-8d95-bf6fb069ca15 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:50:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9f37c11a-df27-4f97-8d95-bf6fb069ca15 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:29 devstack sudo[109350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:50:29 devstack sudo[109350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:29 devstack sudo[109350]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9f37c11a-df27-4f97-8d95-bf6fb069ca15 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.252s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:29 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-9f37c11a-df27-4f97-8d95-bf6fb069ca15 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:50:29 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-9f37c11a-df27-4f97-8d95-bf6fb069ca15 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Deleted volume successfully. Aug 11 04:50:29 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9f37c11a-df27-4f97-8d95-bf6fb069ca15 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "cinder-de9a13a3-687d-468d-a06c-60b1bcc2075e-delete_volume" released by "delete_volume" :: held 1.145s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:50:29 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-534b358d-dfa2-4ffb-8f05-7c63f3b58080 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Acquiring lock "cinder-1b04dcb4-7a2a-4d60-afb6-0166486ccd57-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:50:29 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-534b358d-dfa2-4ffb-8f05-7c63f3b58080 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "cinder-1b04dcb4-7a2a-4d60-afb6-0166486ccd57-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:50:29 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-534b358d-dfa2-4ffb-8f05-7c63f3b58080 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Acquiring lock "cinder-quobyte-1b04dcb4-7a2a-4d60-afb6-0166486ccd57" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:50:29 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-534b358d-dfa2-4ffb-8f05-7c63f3b58080 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "cinder-quobyte-1b04dcb4-7a2a-4d60-afb6-0166486ccd57" acquired by "delete_volume" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:50:29 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d7f07b-9ffb-402a-b5df-b3419047b48a]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:50:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-534b358d-dfa2-4ffb-8f05-7c63f3b58080 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1b04dcb4-7a2a-4d60-afb6-0166486ccd57 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:30 devstack sudo[109353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1b04dcb4-7a2a-4d60-afb6-0166486ccd57 Aug 11 04:50:30 devstack sudo[109353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:30 devstack sudo[109353]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-534b358d-dfa2-4ffb-8f05-7c63f3b58080 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1b04dcb4-7a2a-4d60-afb6-0166486ccd57" returned: 0 in 0.376s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-534b358d-dfa2-4ffb-8f05-7c63f3b58080 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1b04dcb4-7a2a-4d60-afb6-0166486ccd57 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:30 devstack sudo[109358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1b04dcb4-7a2a-4d60-afb6-0166486ccd57 Aug 11 04:50:30 devstack sudo[109358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:30 devstack sudo[109358]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-534b358d-dfa2-4ffb-8f05-7c63f3b58080 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1b04dcb4-7a2a-4d60-afb6-0166486ccd57" returned: 0 in 0.242s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-534b358d-dfa2-4ffb-8f05-7c63f3b58080 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "cinder-quobyte-1b04dcb4-7a2a-4d60-afb6-0166486ccd57" released by "delete_volume" :: held 0.662s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:50:30 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-534b358d-dfa2-4ffb-8f05-7c63f3b58080 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Created reservations ['8cd95337-af86-47dd-ac68-d51fa8cb6ce3', '766ba1a6-d6c1-4244-bb69-3a935fff1f5d', '42a0fb48-03c4-42a6-b0dd-f38e438d6342', 'e9aa0b13-b6d9-4744-b8b3-f2a2dd9ea861'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:50:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-534b358d-dfa2-4ffb-8f05-7c63f3b58080 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:50:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-534b358d-dfa2-4ffb-8f05-7c63f3b58080 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:50:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-534b358d-dfa2-4ffb-8f05-7c63f3b58080 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:50:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-534b358d-dfa2-4ffb-8f05-7c63f3b58080 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:50:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-534b358d-dfa2-4ffb-8f05-7c63f3b58080 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:50:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-534b358d-dfa2-4ffb-8f05-7c63f3b58080 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:30 devstack sudo[109361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:50:30 devstack sudo[109361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:30 devstack sudo[109361]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-534b358d-dfa2-4ffb-8f05-7c63f3b58080 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.250s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:30 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-534b358d-dfa2-4ffb-8f05-7c63f3b58080 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:50:30 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-534b358d-dfa2-4ffb-8f05-7c63f3b58080 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Deleted volume successfully. Aug 11 04:50:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-534b358d-dfa2-4ffb-8f05-7c63f3b58080 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "cinder-1b04dcb4-7a2a-4d60-afb6-0166486ccd57-delete_volume" released by "delete_volume" :: held 1.110s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:50:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-58970a9d-377b-4319-8f79-7b5c4d185a27 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Acquiring lock "cinder-16a8921d-20c4-45cb-ae14-9b66b69ae2fd-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:50:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-58970a9d-377b-4319-8f79-7b5c4d185a27 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "cinder-16a8921d-20c4-45cb-ae14-9b66b69ae2fd-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:50:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-58970a9d-377b-4319-8f79-7b5c4d185a27 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Acquiring lock "cinder-quobyte-16a8921d-20c4-45cb-ae14-9b66b69ae2fd" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:50:31 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-58970a9d-377b-4319-8f79-7b5c4d185a27 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "cinder-quobyte-16a8921d-20c4-45cb-ae14-9b66b69ae2fd" acquired by "delete_volume" :: waited 0.015s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:50:31 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec57b51-98c2-4347-9fda-0af246072270]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:50:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-58970a9d-377b-4319-8f79-7b5c4d185a27 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-16a8921d-20c4-45cb-ae14-9b66b69ae2fd {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:31 devstack sudo[109364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-16a8921d-20c4-45cb-ae14-9b66b69ae2fd Aug 11 04:50:31 devstack sudo[109364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:31 devstack sudo[109364]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-58970a9d-377b-4319-8f79-7b5c4d185a27 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-16a8921d-20c4-45cb-ae14-9b66b69ae2fd" returned: 0 in 0.354s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-58970a9d-377b-4319-8f79-7b5c4d185a27 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-16a8921d-20c4-45cb-ae14-9b66b69ae2fd {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:31 devstack sudo[109369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-16a8921d-20c4-45cb-ae14-9b66b69ae2fd Aug 11 04:50:31 devstack sudo[109369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:31 devstack sudo[109369]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-58970a9d-377b-4319-8f79-7b5c4d185a27 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-16a8921d-20c4-45cb-ae14-9b66b69ae2fd" returned: 0 in 0.239s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:31 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-58970a9d-377b-4319-8f79-7b5c4d185a27 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "cinder-quobyte-16a8921d-20c4-45cb-ae14-9b66b69ae2fd" released by "delete_volume" :: held 0.634s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:50:31 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-58970a9d-377b-4319-8f79-7b5c4d185a27 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Created reservations ['6a3f2ecd-3a40-43bc-acc9-18867f5de230', '7b9c2c03-c922-428b-9dcc-6d7c3bb63bf8', '334323b5-dbea-4d66-8c7c-f260e2b0fec9', '5a7a2b4a-955b-4919-94cc-c33f65885d5b'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:50:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-58970a9d-377b-4319-8f79-7b5c4d185a27 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:50:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-58970a9d-377b-4319-8f79-7b5c4d185a27 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:50:31 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-58970a9d-377b-4319-8f79-7b5c4d185a27 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:50:31 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-58970a9d-377b-4319-8f79-7b5c4d185a27 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:50:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-58970a9d-377b-4319-8f79-7b5c4d185a27 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:50:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-58970a9d-377b-4319-8f79-7b5c4d185a27 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:31 devstack sudo[109372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:50:31 devstack sudo[109372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:32 devstack sudo[109372]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-58970a9d-377b-4319-8f79-7b5c4d185a27 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.275s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:32 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-58970a9d-377b-4319-8f79-7b5c4d185a27 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:50:32 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-58970a9d-377b-4319-8f79-7b5c4d185a27 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Deleted volume successfully. Aug 11 04:50:32 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-58970a9d-377b-4319-8f79-7b5c4d185a27 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "cinder-16a8921d-20c4-45cb-ae14-9b66b69ae2fd-delete_volume" released by "delete_volume" :: held 1.108s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:50:32 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b3177d6a-fe46-4b02-a433-1e655d7b8c28 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Acquiring lock "cinder-520240ce-7378-4a68-ac39-83b1d8f158d7-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:50:32 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b3177d6a-fe46-4b02-a433-1e655d7b8c28 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "cinder-520240ce-7378-4a68-ac39-83b1d8f158d7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:50:32 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b3177d6a-fe46-4b02-a433-1e655d7b8c28 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Acquiring lock "cinder-quobyte-520240ce-7378-4a68-ac39-83b1d8f158d7" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:50:32 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b3177d6a-fe46-4b02-a433-1e655d7b8c28 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "cinder-quobyte-520240ce-7378-4a68-ac39-83b1d8f158d7" acquired by "delete_volume" :: waited 0.016s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:50:32 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[f240119f-0a07-44fb-9a34-0b84a3d11d2e]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:50:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b3177d6a-fe46-4b02-a433-1e655d7b8c28 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-520240ce-7378-4a68-ac39-83b1d8f158d7 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:32 devstack sudo[109377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-520240ce-7378-4a68-ac39-83b1d8f158d7 Aug 11 04:50:32 devstack sudo[109377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:32 devstack sudo[109377]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b3177d6a-fe46-4b02-a433-1e655d7b8c28 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-520240ce-7378-4a68-ac39-83b1d8f158d7" returned: 0 in 0.375s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b3177d6a-fe46-4b02-a433-1e655d7b8c28 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-520240ce-7378-4a68-ac39-83b1d8f158d7 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:32 devstack sudo[109382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-520240ce-7378-4a68-ac39-83b1d8f158d7 Aug 11 04:50:32 devstack sudo[109382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:32 devstack sudo[109382]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b3177d6a-fe46-4b02-a433-1e655d7b8c28 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-520240ce-7378-4a68-ac39-83b1d8f158d7" returned: 0 in 0.261s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:32 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b3177d6a-fe46-4b02-a433-1e655d7b8c28 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "cinder-quobyte-520240ce-7378-4a68-ac39-83b1d8f158d7" released by "delete_volume" :: held 0.687s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:50:32 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-b3177d6a-fe46-4b02-a433-1e655d7b8c28 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Created reservations ['4820e821-a9e0-4063-8756-e50d26641921', '3cdd39ee-9fb9-4cf7-9423-b5627e14f204', '3a0b6708-b15e-47e3-b5e0-997d153e387a', '2346fbb4-0828-4856-9617-a3f83b4a8c7b'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:50:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b3177d6a-fe46-4b02-a433-1e655d7b8c28 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:50:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b3177d6a-fe46-4b02-a433-1e655d7b8c28 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:50:33 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b3177d6a-fe46-4b02-a433-1e655d7b8c28 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:50:33 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b3177d6a-fe46-4b02-a433-1e655d7b8c28 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:50:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b3177d6a-fe46-4b02-a433-1e655d7b8c28 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:50:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b3177d6a-fe46-4b02-a433-1e655d7b8c28 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:33 devstack sudo[109385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:50:33 devstack sudo[109385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:33 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bd7cd11-7244-45fc-aadb-6db260a0ace9 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:50:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0bd7cd11-7244-45fc-aadb-6db260a0ace9 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] Flow 'volume_create_manager' (ca0f4c68-6436-4eb1-8768-7d2026a8a045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:50:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0bd7cd11-7244-45fc-aadb-6db260a0ace9 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d78a6df5-db62-4930-bf27-16ba5a0ca33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:50:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0bd7cd11-7244-45fc-aadb-6db260a0ace9 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d78a6df5-db62-4930-bf27-16ba5a0ca33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1872661998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4882446-6151-4efb-a599-803fc938b996,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cb30f9e24d24adc95c9a05d495fec2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:50:33Z,use_quota=True,user_id='aa1887f3c74f405e971831437ac43159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:50:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0bd7cd11-7244-45fc-aadb-6db260a0ace9 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9aef7bd-b4a4-4d55-a139-44b746b8d136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:50:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0bd7cd11-7244-45fc-aadb-6db260a0ace9 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9aef7bd-b4a4-4d55-a139-44b746b8d136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:50:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0bd7cd11-7244-45fc-aadb-6db260a0ace9 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89929007-882f-4cbc-83d0-773ca9e547b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:50:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0bd7cd11-7244-45fc-aadb-6db260a0ace9 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89929007-882f-4cbc-83d0-773ca9e547b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4882446-6151-4efb-a599-803fc938b996', 'volume_name': 'volume-c4882446-6151-4efb-a599-803fc938b996', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:50:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0bd7cd11-7244-45fc-aadb-6db260a0ace9 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f19c0206-e5f3-44e5-9bf3-19e3ace9d565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:50:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0bd7cd11-7244-45fc-aadb-6db260a0ace9 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f19c0206-e5f3-44e5-9bf3-19e3ace9d565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:50:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0bd7cd11-7244-45fc-aadb-6db260a0ace9 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a0a48b9-3ddc-4e6c-b185-05da76721482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:50:33 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-0bd7cd11-7244-45fc-aadb-6db260a0ace9 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] Volume c4882446-6151-4efb-a599-803fc938b996: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4882446-6151-4efb-a599-803fc938b996', 'volume_size': 1} Aug 11 04:50:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0bd7cd11-7244-45fc-aadb-6db260a0ace9 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:50:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0bd7cd11-7244-45fc-aadb-6db260a0ace9 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:50:33 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0bd7cd11-7244-45fc-aadb-6db260a0ace9 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1872661998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4882446-6151-4efb-a599-803fc938b996,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cb30f9e24d24adc95c9a05d495fec2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:50:33Z,use_quota=True,user_id='aa1887f3c74f405e971831437ac43159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:50:33 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-0bd7cd11-7244-45fc-aadb-6db260a0ace9 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] Creating volume c4882446-6151-4efb-a599-803fc938b996 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:50:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0bd7cd11-7244-45fc-aadb-6db260a0ace9 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:50:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0bd7cd11-7244-45fc-aadb-6db260a0ace9 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:50:33 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0bd7cd11-7244-45fc-aadb-6db260a0ace9 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:50:33 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0bd7cd11-7244-45fc-aadb-6db260a0ace9 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:50:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0bd7cd11-7244-45fc-aadb-6db260a0ace9 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:50:33 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0bd7cd11-7244-45fc-aadb-6db260a0ace9 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:50:33 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-0bd7cd11-7244-45fc-aadb-6db260a0ace9 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:50:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0bd7cd11-7244-45fc-aadb-6db260a0ace9 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c4882446-6151-4efb-a599-803fc938b996 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8109fb98-a082-4a4e-9d8f-7931b9adb83f tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Acquiring lock "cinder-38b93c3e-12d0-4e23-8f5e-e7b48d9cdacb-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:50:33 devstack sudo[109389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c4882446-6151-4efb-a599-803fc938b996 1073741824 Aug 11 04:50:33 devstack sudo[109385]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:33 devstack sudo[109389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b3177d6a-fe46-4b02-a433-1e655d7b8c28 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.276s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:33 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-b3177d6a-fe46-4b02-a433-1e655d7b8c28 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:50:33 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-b3177d6a-fe46-4b02-a433-1e655d7b8c28 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Deleted volume successfully. Aug 11 04:50:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8109fb98-a082-4a4e-9d8f-7931b9adb83f tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "cinder-38b93c3e-12d0-4e23-8f5e-e7b48d9cdacb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:50:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b3177d6a-fe46-4b02-a433-1e655d7b8c28 tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "cinder-520240ce-7378-4a68-ac39-83b1d8f158d7-delete_volume" released by "delete_volume" :: held 1.213s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:50:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8109fb98-a082-4a4e-9d8f-7931b9adb83f tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Acquiring lock "cinder-quobyte-38b93c3e-12d0-4e23-8f5e-e7b48d9cdacb" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:50:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8109fb98-a082-4a4e-9d8f-7931b9adb83f tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "cinder-quobyte-38b93c3e-12d0-4e23-8f5e-e7b48d9cdacb" acquired by "delete_volume" :: waited 0.016s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:50:33 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a586813-67fa-48a3-b5cf-00f76ecc726a]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:50:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8109fb98-a082-4a4e-9d8f-7931b9adb83f tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-38b93c3e-12d0-4e23-8f5e-e7b48d9cdacb {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:33 devstack sudo[109391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-38b93c3e-12d0-4e23-8f5e-e7b48d9cdacb Aug 11 04:50:33 devstack sudo[109391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:33 devstack sudo[109389]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0bd7cd11-7244-45fc-aadb-6db260a0ace9 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c4882446-6151-4efb-a599-803fc938b996 1073741824" returned: 0 in 0.484s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0bd7cd11-7244-45fc-aadb-6db260a0ace9 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c4882446-6151-4efb-a599-803fc938b996 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:33 devstack sudo[109391]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8109fb98-a082-4a4e-9d8f-7931b9adb83f tempest-CreateVolumesFromSourceVolumeTest-677127951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-38b93c3e-12d0-4e23-8f5e-e7b48d9cdacb" returned: 0 in 0.379s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8109fb98-a082-4a4e-9d8f-7931b9adb83f tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-38b93c3e-12d0-4e23-8f5e-e7b48d9cdacb {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:33 devstack sudo[109399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c4882446-6151-4efb-a599-803fc938b996 Aug 11 04:50:33 devstack sudo[109399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:33 devstack sudo[109400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-38b93c3e-12d0-4e23-8f5e-e7b48d9cdacb Aug 11 04:50:33 devstack sudo[109400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:34 devstack sudo[109399]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0bd7cd11-7244-45fc-aadb-6db260a0ace9 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c4882446-6151-4efb-a599-803fc938b996" returned: 0 in 0.246s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0bd7cd11-7244-45fc-aadb-6db260a0ace9 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:50:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0bd7cd11-7244-45fc-aadb-6db260a0ace9 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:50:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0bd7cd11-7244-45fc-aadb-6db260a0ace9 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a0a48b9-3ddc-4e6c-b185-05da76721482) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4882446-6151-4efb-a599-803fc938b996', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:50:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0bd7cd11-7244-45fc-aadb-6db260a0ace9 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe8c6767-c8ce-4b53-9f08-bc05b44f2684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:50:34 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-0bd7cd11-7244-45fc-aadb-6db260a0ace9 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] Volume volume-c4882446-6151-4efb-a599-803fc938b996 (c4882446-6151-4efb-a599-803fc938b996): created successfully Aug 11 04:50:34 devstack sudo[109400]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0bd7cd11-7244-45fc-aadb-6db260a0ace9 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe8c6767-c8ce-4b53-9f08-bc05b44f2684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:50:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0bd7cd11-7244-45fc-aadb-6db260a0ace9 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] Flow 'volume_create_manager' (ca0f4c68-6436-4eb1-8768-7d2026a8a045) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:50:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8109fb98-a082-4a4e-9d8f-7931b9adb83f tempest-CreateVolumesFromSourceVolumeTest-677127951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-38b93c3e-12d0-4e23-8f5e-e7b48d9cdacb" returned: 0 in 0.281s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:34 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-0bd7cd11-7244-45fc-aadb-6db260a0ace9 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] Created volume successfully. Aug 11 04:50:34 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8109fb98-a082-4a4e-9d8f-7931b9adb83f tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "cinder-quobyte-38b93c3e-12d0-4e23-8f5e-e7b48d9cdacb" released by "delete_volume" :: held 0.717s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:50:34 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-8109fb98-a082-4a4e-9d8f-7931b9adb83f tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Created reservations ['b7da0fa6-3901-4865-ad0f-33af495fe3ce', '7c41601b-f424-487f-8c0b-8ac0a5f18b93', '6e7259d5-ff71-4e85-af75-48523a08da15', 'cb4426d6-2c6b-488e-8757-97ef1180fc56'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:50:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8109fb98-a082-4a4e-9d8f-7931b9adb83f tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:50:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8109fb98-a082-4a4e-9d8f-7931b9adb83f tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:50:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-8109fb98-a082-4a4e-9d8f-7931b9adb83f tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:50:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-8109fb98-a082-4a4e-9d8f-7931b9adb83f tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:50:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8109fb98-a082-4a4e-9d8f-7931b9adb83f tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:50:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8109fb98-a082-4a4e-9d8f-7931b9adb83f tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:34 devstack sudo[109405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:50:34 devstack sudo[109405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:34 devstack sudo[109405]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8109fb98-a082-4a4e-9d8f-7931b9adb83f tempest-CreateVolumesFromSourceVolumeTest-677127951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.246s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:34 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-8109fb98-a082-4a4e-9d8f-7931b9adb83f tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:50:34 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-8109fb98-a082-4a4e-9d8f-7931b9adb83f tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Deleted volume successfully. Aug 11 04:50:34 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8109fb98-a082-4a4e-9d8f-7931b9adb83f tempest-CreateVolumesFromSourceVolumeTest-677127951 None] Lock "cinder-38b93c3e-12d0-4e23-8f5e-e7b48d9cdacb-delete_volume" released by "delete_volume" :: held 1.177s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:50:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-0252c638-eca2-4ce9-a6fd-17865826f025 req-c28146dc-857f-4bbe-98d8-efc273951fee tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:50:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-0252c638-eca2-4ce9-a6fd-17865826f025 req-c28146dc-857f-4bbe-98d8-efc273951fee tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:50:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-0252c638-eca2-4ce9-a6fd-17865826f025 req-c28146dc-857f-4bbe-98d8-efc273951fee tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:50:36 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-0252c638-eca2-4ce9-a6fd-17865826f025 req-c28146dc-857f-4bbe-98d8-efc273951fee tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd', 'name': 'volume-c4882446-6151-4efb-a599-803fc938b996', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd76fe5e2-113e-4073-99ff-89661564838f', 'enforce_multipath': True} {{(pid=94472) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 11 04:50:36 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-0252c638-eca2-4ce9-a6fd-17865826f025 req-c28146dc-857f-4bbe-98d8-efc273951fee tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] attachment_update completed successfully. Aug 11 04:50:38 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6e26dc2-2424-4e14-bcb1-c2cfaf2cac0d tempest-VolumeDependencyTests-220383950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:50:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a6e26dc2-2424-4e14-bcb1-c2cfaf2cac0d tempest-VolumeDependencyTests-220383950 None] Flow 'volume_create_manager' (8e44af62-3db5-4904-9342-371a41ea009e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:50:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a6e26dc2-2424-4e14-bcb1-c2cfaf2cac0d tempest-VolumeDependencyTests-220383950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba7d7c6c-21d5-4f64-9b57-59922a1e17b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:50:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a6e26dc2-2424-4e14-bcb1-c2cfaf2cac0d tempest-VolumeDependencyTests-220383950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba7d7c6c-21d5-4f64-9b57-59922a1e17b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-916961121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=477b134e-66cd-4ce4-849f-e6db1511d839,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71f66b14776d4f0e97a61775f2f09d5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:50:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:50:38Z,use_quota=True,user_id='8059c881190f4768b9dbbcdf511c2aa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:50:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a6e26dc2-2424-4e14-bcb1-c2cfaf2cac0d tempest-VolumeDependencyTests-220383950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcd4027e-895b-4f5b-af49-67b85066d131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:50:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a6e26dc2-2424-4e14-bcb1-c2cfaf2cac0d tempest-VolumeDependencyTests-220383950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcd4027e-895b-4f5b-af49-67b85066d131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:50:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a6e26dc2-2424-4e14-bcb1-c2cfaf2cac0d tempest-VolumeDependencyTests-220383950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62420407-e46d-4eae-9dc2-250380e0d91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:50:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a6e26dc2-2424-4e14-bcb1-c2cfaf2cac0d tempest-VolumeDependencyTests-220383950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62420407-e46d-4eae-9dc2-250380e0d91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '477b134e-66cd-4ce4-849f-e6db1511d839', 'volume_name': 'volume-477b134e-66cd-4ce4-849f-e6db1511d839', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:50:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a6e26dc2-2424-4e14-bcb1-c2cfaf2cac0d tempest-VolumeDependencyTests-220383950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5821d700-ca2d-4b71-8b6e-c50129bdbb84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:50:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a6e26dc2-2424-4e14-bcb1-c2cfaf2cac0d tempest-VolumeDependencyTests-220383950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5821d700-ca2d-4b71-8b6e-c50129bdbb84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:50:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a6e26dc2-2424-4e14-bcb1-c2cfaf2cac0d tempest-VolumeDependencyTests-220383950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7ade636-237c-4a66-8290-6ac837c17092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:50:38 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-a6e26dc2-2424-4e14-bcb1-c2cfaf2cac0d tempest-VolumeDependencyTests-220383950 None] Volume 477b134e-66cd-4ce4-849f-e6db1511d839: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-477b134e-66cd-4ce4-849f-e6db1511d839', 'volume_size': 1} Aug 11 04:50:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a6e26dc2-2424-4e14-bcb1-c2cfaf2cac0d tempest-VolumeDependencyTests-220383950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:50:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a6e26dc2-2424-4e14-bcb1-c2cfaf2cac0d tempest-VolumeDependencyTests-220383950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:50:38 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a6e26dc2-2424-4e14-bcb1-c2cfaf2cac0d tempest-VolumeDependencyTests-220383950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-916961121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=477b134e-66cd-4ce4-849f-e6db1511d839,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71f66b14776d4f0e97a61775f2f09d5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:50:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:50:38Z,use_quota=True,user_id='8059c881190f4768b9dbbcdf511c2aa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:50:38 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-a6e26dc2-2424-4e14-bcb1-c2cfaf2cac0d tempest-VolumeDependencyTests-220383950 None] Creating volume 477b134e-66cd-4ce4-849f-e6db1511d839 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:50:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a6e26dc2-2424-4e14-bcb1-c2cfaf2cac0d tempest-VolumeDependencyTests-220383950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:50:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a6e26dc2-2424-4e14-bcb1-c2cfaf2cac0d tempest-VolumeDependencyTests-220383950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:50:38 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a6e26dc2-2424-4e14-bcb1-c2cfaf2cac0d tempest-VolumeDependencyTests-220383950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:50:38 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a6e26dc2-2424-4e14-bcb1-c2cfaf2cac0d tempest-VolumeDependencyTests-220383950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:50:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a6e26dc2-2424-4e14-bcb1-c2cfaf2cac0d tempest-VolumeDependencyTests-220383950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:50:38 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a6e26dc2-2424-4e14-bcb1-c2cfaf2cac0d tempest-VolumeDependencyTests-220383950 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:50:38 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-a6e26dc2-2424-4e14-bcb1-c2cfaf2cac0d tempest-VolumeDependencyTests-220383950 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:50:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a6e26dc2-2424-4e14-bcb1-c2cfaf2cac0d tempest-VolumeDependencyTests-220383950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:38 devstack sudo[109831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839 1073741824 Aug 11 04:50:38 devstack sudo[109831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:38 devstack sudo[109831]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a6e26dc2-2424-4e14-bcb1-c2cfaf2cac0d tempest-VolumeDependencyTests-220383950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839 1073741824" returned: 0 in 0.573s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a6e26dc2-2424-4e14-bcb1-c2cfaf2cac0d tempest-VolumeDependencyTests-220383950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:38 devstack sudo[109838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839 Aug 11 04:50:38 devstack sudo[109838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:39 devstack sudo[109838]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a6e26dc2-2424-4e14-bcb1-c2cfaf2cac0d tempest-VolumeDependencyTests-220383950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839" returned: 0 in 0.367s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a6e26dc2-2424-4e14-bcb1-c2cfaf2cac0d tempest-VolumeDependencyTests-220383950 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:50:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a6e26dc2-2424-4e14-bcb1-c2cfaf2cac0d tempest-VolumeDependencyTests-220383950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:50:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a6e26dc2-2424-4e14-bcb1-c2cfaf2cac0d tempest-VolumeDependencyTests-220383950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7ade636-237c-4a66-8290-6ac837c17092) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-477b134e-66cd-4ce4-849f-e6db1511d839', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:50:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a6e26dc2-2424-4e14-bcb1-c2cfaf2cac0d tempest-VolumeDependencyTests-220383950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6677a1c-6453-4877-89cb-681653224518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:50:39 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-a6e26dc2-2424-4e14-bcb1-c2cfaf2cac0d tempest-VolumeDependencyTests-220383950 None] Volume volume-477b134e-66cd-4ce4-849f-e6db1511d839 (477b134e-66cd-4ce4-849f-e6db1511d839): created successfully Aug 11 04:50:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a6e26dc2-2424-4e14-bcb1-c2cfaf2cac0d tempest-VolumeDependencyTests-220383950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6677a1c-6453-4877-89cb-681653224518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:50:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a6e26dc2-2424-4e14-bcb1-c2cfaf2cac0d tempest-VolumeDependencyTests-220383950 None] Flow 'volume_create_manager' (8e44af62-3db5-4904-9342-371a41ea009e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:50:39 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-a6e26dc2-2424-4e14-bcb1-c2cfaf2cac0d tempest-VolumeDependencyTests-220383950 None] Created volume successfully. Aug 11 04:50:39 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-ef5821fa-d09f-4830-b39a-514e5bb128a9 req-6b35f2d1-0b35-42ed-8772-417f51193ae7 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] Terminate volume connection completed successfully. Aug 11 04:50:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-ef5821fa-d09f-4830-b39a-514e5bb128a9 req-6b35f2d1-0b35-42ed-8772-417f51193ae7 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] Deleting attachment d76fe5e2-113e-4073-99ff-89661564838f. {{(pid=94472) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 11 04:50:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4ff44ca9-79bd-4343-ab74-401002085025 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] Acquiring lock "cinder-c4882446-6151-4efb-a599-803fc938b996-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:50:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4ff44ca9-79bd-4343-ab74-401002085025 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] Lock "cinder-c4882446-6151-4efb-a599-803fc938b996-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:50:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4ff44ca9-79bd-4343-ab74-401002085025 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] Acquiring lock "cinder-quobyte-c4882446-6151-4efb-a599-803fc938b996" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:50:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-648426b3-179a-4315-b29f-407ad599b3cb tempest-VolumeDependencyTests-220383950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:50:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-648426b3-179a-4315-b29f-407ad599b3cb tempest-VolumeDependencyTests-220383950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:50:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4ff44ca9-79bd-4343-ab74-401002085025 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] Lock "cinder-quobyte-c4882446-6151-4efb-a599-803fc938b996" acquired by "delete_volume" :: waited 0.022s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:50:40 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-648426b3-179a-4315-b29f-407ad599b3cb tempest-VolumeDependencyTests-220383950 None] Creating offline snapshot 7a8f3e48-4c8c-4520-84d7-3a8c22a7a41e of volume 477b134e-66cd-4ce4-849f-e6db1511d839 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 04:50:40 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a8fd21-c68e-45f7-af9f-788df63001d0]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:50:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4ff44ca9-79bd-4343-ab74-401002085025 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c4882446-6151-4efb-a599-803fc938b996 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:40 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c63f84-8446-449a-97dc-78aa5b094f1a]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:50:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-648426b3-179a-4315-b29f-407ad599b3cb tempest-VolumeDependencyTests-220383950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:40 devstack sudo[109871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c4882446-6151-4efb-a599-803fc938b996 Aug 11 04:50:40 devstack sudo[109871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:40 devstack sudo[109872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839 Aug 11 04:50:40 devstack sudo[109872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:40 devstack sudo[109872]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-648426b3-179a-4315-b29f-407ad599b3cb tempest-VolumeDependencyTests-220383950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839" returned: 0 in 0.385s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-648426b3-179a-4315-b29f-407ad599b3cb tempest-VolumeDependencyTests-220383950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839.7a8f3e48-4c8c-4520-84d7-3a8c22a7a41e 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:40 devstack sudo[109871]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4ff44ca9-79bd-4343-ab74-401002085025 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c4882446-6151-4efb-a599-803fc938b996" returned: 0 in 0.414s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4ff44ca9-79bd-4343-ab74-401002085025 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c4882446-6151-4efb-a599-803fc938b996 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:40 devstack sudo[109881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839.7a8f3e48-4c8c-4520-84d7-3a8c22a7a41e 1G Aug 11 04:50:40 devstack sudo[109881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:40 devstack sudo[109882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c4882446-6151-4efb-a599-803fc938b996 Aug 11 04:50:40 devstack sudo[109882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:41 devstack sudo[109882]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4ff44ca9-79bd-4343-ab74-401002085025 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c4882446-6151-4efb-a599-803fc938b996" returned: 0 in 0.277s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:41 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4ff44ca9-79bd-4343-ab74-401002085025 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] Lock "cinder-quobyte-c4882446-6151-4efb-a599-803fc938b996" released by "delete_volume" :: held 0.746s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:50:41 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-4ff44ca9-79bd-4343-ab74-401002085025 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] Created reservations ['785d0740-3ede-40ae-a628-c38cf1a07545', '63553f92-3367-44c3-ae52-e84e9f8db459', '55825137-967d-4b64-9b52-e87b55bd2306', '9ec4ef19-1b19-4b9a-9393-8a619fe352fc'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:50:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4ff44ca9-79bd-4343-ab74-401002085025 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:50:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4ff44ca9-79bd-4343-ab74-401002085025 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:50:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4ff44ca9-79bd-4343-ab74-401002085025 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:50:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4ff44ca9-79bd-4343-ab74-401002085025 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:50:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4ff44ca9-79bd-4343-ab74-401002085025 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:50:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4ff44ca9-79bd-4343-ab74-401002085025 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:41 devstack sudo[109881]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-648426b3-179a-4315-b29f-407ad599b3cb tempest-VolumeDependencyTests-220383950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839.7a8f3e48-4c8c-4520-84d7-3a8c22a7a41e 1G" returned: 0 in 0.524s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-648426b3-179a-4315-b29f-407ad599b3cb tempest-VolumeDependencyTests-220383950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-477b134e-66cd-4ce4-849f-e6db1511d839 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839.7a8f3e48-4c8c-4520-84d7-3a8c22a7a41e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:41 devstack sudo[109890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:50:41 devstack sudo[109890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:41 devstack sudo[109891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-477b134e-66cd-4ce4-849f-e6db1511d839 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839.7a8f3e48-4c8c-4520-84d7-3a8c22a7a41e Aug 11 04:50:41 devstack sudo[109891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:41 devstack sudo[109890]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4ff44ca9-79bd-4343-ab74-401002085025 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.359s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:41 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-4ff44ca9-79bd-4343-ab74-401002085025 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:50:41 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-4ff44ca9-79bd-4343-ab74-401002085025 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] Deleted volume successfully. Aug 11 04:50:41 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4ff44ca9-79bd-4343-ab74-401002085025 tempest-TestServerVolumeAttachScenarioOldVersion-606874694 None] Lock "cinder-c4882446-6151-4efb-a599-803fc938b996-delete_volume" released by "delete_volume" :: held 1.402s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:50:41 devstack sudo[109891]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-648426b3-179a-4315-b29f-407ad599b3cb tempest-VolumeDependencyTests-220383950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-477b134e-66cd-4ce4-849f-e6db1511d839 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839.7a8f3e48-4c8c-4520-84d7-3a8c22a7a41e" returned: 0 in 0.462s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:41 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-648426b3-179a-4315-b29f-407ad599b3cb tempest-VolumeDependencyTests-220383950 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839.7a8f3e48-4c8c-4520-84d7-3a8c22a7a41e is being set with open permissions: ugo+rw Aug 11 04:50:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-648426b3-179a-4315-b29f-407ad599b3cb tempest-VolumeDependencyTests-220383950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839.7a8f3e48-4c8c-4520-84d7-3a8c22a7a41e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:41 devstack sudo[109899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839.7a8f3e48-4c8c-4520-84d7-3a8c22a7a41e Aug 11 04:50:41 devstack sudo[109899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:42 devstack sudo[109899]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-648426b3-179a-4315-b29f-407ad599b3cb tempest-VolumeDependencyTests-220383950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839.7a8f3e48-4c8c-4520-84d7-3a8c22a7a41e" returned: 0 in 0.307s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-648426b3-179a-4315-b29f-407ad599b3cb tempest-VolumeDependencyTests-220383950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:42 devstack sudo[109909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839.info Aug 11 04:50:42 devstack sudo[109909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:42 devstack sudo[109909]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-648426b3-179a-4315-b29f-407ad599b3cb tempest-VolumeDependencyTests-220383950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839.info" returned: 0 in 0.453s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:42 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-648426b3-179a-4315-b29f-407ad599b3cb tempest-VolumeDependencyTests-220383950 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839.info is being set with open permissions: ugo+rw Aug 11 04:50:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-648426b3-179a-4315-b29f-407ad599b3cb tempest-VolumeDependencyTests-220383950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:42 devstack sudo[109929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839.info Aug 11 04:50:42 devstack sudo[109929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:43 devstack sudo[109929]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-648426b3-179a-4315-b29f-407ad599b3cb tempest-VolumeDependencyTests-220383950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839.info" returned: 0 in 0.293s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-648426b3-179a-4315-b29f-407ad599b3cb tempest-VolumeDependencyTests-220383950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.557s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:50:43 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-648426b3-179a-4315-b29f-407ad599b3cb tempest-VolumeDependencyTests-220383950 None] Create snapshot completed successfully Aug 11 04:50:44 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-00fbd3cd-3fc5-4efc-96af-1d1fd723f032 tempest-VolumeDependencyTests-220383950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:50:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-00fbd3cd-3fc5-4efc-96af-1d1fd723f032 tempest-VolumeDependencyTests-220383950 None] Flow 'volume_create_manager' (42699164-5c86-43ba-903f-f9d9f69d1c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:50:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-00fbd3cd-3fc5-4efc-96af-1d1fd723f032 tempest-VolumeDependencyTests-220383950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79be1dea-f422-4cd4-8369-7ba07efb6f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:50:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-00fbd3cd-3fc5-4efc-96af-1d1fd723f032 tempest-VolumeDependencyTests-220383950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79be1dea-f422-4cd4-8369-7ba07efb6f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:50:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1866837409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f1a82b5-605e-4798-ab4e-32ccbc67bf4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71f66b14776d4f0e97a61775f2f09d5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:50:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7a8f3e48-4c8c-4520-84d7-3a8c22a7a41e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:50:44Z,use_quota=True,user_id='8059c881190f4768b9dbbcdf511c2aa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:50:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-00fbd3cd-3fc5-4efc-96af-1d1fd723f032 tempest-VolumeDependencyTests-220383950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0e90d93-36b4-44a5-86d0-d543ae488f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:50:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-00fbd3cd-3fc5-4efc-96af-1d1fd723f032 tempest-VolumeDependencyTests-220383950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0e90d93-36b4-44a5-86d0-d543ae488f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:50:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-00fbd3cd-3fc5-4efc-96af-1d1fd723f032 tempest-VolumeDependencyTests-220383950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1284b1fb-dace-4a8b-9dd1-2e73b26de176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:50:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-00fbd3cd-3fc5-4efc-96af-1d1fd723f032 tempest-VolumeDependencyTests-220383950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1284b1fb-dace-4a8b-9dd1-2e73b26de176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4f1a82b5-605e-4798-ab4e-32ccbc67bf4d', 'volume_name': 'volume-4f1a82b5-605e-4798-ab4e-32ccbc67bf4d', 'volume_size': 1, 'snapshot_id': '7a8f3e48-4c8c-4520-84d7-3a8c22a7a41e'}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:50:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-00fbd3cd-3fc5-4efc-96af-1d1fd723f032 tempest-VolumeDependencyTests-220383950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5004663-62d5-48e8-a145-705a4149cdd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:50:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-00fbd3cd-3fc5-4efc-96af-1d1fd723f032 tempest-VolumeDependencyTests-220383950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5004663-62d5-48e8-a145-705a4149cdd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:50:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-00fbd3cd-3fc5-4efc-96af-1d1fd723f032 tempest-VolumeDependencyTests-220383950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ce007a7-c4fd-44d5-8afc-cecd69deab44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:50:44 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-00fbd3cd-3fc5-4efc-96af-1d1fd723f032 tempest-VolumeDependencyTests-220383950 None] Volume 4f1a82b5-605e-4798-ab4e-32ccbc67bf4d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4f1a82b5-605e-4798-ab4e-32ccbc67bf4d', 'volume_size': 1, 'snapshot_id': '7a8f3e48-4c8c-4520-84d7-3a8c22a7a41e'} Aug 11 04:50:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-00fbd3cd-3fc5-4efc-96af-1d1fd723f032 tempest-VolumeDependencyTests-220383950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:50:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-00fbd3cd-3fc5-4efc-96af-1d1fd723f032 tempest-VolumeDependencyTests-220383950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:50:44 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-00fbd3cd-3fc5-4efc-96af-1d1fd723f032 tempest-VolumeDependencyTests-220383950 None] Acquiring lock "cinder-quobyte-7a8f3e48-4c8c-4520-84d7-3a8c22a7a41e-4f1a82b5-605e-4798-ab4e-32ccbc67bf4d" by "_create_volume_from_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:50:44 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-00fbd3cd-3fc5-4efc-96af-1d1fd723f032 tempest-VolumeDependencyTests-220383950 None] Lock "cinder-quobyte-7a8f3e48-4c8c-4520-84d7-3a8c22a7a41e-4f1a82b5-605e-4798-ab4e-32ccbc67bf4d" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:50:44 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-00fbd3cd-3fc5-4efc-96af-1d1fd723f032 tempest-VolumeDependencyTests-220383950 None] Creating volume 4f1a82b5-605e-4798-ab4e-32ccbc67bf4d from snapshot 7a8f3e48-4c8c-4520-84d7-3a8c22a7a41e {{(pid=94472) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 11 04:50:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-00fbd3cd-3fc5-4efc-96af-1d1fd723f032 tempest-VolumeDependencyTests-220383950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:50:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-00fbd3cd-3fc5-4efc-96af-1d1fd723f032 tempest-VolumeDependencyTests-220383950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:50:44 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-00fbd3cd-3fc5-4efc-96af-1d1fd723f032 tempest-VolumeDependencyTests-220383950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:50:44 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-00fbd3cd-3fc5-4efc-96af-1d1fd723f032 tempest-VolumeDependencyTests-220383950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:50:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-00fbd3cd-3fc5-4efc-96af-1d1fd723f032 tempest-VolumeDependencyTests-220383950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:50:44 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-00fbd3cd-3fc5-4efc-96af-1d1fd723f032 tempest-VolumeDependencyTests-220383950 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:50:44 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-00fbd3cd-3fc5-4efc-96af-1d1fd723f032 tempest-VolumeDependencyTests-220383950 None] Acquiring lock "cinder-quobyte-4f1a82b5-605e-4798-ab4e-32ccbc67bf4d" by "_copy_volume_from_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:50:44 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-00fbd3cd-3fc5-4efc-96af-1d1fd723f032 tempest-VolumeDependencyTests-220383950 None] Lock "cinder-quobyte-4f1a82b5-605e-4798-ab4e-32ccbc67bf4d" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:50:44 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-00fbd3cd-3fc5-4efc-96af-1d1fd723f032 tempest-VolumeDependencyTests-220383950 None] snapshot: 7a8f3e48-4c8c-4520-84d7-3a8c22a7a41e, volume: 4f1a82b5-605e-4798-ab4e-32ccbc67bf4d, {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 11 04:50:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-00fbd3cd-3fc5-4efc-96af-1d1fd723f032 tempest-VolumeDependencyTests-220383950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:50:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-00fbd3cd-3fc5-4efc-96af-1d1fd723f032 tempest-VolumeDependencyTests-220383950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:50:44 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-00fbd3cd-3fc5-4efc-96af-1d1fd723f032 tempest-VolumeDependencyTests-220383950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:50:44 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-00fbd3cd-3fc5-4efc-96af-1d1fd723f032 tempest-VolumeDependencyTests-220383950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:50:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-00fbd3cd-3fc5-4efc-96af-1d1fd723f032 tempest-VolumeDependencyTests-220383950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:50:44 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[433d6793-f09c-4228-b736-f7008673e9fc]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:50:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-00fbd3cd-3fc5-4efc-96af-1d1fd723f032 tempest-VolumeDependencyTests-220383950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839.7a8f3e48-4c8c-4520-84d7-3a8c22a7a41e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:44 devstack sudo[109939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839.7a8f3e48-4c8c-4520-84d7-3a8c22a7a41e Aug 11 04:50:44 devstack sudo[109939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:45 devstack sudo[109939]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-00fbd3cd-3fc5-4efc-96af-1d1fd723f032 tempest-VolumeDependencyTests-220383950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839.7a8f3e48-4c8c-4520-84d7-3a8c22a7a41e" returned: 0 in 0.429s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:45 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-00fbd3cd-3fc5-4efc-96af-1d1fd723f032 tempest-VolumeDependencyTests-220383950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-477b134e-66cd-4ce4-849f-e6db1511d839(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:50:45 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[a216cf18-7012-43f8-a1c0-c96e01f6825d]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:50:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-00fbd3cd-3fc5-4efc-96af-1d1fd723f032 tempest-VolumeDependencyTests-220383950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:45 devstack sudo[109944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839 Aug 11 04:50:45 devstack sudo[109944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:45 devstack sudo[109944]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-00fbd3cd-3fc5-4efc-96af-1d1fd723f032 tempest-VolumeDependencyTests-220383950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839" returned: 0 in 0.403s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:45 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-00fbd3cd-3fc5-4efc-96af-1d1fd723f032 tempest-VolumeDependencyTests-220383950 None] will copy from snapshot at /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839 {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 11 04:50:45 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-00fbd3cd-3fc5-4efc-96af-1d1fd723f032 tempest-VolumeDependencyTests-220383950 None] Creating direct copy from snapshot {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 11 04:50:45 devstack cinder-volume[94472]: DEBUG cinder.utils [None req-00fbd3cd-3fc5-4efc-96af-1d1fd723f032 tempest-VolumeDependencyTests-220383950 None] Path /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-4f1a82b5-605e-4798-ab4e-32ccbc67bf4d not found in is_blk_device check {{(pid=94472) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 11 04:50:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-00fbd3cd-3fc5-4efc-96af-1d1fd723f032 tempest-VolumeDependencyTests-220383950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-4f1a82b5-605e-4798-ab4e-32ccbc67bf4d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:45 devstack sudo[109949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-4f1a82b5-605e-4798-ab4e-32ccbc67bf4d Aug 11 04:50:45 devstack sudo[109949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:51 devstack sudo[109949]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-00fbd3cd-3fc5-4efc-96af-1d1fd723f032 tempest-VolumeDependencyTests-220383950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-4f1a82b5-605e-4798-ab4e-32ccbc67bf4d" returned: 0 in 5.841s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:51 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-00fbd3cd-3fc5-4efc-96af-1d1fd723f032 tempest-VolumeDependencyTests-220383950 None] Image conversion details: src /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839, size 1024.00 MB, duration 5.84 sec, destination /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-4f1a82b5-605e-4798-ab4e-32ccbc67bf4d {{(pid=94472) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 11 04:50:51 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-00fbd3cd-3fc5-4efc-96af-1d1fd723f032 tempest-VolumeDependencyTests-220383950 None] Converted 1024.00 MB image at 175.27 MB/s Aug 11 04:50:51 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-00fbd3cd-3fc5-4efc-96af-1d1fd723f032 tempest-VolumeDependencyTests-220383950 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-4f1a82b5-605e-4798-ab4e-32ccbc67bf4d is being set with open permissions: ugo+rw Aug 11 04:50:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-00fbd3cd-3fc5-4efc-96af-1d1fd723f032 tempest-VolumeDependencyTests-220383950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-4f1a82b5-605e-4798-ab4e-32ccbc67bf4d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:51 devstack sudo[109980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-4f1a82b5-605e-4798-ab4e-32ccbc67bf4d Aug 11 04:50:51 devstack sudo[109980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:51 devstack sudo[109980]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-00fbd3cd-3fc5-4efc-96af-1d1fd723f032 tempest-VolumeDependencyTests-220383950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-4f1a82b5-605e-4798-ab4e-32ccbc67bf4d" returned: 0 in 0.323s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:51 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-00fbd3cd-3fc5-4efc-96af-1d1fd723f032 tempest-VolumeDependencyTests-220383950 None] Lock "cinder-quobyte-4f1a82b5-605e-4798-ab4e-32ccbc67bf4d" released by "_copy_volume_from_snapshot" :: held 7.156s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:50:51 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-00fbd3cd-3fc5-4efc-96af-1d1fd723f032 tempest-VolumeDependencyTests-220383950 None] Lock "cinder-quobyte-7a8f3e48-4c8c-4520-84d7-3a8c22a7a41e-4f1a82b5-605e-4798-ab4e-32ccbc67bf4d" released by "_create_volume_from_snapshot" :: held 7.339s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:50:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-00fbd3cd-3fc5-4efc-96af-1d1fd723f032 tempest-VolumeDependencyTests-220383950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.382s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:50:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-00fbd3cd-3fc5-4efc-96af-1d1fd723f032 tempest-VolumeDependencyTests-220383950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ce007a7-c4fd-44d5-8afc-cecd69deab44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f1a82b5-605e-4798-ab4e-32ccbc67bf4d', 'volume_size': 1, 'snapshot_id': '7a8f3e48-4c8c-4520-84d7-3a8c22a7a41e'}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:50:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-00fbd3cd-3fc5-4efc-96af-1d1fd723f032 tempest-VolumeDependencyTests-220383950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1216777c-00e4-477c-b693-fbb59425e421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:50:51 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-00fbd3cd-3fc5-4efc-96af-1d1fd723f032 tempest-VolumeDependencyTests-220383950 None] Volume volume-4f1a82b5-605e-4798-ab4e-32ccbc67bf4d (4f1a82b5-605e-4798-ab4e-32ccbc67bf4d): created successfully Aug 11 04:50:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-00fbd3cd-3fc5-4efc-96af-1d1fd723f032 tempest-VolumeDependencyTests-220383950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1216777c-00e4-477c-b693-fbb59425e421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:50:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-00fbd3cd-3fc5-4efc-96af-1d1fd723f032 tempest-VolumeDependencyTests-220383950 None] Flow 'volume_create_manager' (42699164-5c86-43ba-903f-f9d9f69d1c5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:50:52 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-00fbd3cd-3fc5-4efc-96af-1d1fd723f032 tempest-VolumeDependencyTests-220383950 None] Created volume successfully. Aug 11 04:50:52 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-91f389f1-e04f-4a3d-b242-0efa65ad8bc1 tempest-VolumeDependencyTests-220383950 None] Acquiring lock "cinder-7a8f3e48-4c8c-4520-84d7-3a8c22a7a41e-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:50:52 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-91f389f1-e04f-4a3d-b242-0efa65ad8bc1 tempest-VolumeDependencyTests-220383950 None] Lock "cinder-7a8f3e48-4c8c-4520-84d7-3a8c22a7a41e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:50:52 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-91f389f1-e04f-4a3d-b242-0efa65ad8bc1 tempest-VolumeDependencyTests-220383950 None] Acquiring lock "cinder-quobyte-477b134e-66cd-4ce4-849f-e6db1511d839" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:50:52 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-91f389f1-e04f-4a3d-b242-0efa65ad8bc1 tempest-VolumeDependencyTests-220383950 None] Lock "cinder-quobyte-477b134e-66cd-4ce4-849f-e6db1511d839" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:50:52 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-91f389f1-e04f-4a3d-b242-0efa65ad8bc1 tempest-VolumeDependencyTests-220383950 None] Acquiring lock "cinder-quobyte-7a8f3e48-4c8c-4520-84d7-3a8c22a7a41e" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:50:52 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-91f389f1-e04f-4a3d-b242-0efa65ad8bc1 tempest-VolumeDependencyTests-220383950 None] Lock "cinder-quobyte-7a8f3e48-4c8c-4520-84d7-3a8c22a7a41e" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:50:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-91f389f1-e04f-4a3d-b242-0efa65ad8bc1 tempest-VolumeDependencyTests-220383950 None] Deleting offline snapshot 7a8f3e48-4c8c-4520-84d7-3a8c22a7a41e of volume 477b134e-66cd-4ce4-849f-e6db1511d839 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 04:50:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-91f389f1-e04f-4a3d-b242-0efa65ad8bc1 tempest-VolumeDependencyTests-220383950 None] snapshot_file for this snap is: volume-477b134e-66cd-4ce4-849f-e6db1511d839.7a8f3e48-4c8c-4520-84d7-3a8c22a7a41e {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 04:50:52 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[2853fc98-365a-4439-b49e-475acff591f7]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:50:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-91f389f1-e04f-4a3d-b242-0efa65ad8bc1 tempest-VolumeDependencyTests-220383950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839.7a8f3e48-4c8c-4520-84d7-3a8c22a7a41e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:52 devstack sudo[110031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839.7a8f3e48-4c8c-4520-84d7-3a8c22a7a41e Aug 11 04:50:52 devstack sudo[110031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:53 devstack sudo[110031]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-91f389f1-e04f-4a3d-b242-0efa65ad8bc1 tempest-VolumeDependencyTests-220383950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839.7a8f3e48-4c8c-4520-84d7-3a8c22a7a41e" returned: 0 in 0.530s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:53 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-91f389f1-e04f-4a3d-b242-0efa65ad8bc1 tempest-VolumeDependencyTests-220383950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-477b134e-66cd-4ce4-849f-e6db1511d839(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:50:53 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f34312-f890-4a0a-a651-bd0f07a9ca8f]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:50:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-91f389f1-e04f-4a3d-b242-0efa65ad8bc1 tempest-VolumeDependencyTests-220383950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:53 devstack sudo[110056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839 Aug 11 04:50:53 devstack sudo[110056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:53 devstack sudo[110056]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-91f389f1-e04f-4a3d-b242-0efa65ad8bc1 tempest-VolumeDependencyTests-220383950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839" returned: 0 in 0.661s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-91f389f1-e04f-4a3d-b242-0efa65ad8bc1 tempest-VolumeDependencyTests-220383950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839.7a8f3e48-4c8c-4520-84d7-3a8c22a7a41e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:53 devstack sudo[110077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839.7a8f3e48-4c8c-4520-84d7-3a8c22a7a41e Aug 11 04:50:53 devstack sudo[110077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:54 devstack sudo[110077]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-91f389f1-e04f-4a3d-b242-0efa65ad8bc1 tempest-VolumeDependencyTests-220383950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839.7a8f3e48-4c8c-4520-84d7-3a8c22a7a41e" returned: 0 in 0.383s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-91f389f1-e04f-4a3d-b242-0efa65ad8bc1 tempest-VolumeDependencyTests-220383950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839.7a8f3e48-4c8c-4520-84d7-3a8c22a7a41e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:54 devstack sudo[110082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839.7a8f3e48-4c8c-4520-84d7-3a8c22a7a41e Aug 11 04:50:54 devstack sudo[110082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:54 devstack sudo[110082]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-91f389f1-e04f-4a3d-b242-0efa65ad8bc1 tempest-VolumeDependencyTests-220383950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839.7a8f3e48-4c8c-4520-84d7-3a8c22a7a41e" returned: 0 in 0.438s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:54 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-91f389f1-e04f-4a3d-b242-0efa65ad8bc1 tempest-VolumeDependencyTests-220383950 None] Lock "cinder-quobyte-7a8f3e48-4c8c-4520-84d7-3a8c22a7a41e" released by "_delete_snapshot" :: held 2.202s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:50:54 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-91f389f1-e04f-4a3d-b242-0efa65ad8bc1 tempest-VolumeDependencyTests-220383950 None] Lock "cinder-quobyte-477b134e-66cd-4ce4-849f-e6db1511d839" released by "delete_snapshot" :: held 2.243s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:50:54 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-91f389f1-e04f-4a3d-b242-0efa65ad8bc1 tempest-VolumeDependencyTests-220383950 None] Created reservations ['7c494887-e0eb-40c3-b427-764a38831d55', '0d8835af-e9e6-48b7-88dc-ed06813b22ea', '00234036-c00b-4604-b621-d8f8e9dafae3', '14a0c339-19ca-4484-a4b4-ab368e413777'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:50:54 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-91f389f1-e04f-4a3d-b242-0efa65ad8bc1 tempest-VolumeDependencyTests-220383950 None] Delete snapshot completed successfully. Aug 11 04:50:54 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-91f389f1-e04f-4a3d-b242-0efa65ad8bc1 tempest-VolumeDependencyTests-220383950 None] Lock "cinder-7a8f3e48-4c8c-4520-84d7-3a8c22a7a41e-delete_snapshot" released by "delete_snapshot" :: held 2.430s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:50:55 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-04645aa4-f909-45fb-bf12-2da0a711dc94 tempest-VolumeDependencyTests-220383950 None] Acquiring lock "cinder-477b134e-66cd-4ce4-849f-e6db1511d839-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:50:55 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-04645aa4-f909-45fb-bf12-2da0a711dc94 tempest-VolumeDependencyTests-220383950 None] Lock "cinder-477b134e-66cd-4ce4-849f-e6db1511d839-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:50:55 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-04645aa4-f909-45fb-bf12-2da0a711dc94 tempest-VolumeDependencyTests-220383950 None] Acquiring lock "cinder-quobyte-477b134e-66cd-4ce4-849f-e6db1511d839" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:50:55 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-04645aa4-f909-45fb-bf12-2da0a711dc94 tempest-VolumeDependencyTests-220383950 None] Lock "cinder-quobyte-477b134e-66cd-4ce4-849f-e6db1511d839" acquired by "delete_volume" :: waited 0.021s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:50:55 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[46710954-b6ac-4ed4-87f2-fd5683827e02]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:50:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-04645aa4-f909-45fb-bf12-2da0a711dc94 tempest-VolumeDependencyTests-220383950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:56 devstack sudo[110087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839 Aug 11 04:50:56 devstack sudo[110087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:56 devstack sudo[110087]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-04645aa4-f909-45fb-bf12-2da0a711dc94 tempest-VolumeDependencyTests-220383950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839" returned: 0 in 0.494s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-04645aa4-f909-45fb-bf12-2da0a711dc94 tempest-VolumeDependencyTests-220383950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:56 devstack sudo[110093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839 Aug 11 04:50:56 devstack sudo[110093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:56 devstack sudo[110093]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-04645aa4-f909-45fb-bf12-2da0a711dc94 tempest-VolumeDependencyTests-220383950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-477b134e-66cd-4ce4-849f-e6db1511d839" returned: 0 in 0.309s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:56 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-04645aa4-f909-45fb-bf12-2da0a711dc94 tempest-VolumeDependencyTests-220383950 None] Lock "cinder-quobyte-477b134e-66cd-4ce4-849f-e6db1511d839" released by "delete_volume" :: held 0.921s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:50:56 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-04645aa4-f909-45fb-bf12-2da0a711dc94 tempest-VolumeDependencyTests-220383950 None] Created reservations ['3580c7c7-3cb5-4dc8-9bdf-2c586f761dbd', 'd4a445c3-3468-4a72-a27b-a176be750f9b', '8c75d3ca-4e1e-4221-b600-23f5991a7b47', '121cee8f-e32c-4724-b0fb-db406753cf5f'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:50:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-04645aa4-f909-45fb-bf12-2da0a711dc94 tempest-VolumeDependencyTests-220383950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:50:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-04645aa4-f909-45fb-bf12-2da0a711dc94 tempest-VolumeDependencyTests-220383950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:50:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-04645aa4-f909-45fb-bf12-2da0a711dc94 tempest-VolumeDependencyTests-220383950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:50:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-04645aa4-f909-45fb-bf12-2da0a711dc94 tempest-VolumeDependencyTests-220383950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:50:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-04645aa4-f909-45fb-bf12-2da0a711dc94 tempest-VolumeDependencyTests-220383950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:50:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-04645aa4-f909-45fb-bf12-2da0a711dc94 tempest-VolumeDependencyTests-220383950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:57 devstack sudo[110104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:50:57 devstack sudo[110104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:57 devstack sudo[110104]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-04645aa4-f909-45fb-bf12-2da0a711dc94 tempest-VolumeDependencyTests-220383950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.402s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:57 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-04645aa4-f909-45fb-bf12-2da0a711dc94 tempest-VolumeDependencyTests-220383950 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:50:57 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-04645aa4-f909-45fb-bf12-2da0a711dc94 tempest-VolumeDependencyTests-220383950 None] Deleted volume successfully. Aug 11 04:50:57 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-04645aa4-f909-45fb-bf12-2da0a711dc94 tempest-VolumeDependencyTests-220383950 None] Lock "cinder-477b134e-66cd-4ce4-849f-e6db1511d839-delete_volume" released by "delete_volume" :: held 1.877s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:50:58 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bac20b25-f950-4a9f-bf32-7e0aaa044244 tempest-VolumeDependencyTests-220383950 None] Acquiring lock "cinder-4f1a82b5-605e-4798-ab4e-32ccbc67bf4d-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:50:58 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bac20b25-f950-4a9f-bf32-7e0aaa044244 tempest-VolumeDependencyTests-220383950 None] Lock "cinder-4f1a82b5-605e-4798-ab4e-32ccbc67bf4d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:50:58 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bac20b25-f950-4a9f-bf32-7e0aaa044244 tempest-VolumeDependencyTests-220383950 None] Acquiring lock "cinder-quobyte-4f1a82b5-605e-4798-ab4e-32ccbc67bf4d" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:50:58 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bac20b25-f950-4a9f-bf32-7e0aaa044244 tempest-VolumeDependencyTests-220383950 None] Lock "cinder-quobyte-4f1a82b5-605e-4798-ab4e-32ccbc67bf4d" acquired by "delete_volume" :: waited 0.015s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:50:58 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[61328120-38dc-40ff-a6a5-6918fe8e5b2f]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:50:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bac20b25-f950-4a9f-bf32-7e0aaa044244 tempest-VolumeDependencyTests-220383950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-4f1a82b5-605e-4798-ab4e-32ccbc67bf4d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:58 devstack sudo[110113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-4f1a82b5-605e-4798-ab4e-32ccbc67bf4d Aug 11 04:50:58 devstack sudo[110113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:58 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 04:50:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:50:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:50:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:50:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:50:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:50:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:58 devstack sudo[110115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:50:58 devstack sudo[110115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:58 devstack sudo[110113]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bac20b25-f950-4a9f-bf32-7e0aaa044244 tempest-VolumeDependencyTests-220383950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-4f1a82b5-605e-4798-ab4e-32ccbc67bf4d" returned: 0 in 0.449s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bac20b25-f950-4a9f-bf32-7e0aaa044244 tempest-VolumeDependencyTests-220383950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-4f1a82b5-605e-4798-ab4e-32ccbc67bf4d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:58 devstack sudo[110120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-4f1a82b5-605e-4798-ab4e-32ccbc67bf4d Aug 11 04:50:58 devstack sudo[110120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:58 devstack sudo[110115]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.291s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:58 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:50:58 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running periodic task VolumeManager._thread_info {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 04:50:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] thread count: 28 {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 11 04:50:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] thread info: [<_MainThread(MainThread, started 133315846115456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 11 04:50:58 devstack sudo[110120]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bac20b25-f950-4a9f-bf32-7e0aaa044244 tempest-VolumeDependencyTests-220383950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-4f1a82b5-605e-4798-ab4e-32ccbc67bf4d" returned: 0 in 0.276s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:58 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bac20b25-f950-4a9f-bf32-7e0aaa044244 tempest-VolumeDependencyTests-220383950 None] Lock "cinder-quobyte-4f1a82b5-605e-4798-ab4e-32ccbc67bf4d" released by "delete_volume" :: held 0.779s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:50:58 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-bac20b25-f950-4a9f-bf32-7e0aaa044244 tempest-VolumeDependencyTests-220383950 None] Created reservations ['2cab2767-6b6c-4e9f-9b29-09d9a0d942df', '5b544429-f6cc-4b10-9480-7110dcbae4e0', 'faafdb22-b48a-43ef-808b-b139f5deeefc', 'e840ac67-7490-4e85-9407-370590956537'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:50:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bac20b25-f950-4a9f-bf32-7e0aaa044244 tempest-VolumeDependencyTests-220383950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:50:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bac20b25-f950-4a9f-bf32-7e0aaa044244 tempest-VolumeDependencyTests-220383950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:50:59 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-bac20b25-f950-4a9f-bf32-7e0aaa044244 tempest-VolumeDependencyTests-220383950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:50:59 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-bac20b25-f950-4a9f-bf32-7e0aaa044244 tempest-VolumeDependencyTests-220383950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:50:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bac20b25-f950-4a9f-bf32-7e0aaa044244 tempest-VolumeDependencyTests-220383950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:50:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bac20b25-f950-4a9f-bf32-7e0aaa044244 tempest-VolumeDependencyTests-220383950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:50:59 devstack sudo[110125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:50:59 devstack sudo[110125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:50:59 devstack sudo[110125]: pam_unix(sudo:session): session closed for user root Aug 11 04:50:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bac20b25-f950-4a9f-bf32-7e0aaa044244 tempest-VolumeDependencyTests-220383950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.285s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:50:59 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-bac20b25-f950-4a9f-bf32-7e0aaa044244 tempest-VolumeDependencyTests-220383950 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:50:59 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-bac20b25-f950-4a9f-bf32-7e0aaa044244 tempest-VolumeDependencyTests-220383950 None] Deleted volume successfully. Aug 11 04:50:59 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bac20b25-f950-4a9f-bf32-7e0aaa044244 tempest-VolumeDependencyTests-220383950 None] Lock "cinder-4f1a82b5-605e-4798-ab4e-32ccbc67bf4d-delete_volume" released by "delete_volume" :: held 1.378s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:51:09 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:UPDATE=108,cinder:SELECT=83,cinder:DELETE=10,cinder:INSERT=18 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:51:09 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=80,cinder:INSERT=32,cinder:UPDATE=108,cinder:DELETE=9 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:51:19 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-a81ed0d9-e83e-419f-b6f9-03c777c7c9e7 tempest-AttachVolumeTestJSON-730164755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:51:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a81ed0d9-e83e-419f-b6f9-03c777c7c9e7 tempest-AttachVolumeTestJSON-730164755 None] Flow 'volume_create_manager' (9523c6a4-8280-4054-b859-d192b5b6c577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:51:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a81ed0d9-e83e-419f-b6f9-03c777c7c9e7 tempest-AttachVolumeTestJSON-730164755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0e78e8f-a7be-4b73-a19e-178b8df5d1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:51:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a81ed0d9-e83e-419f-b6f9-03c777c7c9e7 tempest-AttachVolumeTestJSON-730164755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0e78e8f-a7be-4b73-a19e-178b8df5d1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1054872282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25c9b861-b9a3-4938-b432-6ecb0c304ded,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a58fe74906a46998000d372b02d8357',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:51:20Z,use_quota=True,user_id='fa0a9a5edf7947059442f3da72a35ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:51:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a81ed0d9-e83e-419f-b6f9-03c777c7c9e7 tempest-AttachVolumeTestJSON-730164755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (146b209c-b319-4c79-b878-566679d920ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:51:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a81ed0d9-e83e-419f-b6f9-03c777c7c9e7 tempest-AttachVolumeTestJSON-730164755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (146b209c-b319-4c79-b878-566679d920ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:51:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a81ed0d9-e83e-419f-b6f9-03c777c7c9e7 tempest-AttachVolumeTestJSON-730164755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fb80bce-e277-442a-ae7d-676718110c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:51:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a81ed0d9-e83e-419f-b6f9-03c777c7c9e7 tempest-AttachVolumeTestJSON-730164755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fb80bce-e277-442a-ae7d-676718110c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25c9b861-b9a3-4938-b432-6ecb0c304ded', 'volume_name': 'volume-25c9b861-b9a3-4938-b432-6ecb0c304ded', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:51:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a81ed0d9-e83e-419f-b6f9-03c777c7c9e7 tempest-AttachVolumeTestJSON-730164755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (416039a0-ff0d-4e12-8db3-cff9b6fde873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:51:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a81ed0d9-e83e-419f-b6f9-03c777c7c9e7 tempest-AttachVolumeTestJSON-730164755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (416039a0-ff0d-4e12-8db3-cff9b6fde873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:51:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a81ed0d9-e83e-419f-b6f9-03c777c7c9e7 tempest-AttachVolumeTestJSON-730164755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (943ba99d-619a-4260-a404-73feb9a6ec8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:51:19 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-a81ed0d9-e83e-419f-b6f9-03c777c7c9e7 tempest-AttachVolumeTestJSON-730164755 None] Volume 25c9b861-b9a3-4938-b432-6ecb0c304ded: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25c9b861-b9a3-4938-b432-6ecb0c304ded', 'volume_size': 1} Aug 11 04:51:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a81ed0d9-e83e-419f-b6f9-03c777c7c9e7 tempest-AttachVolumeTestJSON-730164755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:51:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a81ed0d9-e83e-419f-b6f9-03c777c7c9e7 tempest-AttachVolumeTestJSON-730164755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:51:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a81ed0d9-e83e-419f-b6f9-03c777c7c9e7 tempest-AttachVolumeTestJSON-730164755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1054872282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25c9b861-b9a3-4938-b432-6ecb0c304ded,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a58fe74906a46998000d372b02d8357',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:51:20Z,use_quota=True,user_id='fa0a9a5edf7947059442f3da72a35ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:51:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-a81ed0d9-e83e-419f-b6f9-03c777c7c9e7 tempest-AttachVolumeTestJSON-730164755 None] Creating volume 25c9b861-b9a3-4938-b432-6ecb0c304ded {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:51:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a81ed0d9-e83e-419f-b6f9-03c777c7c9e7 tempest-AttachVolumeTestJSON-730164755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:51:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a81ed0d9-e83e-419f-b6f9-03c777c7c9e7 tempest-AttachVolumeTestJSON-730164755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:51:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a81ed0d9-e83e-419f-b6f9-03c777c7c9e7 tempest-AttachVolumeTestJSON-730164755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:51:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a81ed0d9-e83e-419f-b6f9-03c777c7c9e7 tempest-AttachVolumeTestJSON-730164755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:51:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a81ed0d9-e83e-419f-b6f9-03c777c7c9e7 tempest-AttachVolumeTestJSON-730164755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:51:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a81ed0d9-e83e-419f-b6f9-03c777c7c9e7 tempest-AttachVolumeTestJSON-730164755 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:51:19 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-a81ed0d9-e83e-419f-b6f9-03c777c7c9e7 tempest-AttachVolumeTestJSON-730164755 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:51:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a81ed0d9-e83e-419f-b6f9-03c777c7c9e7 tempest-AttachVolumeTestJSON-730164755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-25c9b861-b9a3-4938-b432-6ecb0c304ded 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:51:19 devstack sudo[110193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-25c9b861-b9a3-4938-b432-6ecb0c304ded 1073741824 Aug 11 04:51:19 devstack sudo[110193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:51:20 devstack sudo[110193]: pam_unix(sudo:session): session closed for user root Aug 11 04:51:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a81ed0d9-e83e-419f-b6f9-03c777c7c9e7 tempest-AttachVolumeTestJSON-730164755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-25c9b861-b9a3-4938-b432-6ecb0c304ded 1073741824" returned: 0 in 0.439s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:51:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a81ed0d9-e83e-419f-b6f9-03c777c7c9e7 tempest-AttachVolumeTestJSON-730164755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-25c9b861-b9a3-4938-b432-6ecb0c304ded {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:51:20 devstack sudo[110199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-25c9b861-b9a3-4938-b432-6ecb0c304ded Aug 11 04:51:20 devstack sudo[110199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:51:20 devstack sudo[110199]: pam_unix(sudo:session): session closed for user root Aug 11 04:51:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a81ed0d9-e83e-419f-b6f9-03c777c7c9e7 tempest-AttachVolumeTestJSON-730164755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-25c9b861-b9a3-4938-b432-6ecb0c304ded" returned: 0 in 0.259s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:51:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a81ed0d9-e83e-419f-b6f9-03c777c7c9e7 tempest-AttachVolumeTestJSON-730164755 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:51:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a81ed0d9-e83e-419f-b6f9-03c777c7c9e7 tempest-AttachVolumeTestJSON-730164755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:51:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a81ed0d9-e83e-419f-b6f9-03c777c7c9e7 tempest-AttachVolumeTestJSON-730164755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (943ba99d-619a-4260-a404-73feb9a6ec8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25c9b861-b9a3-4938-b432-6ecb0c304ded', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:51:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a81ed0d9-e83e-419f-b6f9-03c777c7c9e7 tempest-AttachVolumeTestJSON-730164755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15a071bf-81d8-483b-ba71-31378370a4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:51:20 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-a81ed0d9-e83e-419f-b6f9-03c777c7c9e7 tempest-AttachVolumeTestJSON-730164755 None] Volume volume-25c9b861-b9a3-4938-b432-6ecb0c304ded (25c9b861-b9a3-4938-b432-6ecb0c304ded): created successfully Aug 11 04:51:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a81ed0d9-e83e-419f-b6f9-03c777c7c9e7 tempest-AttachVolumeTestJSON-730164755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15a071bf-81d8-483b-ba71-31378370a4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:51:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a81ed0d9-e83e-419f-b6f9-03c777c7c9e7 tempest-AttachVolumeTestJSON-730164755 None] Flow 'volume_create_manager' (9523c6a4-8280-4054-b859-d192b5b6c577) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:51:20 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-a81ed0d9-e83e-419f-b6f9-03c777c7c9e7 tempest-AttachVolumeTestJSON-730164755 None] Created volume successfully. Aug 11 04:51:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-04e2e46a-8734-43cb-8f8a-402f8b97b408 req-cd89bccf-b725-41e4-8494-c8b87b6c785d tempest-AttachVolumeTestJSON-730164755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:51:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-04e2e46a-8734-43cb-8f8a-402f8b97b408 req-cd89bccf-b725-41e4-8494-c8b87b6c785d tempest-AttachVolumeTestJSON-730164755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:51:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-04e2e46a-8734-43cb-8f8a-402f8b97b408 req-cd89bccf-b725-41e4-8494-c8b87b6c785d tempest-AttachVolumeTestJSON-730164755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:51:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-04e2e46a-8734-43cb-8f8a-402f8b97b408 req-cd89bccf-b725-41e4-8494-c8b87b6c785d tempest-AttachVolumeTestJSON-730164755 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd', 'name': 'volume-25c9b861-b9a3-4938-b432-6ecb0c304ded', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '65a06449-9ddc-4014-98c2-73aeb665d365', 'enforce_multipath': True} {{(pid=94472) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 11 04:51:22 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-04e2e46a-8734-43cb-8f8a-402f8b97b408 req-cd89bccf-b725-41e4-8494-c8b87b6c785d tempest-AttachVolumeTestJSON-730164755 None] attachment_update completed successfully. Aug 11 04:51:25 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b271877-b09a-4425-884a-6cbd9dde8052 tempest-AttachVolumeTestJSON-730164755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:51:25 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6b271877-b09a-4425-884a-6cbd9dde8052 tempest-AttachVolumeTestJSON-730164755 None] Flow 'volume_create_manager' (5425430b-224a-4543-881f-981d1d96986c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:51:25 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6b271877-b09a-4425-884a-6cbd9dde8052 tempest-AttachVolumeTestJSON-730164755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40b18f18-bc56-4e71-bd84-e8c62802c9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:51:25 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6b271877-b09a-4425-884a-6cbd9dde8052 tempest-AttachVolumeTestJSON-730164755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40b18f18-bc56-4e71-bd84-e8c62802c9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:51:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-565549311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78b5de26-2d57-4f58-84cd-51a25d726bf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a58fe74906a46998000d372b02d8357',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:51:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:51:25Z,use_quota=True,user_id='fa0a9a5edf7947059442f3da72a35ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:51:25 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6b271877-b09a-4425-884a-6cbd9dde8052 tempest-AttachVolumeTestJSON-730164755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa0d4887-4c57-459d-98cb-60aaf5260b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:51:25 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6b271877-b09a-4425-884a-6cbd9dde8052 tempest-AttachVolumeTestJSON-730164755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa0d4887-4c57-459d-98cb-60aaf5260b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:51:25 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6b271877-b09a-4425-884a-6cbd9dde8052 tempest-AttachVolumeTestJSON-730164755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09a6f83d-3e96-44ca-a51f-d52c13faba97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:51:25 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6b271877-b09a-4425-884a-6cbd9dde8052 tempest-AttachVolumeTestJSON-730164755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09a6f83d-3e96-44ca-a51f-d52c13faba97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78b5de26-2d57-4f58-84cd-51a25d726bf1', 'volume_name': 'volume-78b5de26-2d57-4f58-84cd-51a25d726bf1', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:51:25 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6b271877-b09a-4425-884a-6cbd9dde8052 tempest-AttachVolumeTestJSON-730164755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc42a948-4cf5-4a35-8450-c79496d3d5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:51:25 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6b271877-b09a-4425-884a-6cbd9dde8052 tempest-AttachVolumeTestJSON-730164755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc42a948-4cf5-4a35-8450-c79496d3d5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:51:25 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6b271877-b09a-4425-884a-6cbd9dde8052 tempest-AttachVolumeTestJSON-730164755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b4bd189-7d18-4e5d-be3f-1a785b448ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:51:25 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-6b271877-b09a-4425-884a-6cbd9dde8052 tempest-AttachVolumeTestJSON-730164755 None] Volume 78b5de26-2d57-4f58-84cd-51a25d726bf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78b5de26-2d57-4f58-84cd-51a25d726bf1', 'volume_size': 1} Aug 11 04:51:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6b271877-b09a-4425-884a-6cbd9dde8052 tempest-AttachVolumeTestJSON-730164755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:51:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6b271877-b09a-4425-884a-6cbd9dde8052 tempest-AttachVolumeTestJSON-730164755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:51:25 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6b271877-b09a-4425-884a-6cbd9dde8052 tempest-AttachVolumeTestJSON-730164755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:51:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-565549311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78b5de26-2d57-4f58-84cd-51a25d726bf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a58fe74906a46998000d372b02d8357',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:51:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:51:25Z,use_quota=True,user_id='fa0a9a5edf7947059442f3da72a35ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:51:25 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-6b271877-b09a-4425-884a-6cbd9dde8052 tempest-AttachVolumeTestJSON-730164755 None] Creating volume 78b5de26-2d57-4f58-84cd-51a25d726bf1 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:51:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6b271877-b09a-4425-884a-6cbd9dde8052 tempest-AttachVolumeTestJSON-730164755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:51:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6b271877-b09a-4425-884a-6cbd9dde8052 tempest-AttachVolumeTestJSON-730164755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:51:25 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6b271877-b09a-4425-884a-6cbd9dde8052 tempest-AttachVolumeTestJSON-730164755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:51:25 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6b271877-b09a-4425-884a-6cbd9dde8052 tempest-AttachVolumeTestJSON-730164755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:51:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6b271877-b09a-4425-884a-6cbd9dde8052 tempest-AttachVolumeTestJSON-730164755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:51:25 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6b271877-b09a-4425-884a-6cbd9dde8052 tempest-AttachVolumeTestJSON-730164755 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:51:25 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-6b271877-b09a-4425-884a-6cbd9dde8052 tempest-AttachVolumeTestJSON-730164755 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:51:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6b271877-b09a-4425-884a-6cbd9dde8052 tempest-AttachVolumeTestJSON-730164755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-78b5de26-2d57-4f58-84cd-51a25d726bf1 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:51:25 devstack sudo[110605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-78b5de26-2d57-4f58-84cd-51a25d726bf1 1073741824 Aug 11 04:51:25 devstack sudo[110605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:51:25 devstack sudo[110605]: pam_unix(sudo:session): session closed for user root Aug 11 04:51:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6b271877-b09a-4425-884a-6cbd9dde8052 tempest-AttachVolumeTestJSON-730164755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-78b5de26-2d57-4f58-84cd-51a25d726bf1 1073741824" returned: 0 in 0.518s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:51:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6b271877-b09a-4425-884a-6cbd9dde8052 tempest-AttachVolumeTestJSON-730164755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-78b5de26-2d57-4f58-84cd-51a25d726bf1 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:51:25 devstack sudo[110611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-78b5de26-2d57-4f58-84cd-51a25d726bf1 Aug 11 04:51:25 devstack sudo[110611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:51:26 devstack sudo[110611]: pam_unix(sudo:session): session closed for user root Aug 11 04:51:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6b271877-b09a-4425-884a-6cbd9dde8052 tempest-AttachVolumeTestJSON-730164755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-78b5de26-2d57-4f58-84cd-51a25d726bf1" returned: 0 in 0.253s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:51:26 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6b271877-b09a-4425-884a-6cbd9dde8052 tempest-AttachVolumeTestJSON-730164755 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:51:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6b271877-b09a-4425-884a-6cbd9dde8052 tempest-AttachVolumeTestJSON-730164755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:51:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6b271877-b09a-4425-884a-6cbd9dde8052 tempest-AttachVolumeTestJSON-730164755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b4bd189-7d18-4e5d-be3f-1a785b448ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78b5de26-2d57-4f58-84cd-51a25d726bf1', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:51:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6b271877-b09a-4425-884a-6cbd9dde8052 tempest-AttachVolumeTestJSON-730164755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aedd28f8-418d-463f-9be3-efc4889810be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:51:26 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-6b271877-b09a-4425-884a-6cbd9dde8052 tempest-AttachVolumeTestJSON-730164755 None] Volume volume-78b5de26-2d57-4f58-84cd-51a25d726bf1 (78b5de26-2d57-4f58-84cd-51a25d726bf1): created successfully Aug 11 04:51:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6b271877-b09a-4425-884a-6cbd9dde8052 tempest-AttachVolumeTestJSON-730164755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aedd28f8-418d-463f-9be3-efc4889810be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:51:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6b271877-b09a-4425-884a-6cbd9dde8052 tempest-AttachVolumeTestJSON-730164755 None] Flow 'volume_create_manager' (5425430b-224a-4543-881f-981d1d96986c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:51:26 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-6b271877-b09a-4425-884a-6cbd9dde8052 tempest-AttachVolumeTestJSON-730164755 None] Created volume successfully. Aug 11 04:51:27 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8cb3da7-31bf-410a-9a28-99cb01c524d3 tempest-TestStampPattern-1401503402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:51:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d8cb3da7-31bf-410a-9a28-99cb01c524d3 tempest-TestStampPattern-1401503402 None] Flow 'volume_create_manager' (0ab3345d-d086-4ce8-b33f-f3f1a47e27c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:51:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d8cb3da7-31bf-410a-9a28-99cb01c524d3 tempest-TestStampPattern-1401503402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac0f914e-6715-48d6-87ab-80c3640e75e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:51:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d8cb3da7-31bf-410a-9a28-99cb01c524d3 tempest-TestStampPattern-1401503402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac0f914e-6715-48d6-87ab-80c3640e75e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1305003447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7882da0-8442-4172-9cbc-fff1eb23344a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3402c881b7604cd987926cef40e0a7a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:51:28Z,use_quota=True,user_id='293791954de14ed5875aae566cdb7a24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:51:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d8cb3da7-31bf-410a-9a28-99cb01c524d3 tempest-TestStampPattern-1401503402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a85f6c7c-d399-4c00-96e7-6e9f97dd0177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:51:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d8cb3da7-31bf-410a-9a28-99cb01c524d3 tempest-TestStampPattern-1401503402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a85f6c7c-d399-4c00-96e7-6e9f97dd0177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:51:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d8cb3da7-31bf-410a-9a28-99cb01c524d3 tempest-TestStampPattern-1401503402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0302266-5838-416d-a1fb-542f8d3def39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:51:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d8cb3da7-31bf-410a-9a28-99cb01c524d3 tempest-TestStampPattern-1401503402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0302266-5838-416d-a1fb-542f8d3def39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7882da0-8442-4172-9cbc-fff1eb23344a', 'volume_name': 'volume-c7882da0-8442-4172-9cbc-fff1eb23344a', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:51:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d8cb3da7-31bf-410a-9a28-99cb01c524d3 tempest-TestStampPattern-1401503402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da5354f1-c31c-416e-81dc-ce835d4c60b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:51:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d8cb3da7-31bf-410a-9a28-99cb01c524d3 tempest-TestStampPattern-1401503402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da5354f1-c31c-416e-81dc-ce835d4c60b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:51:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d8cb3da7-31bf-410a-9a28-99cb01c524d3 tempest-TestStampPattern-1401503402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27b03757-5335-47a3-ac89-654b1bae8f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:51:28 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-d8cb3da7-31bf-410a-9a28-99cb01c524d3 tempest-TestStampPattern-1401503402 None] Volume c7882da0-8442-4172-9cbc-fff1eb23344a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7882da0-8442-4172-9cbc-fff1eb23344a', 'volume_size': 1} Aug 11 04:51:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d8cb3da7-31bf-410a-9a28-99cb01c524d3 tempest-TestStampPattern-1401503402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:51:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d8cb3da7-31bf-410a-9a28-99cb01c524d3 tempest-TestStampPattern-1401503402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:51:28 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d8cb3da7-31bf-410a-9a28-99cb01c524d3 tempest-TestStampPattern-1401503402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1305003447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7882da0-8442-4172-9cbc-fff1eb23344a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3402c881b7604cd987926cef40e0a7a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:51:28Z,use_quota=True,user_id='293791954de14ed5875aae566cdb7a24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:51:28 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-d8cb3da7-31bf-410a-9a28-99cb01c524d3 tempest-TestStampPattern-1401503402 None] Creating volume c7882da0-8442-4172-9cbc-fff1eb23344a {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:51:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d8cb3da7-31bf-410a-9a28-99cb01c524d3 tempest-TestStampPattern-1401503402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:51:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d8cb3da7-31bf-410a-9a28-99cb01c524d3 tempest-TestStampPattern-1401503402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:51:28 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d8cb3da7-31bf-410a-9a28-99cb01c524d3 tempest-TestStampPattern-1401503402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:51:28 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d8cb3da7-31bf-410a-9a28-99cb01c524d3 tempest-TestStampPattern-1401503402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:51:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d8cb3da7-31bf-410a-9a28-99cb01c524d3 tempest-TestStampPattern-1401503402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:51:28 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d8cb3da7-31bf-410a-9a28-99cb01c524d3 tempest-TestStampPattern-1401503402 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:51:28 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-d8cb3da7-31bf-410a-9a28-99cb01c524d3 tempest-TestStampPattern-1401503402 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:51:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d8cb3da7-31bf-410a-9a28-99cb01c524d3 tempest-TestStampPattern-1401503402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:51:28 devstack sudo[110620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a 1073741824 Aug 11 04:51:28 devstack sudo[110620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:51:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-ca6648b7-6efe-491f-a654-fccd2605c41e req-2141c69a-812a-412e-8daa-28e6e7b66b8c tempest-AttachVolumeTestJSON-730164755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:51:28 devstack sudo[110620]: pam_unix(sudo:session): session closed for user root Aug 11 04:51:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d8cb3da7-31bf-410a-9a28-99cb01c524d3 tempest-TestStampPattern-1401503402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a 1073741824" returned: 0 in 0.472s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:51:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d8cb3da7-31bf-410a-9a28-99cb01c524d3 tempest-TestStampPattern-1401503402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:51:28 devstack sudo[110631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a Aug 11 04:51:28 devstack sudo[110631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:51:28 devstack sudo[110631]: pam_unix(sudo:session): session closed for user root Aug 11 04:51:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d8cb3da7-31bf-410a-9a28-99cb01c524d3 tempest-TestStampPattern-1401503402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a" returned: 0 in 0.250s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:51:28 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d8cb3da7-31bf-410a-9a28-99cb01c524d3 tempest-TestStampPattern-1401503402 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:51:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d8cb3da7-31bf-410a-9a28-99cb01c524d3 tempest-TestStampPattern-1401503402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:51:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-ca6648b7-6efe-491f-a654-fccd2605c41e req-2141c69a-812a-412e-8daa-28e6e7b66b8c tempest-AttachVolumeTestJSON-730164755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.545s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:51:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-ca6648b7-6efe-491f-a654-fccd2605c41e req-2141c69a-812a-412e-8daa-28e6e7b66b8c tempest-AttachVolumeTestJSON-730164755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:51:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d8cb3da7-31bf-410a-9a28-99cb01c524d3 tempest-TestStampPattern-1401503402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27b03757-5335-47a3-ac89-654b1bae8f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7882da0-8442-4172-9cbc-fff1eb23344a', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:51:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d8cb3da7-31bf-410a-9a28-99cb01c524d3 tempest-TestStampPattern-1401503402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ed70493-0c6b-4b99-94aa-d5905d4766b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:51:28 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-d8cb3da7-31bf-410a-9a28-99cb01c524d3 tempest-TestStampPattern-1401503402 None] Volume volume-c7882da0-8442-4172-9cbc-fff1eb23344a (c7882da0-8442-4172-9cbc-fff1eb23344a): created successfully Aug 11 04:51:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d8cb3da7-31bf-410a-9a28-99cb01c524d3 tempest-TestStampPattern-1401503402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ed70493-0c6b-4b99-94aa-d5905d4766b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:51:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d8cb3da7-31bf-410a-9a28-99cb01c524d3 tempest-TestStampPattern-1401503402 None] Flow 'volume_create_manager' (0ab3345d-d086-4ce8-b33f-f3f1a47e27c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:51:28 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-d8cb3da7-31bf-410a-9a28-99cb01c524d3 tempest-TestStampPattern-1401503402 None] Created volume successfully. Aug 11 04:51:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-ca6648b7-6efe-491f-a654-fccd2605c41e req-2141c69a-812a-412e-8daa-28e6e7b66b8c tempest-AttachVolumeTestJSON-730164755 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd', 'name': 'volume-78b5de26-2d57-4f58-84cd-51a25d726bf1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '180a2272-9861-48b3-b5c6-12a6762f152f', 'enforce_multipath': True} {{(pid=94472) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 11 04:51:29 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-ca6648b7-6efe-491f-a654-fccd2605c41e req-2141c69a-812a-412e-8daa-28e6e7b66b8c tempest-AttachVolumeTestJSON-730164755 None] attachment_update completed successfully. Aug 11 04:51:31 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-a883e504-b417-46e5-b69f-8b3b2d9c2389 req-2ee7a4eb-834f-488e-8954-b38024681e54 tempest-AttachVolumeTestJSON-730164755 None] Terminate volume connection completed successfully. Aug 11 04:51:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-a883e504-b417-46e5-b69f-8b3b2d9c2389 req-2ee7a4eb-834f-488e-8954-b38024681e54 tempest-AttachVolumeTestJSON-730164755 None] Deleting attachment 65a06449-9ddc-4014-98c2-73aeb665d365. {{(pid=94472) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 11 04:51:33 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-9d476f46-9d31-47a7-bd2f-1d8850052291 req-d350f32a-29d0-402e-a5e6-f6c6eecce4e7 tempest-AttachVolumeTestJSON-730164755 None] Terminate volume connection completed successfully. Aug 11 04:51:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-9d476f46-9d31-47a7-bd2f-1d8850052291 req-d350f32a-29d0-402e-a5e6-f6c6eecce4e7 tempest-AttachVolumeTestJSON-730164755 None] Deleting attachment 180a2272-9861-48b3-b5c6-12a6762f152f. {{(pid=94472) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 11 04:51:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2167b3fc-4d60-42c4-a2ea-b96fb5d03a61 tempest-AttachVolumeTestJSON-730164755 None] Acquiring lock "cinder-78b5de26-2d57-4f58-84cd-51a25d726bf1-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:51:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2167b3fc-4d60-42c4-a2ea-b96fb5d03a61 tempest-AttachVolumeTestJSON-730164755 None] Lock "cinder-78b5de26-2d57-4f58-84cd-51a25d726bf1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:51:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2167b3fc-4d60-42c4-a2ea-b96fb5d03a61 tempest-AttachVolumeTestJSON-730164755 None] Acquiring lock "cinder-quobyte-78b5de26-2d57-4f58-84cd-51a25d726bf1" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:51:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2167b3fc-4d60-42c4-a2ea-b96fb5d03a61 tempest-AttachVolumeTestJSON-730164755 None] Lock "cinder-quobyte-78b5de26-2d57-4f58-84cd-51a25d726bf1" acquired by "delete_volume" :: waited 0.037s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:51:37 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[376e540b-ba72-48bc-90e2-58ea1313b452]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:51:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2167b3fc-4d60-42c4-a2ea-b96fb5d03a61 tempest-AttachVolumeTestJSON-730164755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-78b5de26-2d57-4f58-84cd-51a25d726bf1 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:51:38 devstack sudo[110803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-78b5de26-2d57-4f58-84cd-51a25d726bf1 Aug 11 04:51:38 devstack sudo[110803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:51:38 devstack sudo[110803]: pam_unix(sudo:session): session closed for user root Aug 11 04:51:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2167b3fc-4d60-42c4-a2ea-b96fb5d03a61 tempest-AttachVolumeTestJSON-730164755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-78b5de26-2d57-4f58-84cd-51a25d726bf1" returned: 0 in 0.385s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:51:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2167b3fc-4d60-42c4-a2ea-b96fb5d03a61 tempest-AttachVolumeTestJSON-730164755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-78b5de26-2d57-4f58-84cd-51a25d726bf1 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:51:38 devstack sudo[110809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-78b5de26-2d57-4f58-84cd-51a25d726bf1 Aug 11 04:51:38 devstack sudo[110809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:51:38 devstack sudo[110809]: pam_unix(sudo:session): session closed for user root Aug 11 04:51:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2167b3fc-4d60-42c4-a2ea-b96fb5d03a61 tempest-AttachVolumeTestJSON-730164755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-78b5de26-2d57-4f58-84cd-51a25d726bf1" returned: 0 in 0.276s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:51:38 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2167b3fc-4d60-42c4-a2ea-b96fb5d03a61 tempest-AttachVolumeTestJSON-730164755 None] Lock "cinder-quobyte-78b5de26-2d57-4f58-84cd-51a25d726bf1" released by "delete_volume" :: held 0.711s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:51:38 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-2167b3fc-4d60-42c4-a2ea-b96fb5d03a61 tempest-AttachVolumeTestJSON-730164755 None] Created reservations ['a143c55c-2d52-46df-8d4d-994a81c5525d', '4c4908c9-d03f-4223-8fa0-bf446401a7e6', 'cb60c252-8cb9-4eb0-8dcb-ce0a264987be', '2e537c69-7307-42f4-86cf-77825aeabb30'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:51:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2167b3fc-4d60-42c4-a2ea-b96fb5d03a61 tempest-AttachVolumeTestJSON-730164755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:51:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2167b3fc-4d60-42c4-a2ea-b96fb5d03a61 tempest-AttachVolumeTestJSON-730164755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:51:38 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2167b3fc-4d60-42c4-a2ea-b96fb5d03a61 tempest-AttachVolumeTestJSON-730164755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:51:38 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2167b3fc-4d60-42c4-a2ea-b96fb5d03a61 tempest-AttachVolumeTestJSON-730164755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:51:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2167b3fc-4d60-42c4-a2ea-b96fb5d03a61 tempest-AttachVolumeTestJSON-730164755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:51:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2167b3fc-4d60-42c4-a2ea-b96fb5d03a61 tempest-AttachVolumeTestJSON-730164755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:51:38 devstack sudo[110813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:51:38 devstack sudo[110813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:51:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d7d751a3-d333-460c-b923-b70edda08292 tempest-AttachVolumeTestJSON-730164755 None] Acquiring lock "cinder-25c9b861-b9a3-4938-b432-6ecb0c304ded-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:51:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d7d751a3-d333-460c-b923-b70edda08292 tempest-AttachVolumeTestJSON-730164755 None] Lock "cinder-25c9b861-b9a3-4938-b432-6ecb0c304ded-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:51:39 devstack sudo[110813]: pam_unix(sudo:session): session closed for user root Aug 11 04:51:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2167b3fc-4d60-42c4-a2ea-b96fb5d03a61 tempest-AttachVolumeTestJSON-730164755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.343s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:51:39 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-2167b3fc-4d60-42c4-a2ea-b96fb5d03a61 tempest-AttachVolumeTestJSON-730164755 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:51:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d7d751a3-d333-460c-b923-b70edda08292 tempest-AttachVolumeTestJSON-730164755 None] Acquiring lock "cinder-quobyte-25c9b861-b9a3-4938-b432-6ecb0c304ded" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:51:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d7d751a3-d333-460c-b923-b70edda08292 tempest-AttachVolumeTestJSON-730164755 None] Lock "cinder-quobyte-25c9b861-b9a3-4938-b432-6ecb0c304ded" acquired by "delete_volume" :: waited 0.012s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:51:39 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-2167b3fc-4d60-42c4-a2ea-b96fb5d03a61 tempest-AttachVolumeTestJSON-730164755 None] Deleted volume successfully. Aug 11 04:51:39 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fefe53-f278-42e1-915c-5099ab645883]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:51:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d7d751a3-d333-460c-b923-b70edda08292 tempest-AttachVolumeTestJSON-730164755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-25c9b861-b9a3-4938-b432-6ecb0c304ded {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:51:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2167b3fc-4d60-42c4-a2ea-b96fb5d03a61 tempest-AttachVolumeTestJSON-730164755 None] Lock "cinder-78b5de26-2d57-4f58-84cd-51a25d726bf1-delete_volume" released by "delete_volume" :: held 1.399s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:51:39 devstack sudo[110816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-25c9b861-b9a3-4938-b432-6ecb0c304ded Aug 11 04:51:39 devstack sudo[110816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:51:39 devstack sudo[110816]: pam_unix(sudo:session): session closed for user root Aug 11 04:51:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d7d751a3-d333-460c-b923-b70edda08292 tempest-AttachVolumeTestJSON-730164755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-25c9b861-b9a3-4938-b432-6ecb0c304ded" returned: 0 in 0.410s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:51:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d7d751a3-d333-460c-b923-b70edda08292 tempest-AttachVolumeTestJSON-730164755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-25c9b861-b9a3-4938-b432-6ecb0c304ded {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:51:39 devstack sudo[110823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-25c9b861-b9a3-4938-b432-6ecb0c304ded Aug 11 04:51:39 devstack sudo[110823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:51:39 devstack sudo[110823]: pam_unix(sudo:session): session closed for user root Aug 11 04:51:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d7d751a3-d333-460c-b923-b70edda08292 tempest-AttachVolumeTestJSON-730164755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-25c9b861-b9a3-4938-b432-6ecb0c304ded" returned: 0 in 0.253s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:51:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d7d751a3-d333-460c-b923-b70edda08292 tempest-AttachVolumeTestJSON-730164755 None] Lock "cinder-quobyte-25c9b861-b9a3-4938-b432-6ecb0c304ded" released by "delete_volume" :: held 0.715s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:51:39 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-d7d751a3-d333-460c-b923-b70edda08292 tempest-AttachVolumeTestJSON-730164755 None] Created reservations ['72991c66-8d00-4f47-ac51-de23e183f65b', '9be0abfe-250d-43f3-a4b8-834ed8166371', '1a1fa37d-ce18-4512-b759-e56ba45c8296', '88033870-3d65-4d34-9378-cc034a1b2c56'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:51:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d7d751a3-d333-460c-b923-b70edda08292 tempest-AttachVolumeTestJSON-730164755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:51:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d7d751a3-d333-460c-b923-b70edda08292 tempest-AttachVolumeTestJSON-730164755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:51:40 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d7d751a3-d333-460c-b923-b70edda08292 tempest-AttachVolumeTestJSON-730164755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:51:40 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d7d751a3-d333-460c-b923-b70edda08292 tempest-AttachVolumeTestJSON-730164755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:51:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d7d751a3-d333-460c-b923-b70edda08292 tempest-AttachVolumeTestJSON-730164755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:51:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d7d751a3-d333-460c-b923-b70edda08292 tempest-AttachVolumeTestJSON-730164755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:51:40 devstack sudo[110826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:51:40 devstack sudo[110826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:51:40 devstack sudo[110826]: pam_unix(sudo:session): session closed for user root Aug 11 04:51:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d7d751a3-d333-460c-b923-b70edda08292 tempest-AttachVolumeTestJSON-730164755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.249s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:51:40 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-d7d751a3-d333-460c-b923-b70edda08292 tempest-AttachVolumeTestJSON-730164755 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:51:40 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-d7d751a3-d333-460c-b923-b70edda08292 tempest-AttachVolumeTestJSON-730164755 None] Deleted volume successfully. Aug 11 04:51:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d7d751a3-d333-460c-b923-b70edda08292 tempest-AttachVolumeTestJSON-730164755 None] Lock "cinder-25c9b861-b9a3-4938-b432-6ecb0c304ded-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:51:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-81f9ebf8-bbe9-4a0f-befc-e4d47132ba72 tempest-AttachVolumeTestJSON-730164755 None] Acquiring lock "cinder-00686a76-d01d-4ab6-a3d4-3f7ef5197598-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:51:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-81f9ebf8-bbe9-4a0f-befc-e4d47132ba72 tempest-AttachVolumeTestJSON-730164755 None] Lock "cinder-00686a76-d01d-4ab6-a3d4-3f7ef5197598-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:51:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-81f9ebf8-bbe9-4a0f-befc-e4d47132ba72 tempest-AttachVolumeTestJSON-730164755 None] Acquiring lock "cinder-quobyte-00686a76-d01d-4ab6-a3d4-3f7ef5197598" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:51:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-81f9ebf8-bbe9-4a0f-befc-e4d47132ba72 tempest-AttachVolumeTestJSON-730164755 None] Lock "cinder-quobyte-00686a76-d01d-4ab6-a3d4-3f7ef5197598" acquired by "delete_volume" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:51:40 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8345a56-fa58-4ee2-9d32-e34036befaa9]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:51:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-81f9ebf8-bbe9-4a0f-befc-e4d47132ba72 tempest-AttachVolumeTestJSON-730164755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-00686a76-d01d-4ab6-a3d4-3f7ef5197598 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:51:40 devstack sudo[110829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-00686a76-d01d-4ab6-a3d4-3f7ef5197598 Aug 11 04:51:40 devstack sudo[110829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:51:40 devstack sudo[110829]: pam_unix(sudo:session): session closed for user root Aug 11 04:51:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-81f9ebf8-bbe9-4a0f-befc-e4d47132ba72 tempest-AttachVolumeTestJSON-730164755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-00686a76-d01d-4ab6-a3d4-3f7ef5197598" returned: 0 in 0.376s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:51:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-81f9ebf8-bbe9-4a0f-befc-e4d47132ba72 tempest-AttachVolumeTestJSON-730164755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-00686a76-d01d-4ab6-a3d4-3f7ef5197598 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:51:40 devstack sudo[110834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-00686a76-d01d-4ab6-a3d4-3f7ef5197598 Aug 11 04:51:40 devstack sudo[110834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:51:41 devstack sudo[110834]: pam_unix(sudo:session): session closed for user root Aug 11 04:51:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-81f9ebf8-bbe9-4a0f-befc-e4d47132ba72 tempest-AttachVolumeTestJSON-730164755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-00686a76-d01d-4ab6-a3d4-3f7ef5197598" returned: 0 in 0.251s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:51:41 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-81f9ebf8-bbe9-4a0f-befc-e4d47132ba72 tempest-AttachVolumeTestJSON-730164755 None] Lock "cinder-quobyte-00686a76-d01d-4ab6-a3d4-3f7ef5197598" released by "delete_volume" :: held 0.671s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:51:41 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-81f9ebf8-bbe9-4a0f-befc-e4d47132ba72 tempest-AttachVolumeTestJSON-730164755 None] Created reservations ['42e69d79-4383-4f86-b831-34141593e41b', '1b75204c-d17f-4fd2-9023-7de3a9f006a1', '6daeb026-1be8-4041-8ca2-9a00efe3a196', '06796e13-d870-4f53-b8e4-81eb11f84c4e'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:51:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-81f9ebf8-bbe9-4a0f-befc-e4d47132ba72 tempest-AttachVolumeTestJSON-730164755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:51:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-81f9ebf8-bbe9-4a0f-befc-e4d47132ba72 tempest-AttachVolumeTestJSON-730164755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:51:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-81f9ebf8-bbe9-4a0f-befc-e4d47132ba72 tempest-AttachVolumeTestJSON-730164755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:51:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-81f9ebf8-bbe9-4a0f-befc-e4d47132ba72 tempest-AttachVolumeTestJSON-730164755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:51:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-81f9ebf8-bbe9-4a0f-befc-e4d47132ba72 tempest-AttachVolumeTestJSON-730164755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:51:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-81f9ebf8-bbe9-4a0f-befc-e4d47132ba72 tempest-AttachVolumeTestJSON-730164755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:51:41 devstack sudo[110837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:51:41 devstack sudo[110837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:51:41 devstack sudo[110837]: pam_unix(sudo:session): session closed for user root Aug 11 04:51:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-81f9ebf8-bbe9-4a0f-befc-e4d47132ba72 tempest-AttachVolumeTestJSON-730164755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.267s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:51:41 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-81f9ebf8-bbe9-4a0f-befc-e4d47132ba72 tempest-AttachVolumeTestJSON-730164755 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:51:41 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-81f9ebf8-bbe9-4a0f-befc-e4d47132ba72 tempest-AttachVolumeTestJSON-730164755 None] Deleted volume successfully. Aug 11 04:51:41 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-81f9ebf8-bbe9-4a0f-befc-e4d47132ba72 tempest-AttachVolumeTestJSON-730164755 None] Lock "cinder-00686a76-d01d-4ab6-a3d4-3f7ef5197598-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:51:49 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [req-76583e9d-d1fe-4f8d-be8b-c6f10f673532 req-099a0a03-e217-43ed-81fb-3dd9c6645209 tempest-VolumesSnapshotsTestJSON-707057637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:51:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-76583e9d-d1fe-4f8d-be8b-c6f10f673532 req-099a0a03-e217-43ed-81fb-3dd9c6645209 tempest-VolumesSnapshotsTestJSON-707057637 None] Flow 'volume_create_manager' (98809221-5d26-403d-8a63-4669fd4772f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:51:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-76583e9d-d1fe-4f8d-be8b-c6f10f673532 req-099a0a03-e217-43ed-81fb-3dd9c6645209 tempest-VolumesSnapshotsTestJSON-707057637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8dd87ff-a481-45fa-be88-f6ebff1035ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:51:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-76583e9d-d1fe-4f8d-be8b-c6f10f673532 req-099a0a03-e217-43ed-81fb-3dd9c6645209 tempest-VolumesSnapshotsTestJSON-707057637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8dd87ff-a481-45fa-be88-f6ebff1035ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:51:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-879837232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dca7741-1abe-4891-9948-a859645ca450,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ee3c133284e4fc1a6eb84e11a9ffb79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:51:49Z,use_quota=True,user_id='967d1f690f5e430485aefc64045c2947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:51:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-76583e9d-d1fe-4f8d-be8b-c6f10f673532 req-099a0a03-e217-43ed-81fb-3dd9c6645209 tempest-VolumesSnapshotsTestJSON-707057637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d640f50d-3c0b-4620-bfab-b488009d7d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:51:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-76583e9d-d1fe-4f8d-be8b-c6f10f673532 req-099a0a03-e217-43ed-81fb-3dd9c6645209 tempest-VolumesSnapshotsTestJSON-707057637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d640f50d-3c0b-4620-bfab-b488009d7d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:51:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-76583e9d-d1fe-4f8d-be8b-c6f10f673532 req-099a0a03-e217-43ed-81fb-3dd9c6645209 tempest-VolumesSnapshotsTestJSON-707057637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8135fdfb-e839-440d-b113-71661eeed205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:51:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-76583e9d-d1fe-4f8d-be8b-c6f10f673532 req-099a0a03-e217-43ed-81fb-3dd9c6645209 tempest-VolumesSnapshotsTestJSON-707057637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8135fdfb-e839-440d-b113-71661eeed205) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dca7741-1abe-4891-9948-a859645ca450', 'volume_name': 'volume-5dca7741-1abe-4891-9948-a859645ca450', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:51:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-76583e9d-d1fe-4f8d-be8b-c6f10f673532 req-099a0a03-e217-43ed-81fb-3dd9c6645209 tempest-VolumesSnapshotsTestJSON-707057637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad2b3d2b-4e48-49c7-8ef2-f0b0c2c6fea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:51:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-76583e9d-d1fe-4f8d-be8b-c6f10f673532 req-099a0a03-e217-43ed-81fb-3dd9c6645209 tempest-VolumesSnapshotsTestJSON-707057637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad2b3d2b-4e48-49c7-8ef2-f0b0c2c6fea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:51:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-76583e9d-d1fe-4f8d-be8b-c6f10f673532 req-099a0a03-e217-43ed-81fb-3dd9c6645209 tempest-VolumesSnapshotsTestJSON-707057637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9baa404-9e3f-49b9-ac1c-fde420bfa103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:51:49 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [req-76583e9d-d1fe-4f8d-be8b-c6f10f673532 req-099a0a03-e217-43ed-81fb-3dd9c6645209 tempest-VolumesSnapshotsTestJSON-707057637 None] Volume 5dca7741-1abe-4891-9948-a859645ca450: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dca7741-1abe-4891-9948-a859645ca450', 'volume_size': 1} Aug 11 04:51:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-76583e9d-d1fe-4f8d-be8b-c6f10f673532 req-099a0a03-e217-43ed-81fb-3dd9c6645209 tempest-VolumesSnapshotsTestJSON-707057637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:51:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-76583e9d-d1fe-4f8d-be8b-c6f10f673532 req-099a0a03-e217-43ed-81fb-3dd9c6645209 tempest-VolumesSnapshotsTestJSON-707057637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:51:49 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [req-76583e9d-d1fe-4f8d-be8b-c6f10f673532 req-099a0a03-e217-43ed-81fb-3dd9c6645209 tempest-VolumesSnapshotsTestJSON-707057637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:51:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-879837232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dca7741-1abe-4891-9948-a859645ca450,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ee3c133284e4fc1a6eb84e11a9ffb79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:51:49Z,use_quota=True,user_id='967d1f690f5e430485aefc64045c2947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:51:49 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [req-76583e9d-d1fe-4f8d-be8b-c6f10f673532 req-099a0a03-e217-43ed-81fb-3dd9c6645209 tempest-VolumesSnapshotsTestJSON-707057637 None] Creating volume 5dca7741-1abe-4891-9948-a859645ca450 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:51:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-76583e9d-d1fe-4f8d-be8b-c6f10f673532 req-099a0a03-e217-43ed-81fb-3dd9c6645209 tempest-VolumesSnapshotsTestJSON-707057637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:51:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-76583e9d-d1fe-4f8d-be8b-c6f10f673532 req-099a0a03-e217-43ed-81fb-3dd9c6645209 tempest-VolumesSnapshotsTestJSON-707057637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:51:49 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [req-76583e9d-d1fe-4f8d-be8b-c6f10f673532 req-099a0a03-e217-43ed-81fb-3dd9c6645209 tempest-VolumesSnapshotsTestJSON-707057637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:51:49 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [req-76583e9d-d1fe-4f8d-be8b-c6f10f673532 req-099a0a03-e217-43ed-81fb-3dd9c6645209 tempest-VolumesSnapshotsTestJSON-707057637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:51:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-76583e9d-d1fe-4f8d-be8b-c6f10f673532 req-099a0a03-e217-43ed-81fb-3dd9c6645209 tempest-VolumesSnapshotsTestJSON-707057637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:51:49 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [req-76583e9d-d1fe-4f8d-be8b-c6f10f673532 req-099a0a03-e217-43ed-81fb-3dd9c6645209 tempest-VolumesSnapshotsTestJSON-707057637 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:51:49 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [req-76583e9d-d1fe-4f8d-be8b-c6f10f673532 req-099a0a03-e217-43ed-81fb-3dd9c6645209 tempest-VolumesSnapshotsTestJSON-707057637 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:51:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-76583e9d-d1fe-4f8d-be8b-c6f10f673532 req-099a0a03-e217-43ed-81fb-3dd9c6645209 tempest-VolumesSnapshotsTestJSON-707057637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5dca7741-1abe-4891-9948-a859645ca450 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:51:49 devstack sudo[110858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5dca7741-1abe-4891-9948-a859645ca450 1073741824 Aug 11 04:51:49 devstack sudo[110858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:51:49 devstack sudo[110858]: pam_unix(sudo:session): session closed for user root Aug 11 04:51:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-76583e9d-d1fe-4f8d-be8b-c6f10f673532 req-099a0a03-e217-43ed-81fb-3dd9c6645209 tempest-VolumesSnapshotsTestJSON-707057637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5dca7741-1abe-4891-9948-a859645ca450 1073741824" returned: 0 in 0.429s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:51:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-76583e9d-d1fe-4f8d-be8b-c6f10f673532 req-099a0a03-e217-43ed-81fb-3dd9c6645209 tempest-VolumesSnapshotsTestJSON-707057637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5dca7741-1abe-4891-9948-a859645ca450 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:51:49 devstack sudo[110864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5dca7741-1abe-4891-9948-a859645ca450 Aug 11 04:51:49 devstack sudo[110864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:51:49 devstack sudo[110864]: pam_unix(sudo:session): session closed for user root Aug 11 04:51:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-76583e9d-d1fe-4f8d-be8b-c6f10f673532 req-099a0a03-e217-43ed-81fb-3dd9c6645209 tempest-VolumesSnapshotsTestJSON-707057637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5dca7741-1abe-4891-9948-a859645ca450" returned: 0 in 0.244s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:51:49 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [req-76583e9d-d1fe-4f8d-be8b-c6f10f673532 req-099a0a03-e217-43ed-81fb-3dd9c6645209 tempest-VolumesSnapshotsTestJSON-707057637 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:51:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-76583e9d-d1fe-4f8d-be8b-c6f10f673532 req-099a0a03-e217-43ed-81fb-3dd9c6645209 tempest-VolumesSnapshotsTestJSON-707057637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:51:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-76583e9d-d1fe-4f8d-be8b-c6f10f673532 req-099a0a03-e217-43ed-81fb-3dd9c6645209 tempest-VolumesSnapshotsTestJSON-707057637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9baa404-9e3f-49b9-ac1c-fde420bfa103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dca7741-1abe-4891-9948-a859645ca450', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:51:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-76583e9d-d1fe-4f8d-be8b-c6f10f673532 req-099a0a03-e217-43ed-81fb-3dd9c6645209 tempest-VolumesSnapshotsTestJSON-707057637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15607eaa-21de-4081-b522-170aec8e337e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:51:49 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [req-76583e9d-d1fe-4f8d-be8b-c6f10f673532 req-099a0a03-e217-43ed-81fb-3dd9c6645209 tempest-VolumesSnapshotsTestJSON-707057637 None] Volume volume-5dca7741-1abe-4891-9948-a859645ca450 (5dca7741-1abe-4891-9948-a859645ca450): created successfully Aug 11 04:51:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-76583e9d-d1fe-4f8d-be8b-c6f10f673532 req-099a0a03-e217-43ed-81fb-3dd9c6645209 tempest-VolumesSnapshotsTestJSON-707057637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15607eaa-21de-4081-b522-170aec8e337e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:51:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-76583e9d-d1fe-4f8d-be8b-c6f10f673532 req-099a0a03-e217-43ed-81fb-3dd9c6645209 tempest-VolumesSnapshotsTestJSON-707057637 None] Flow 'volume_create_manager' (98809221-5d26-403d-8a63-4669fd4772f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:51:49 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-76583e9d-d1fe-4f8d-be8b-c6f10f673532 req-099a0a03-e217-43ed-81fb-3dd9c6645209 tempest-VolumesSnapshotsTestJSON-707057637 None] Created volume successfully. Aug 11 04:51:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-ce955a9c-69b5-4d30-969e-9eac700c3330 req-9eaf900d-62d2-4cdf-ab7b-c32faf5e1235 tempest-VolumesSnapshotsTestJSON-707057637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:51:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-ce955a9c-69b5-4d30-969e-9eac700c3330 req-9eaf900d-62d2-4cdf-ab7b-c32faf5e1235 tempest-VolumesSnapshotsTestJSON-707057637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:51:50 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [req-ce955a9c-69b5-4d30-969e-9eac700c3330 req-9eaf900d-62d2-4cdf-ab7b-c32faf5e1235 tempest-VolumesSnapshotsTestJSON-707057637 None] Creating offline snapshot 12fa523f-3493-4e2d-b085-7489029ca2c8 of volume 5dca7741-1abe-4891-9948-a859645ca450 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 04:51:50 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f86abf7-cfdd-4df0-9d92-a3f7cbe0b90d]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:51:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-ce955a9c-69b5-4d30-969e-9eac700c3330 req-9eaf900d-62d2-4cdf-ab7b-c32faf5e1235 tempest-VolumesSnapshotsTestJSON-707057637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5dca7741-1abe-4891-9948-a859645ca450 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:51:50 devstack sudo[110867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5dca7741-1abe-4891-9948-a859645ca450 Aug 11 04:51:50 devstack sudo[110867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:51:50 devstack sudo[110867]: pam_unix(sudo:session): session closed for user root Aug 11 04:51:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-ce955a9c-69b5-4d30-969e-9eac700c3330 req-9eaf900d-62d2-4cdf-ab7b-c32faf5e1235 tempest-VolumesSnapshotsTestJSON-707057637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5dca7741-1abe-4891-9948-a859645ca450" returned: 0 in 0.347s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:51:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-ce955a9c-69b5-4d30-969e-9eac700c3330 req-9eaf900d-62d2-4cdf-ab7b-c32faf5e1235 tempest-VolumesSnapshotsTestJSON-707057637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5dca7741-1abe-4891-9948-a859645ca450,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5dca7741-1abe-4891-9948-a859645ca450.12fa523f-3493-4e2d-b085-7489029ca2c8 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:51:50 devstack sudo[110872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5dca7741-1abe-4891-9948-a859645ca450,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5dca7741-1abe-4891-9948-a859645ca450.12fa523f-3493-4e2d-b085-7489029ca2c8 1G Aug 11 04:51:50 devstack sudo[110872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:51:51 devstack sudo[110872]: pam_unix(sudo:session): session closed for user root Aug 11 04:51:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-ce955a9c-69b5-4d30-969e-9eac700c3330 req-9eaf900d-62d2-4cdf-ab7b-c32faf5e1235 tempest-VolumesSnapshotsTestJSON-707057637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5dca7741-1abe-4891-9948-a859645ca450,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5dca7741-1abe-4891-9948-a859645ca450.12fa523f-3493-4e2d-b085-7489029ca2c8 1G" returned: 0 in 0.363s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:51:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-ce955a9c-69b5-4d30-969e-9eac700c3330 req-9eaf900d-62d2-4cdf-ab7b-c32faf5e1235 tempest-VolumesSnapshotsTestJSON-707057637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dca7741-1abe-4891-9948-a859645ca450 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5dca7741-1abe-4891-9948-a859645ca450.12fa523f-3493-4e2d-b085-7489029ca2c8 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:51:51 devstack sudo[110877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dca7741-1abe-4891-9948-a859645ca450 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5dca7741-1abe-4891-9948-a859645ca450.12fa523f-3493-4e2d-b085-7489029ca2c8 Aug 11 04:51:51 devstack sudo[110877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:51:51 devstack sudo[110877]: pam_unix(sudo:session): session closed for user root Aug 11 04:51:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-ce955a9c-69b5-4d30-969e-9eac700c3330 req-9eaf900d-62d2-4cdf-ab7b-c32faf5e1235 tempest-VolumesSnapshotsTestJSON-707057637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dca7741-1abe-4891-9948-a859645ca450 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5dca7741-1abe-4891-9948-a859645ca450.12fa523f-3493-4e2d-b085-7489029ca2c8" returned: 0 in 0.268s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:51:51 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [req-ce955a9c-69b5-4d30-969e-9eac700c3330 req-9eaf900d-62d2-4cdf-ab7b-c32faf5e1235 tempest-VolumesSnapshotsTestJSON-707057637 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5dca7741-1abe-4891-9948-a859645ca450.12fa523f-3493-4e2d-b085-7489029ca2c8 is being set with open permissions: ugo+rw Aug 11 04:51:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-ce955a9c-69b5-4d30-969e-9eac700c3330 req-9eaf900d-62d2-4cdf-ab7b-c32faf5e1235 tempest-VolumesSnapshotsTestJSON-707057637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5dca7741-1abe-4891-9948-a859645ca450.12fa523f-3493-4e2d-b085-7489029ca2c8 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:51:51 devstack sudo[110882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5dca7741-1abe-4891-9948-a859645ca450.12fa523f-3493-4e2d-b085-7489029ca2c8 Aug 11 04:51:51 devstack sudo[110882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:51:51 devstack sudo[110882]: pam_unix(sudo:session): session closed for user root Aug 11 04:51:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-ce955a9c-69b5-4d30-969e-9eac700c3330 req-9eaf900d-62d2-4cdf-ab7b-c32faf5e1235 tempest-VolumesSnapshotsTestJSON-707057637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5dca7741-1abe-4891-9948-a859645ca450.12fa523f-3493-4e2d-b085-7489029ca2c8" returned: 0 in 0.233s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:51:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-ce955a9c-69b5-4d30-969e-9eac700c3330 req-9eaf900d-62d2-4cdf-ab7b-c32faf5e1235 tempest-VolumesSnapshotsTestJSON-707057637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5dca7741-1abe-4891-9948-a859645ca450.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:51:51 devstack sudo[110885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5dca7741-1abe-4891-9948-a859645ca450.info Aug 11 04:51:51 devstack sudo[110885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:51:51 devstack sudo[110885]: pam_unix(sudo:session): session closed for user root Aug 11 04:51:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-ce955a9c-69b5-4d30-969e-9eac700c3330 req-9eaf900d-62d2-4cdf-ab7b-c32faf5e1235 tempest-VolumesSnapshotsTestJSON-707057637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5dca7741-1abe-4891-9948-a859645ca450.info" returned: 0 in 0.242s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:51:51 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [req-ce955a9c-69b5-4d30-969e-9eac700c3330 req-9eaf900d-62d2-4cdf-ab7b-c32faf5e1235 tempest-VolumesSnapshotsTestJSON-707057637 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5dca7741-1abe-4891-9948-a859645ca450.info is being set with open permissions: ugo+rw Aug 11 04:51:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-ce955a9c-69b5-4d30-969e-9eac700c3330 req-9eaf900d-62d2-4cdf-ab7b-c32faf5e1235 tempest-VolumesSnapshotsTestJSON-707057637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5dca7741-1abe-4891-9948-a859645ca450.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:51:51 devstack sudo[110888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5dca7741-1abe-4891-9948-a859645ca450.info Aug 11 04:51:51 devstack sudo[110888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:51:52 devstack sudo[110888]: pam_unix(sudo:session): session closed for user root Aug 11 04:51:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-ce955a9c-69b5-4d30-969e-9eac700c3330 req-9eaf900d-62d2-4cdf-ab7b-c32faf5e1235 tempest-VolumesSnapshotsTestJSON-707057637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5dca7741-1abe-4891-9948-a859645ca450.info" returned: 0 in 0.235s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:51:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-ce955a9c-69b5-4d30-969e-9eac700c3330 req-9eaf900d-62d2-4cdf-ab7b-c32faf5e1235 tempest-VolumesSnapshotsTestJSON-707057637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.769s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:51:52 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-ce955a9c-69b5-4d30-969e-9eac700c3330 req-9eaf900d-62d2-4cdf-ab7b-c32faf5e1235 tempest-VolumesSnapshotsTestJSON-707057637 None] Create snapshot completed successfully Aug 11 04:51:52 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-d67592a1-c33c-4056-85e5-090c8592ad3a req-ce69ac6c-6ddb-4e77-b1f7-fb77d2a57e09 tempest-VolumesSnapshotsTestJSON-707057637 None] Acquiring lock "cinder-12fa523f-3493-4e2d-b085-7489029ca2c8-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:51:52 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-d67592a1-c33c-4056-85e5-090c8592ad3a req-ce69ac6c-6ddb-4e77-b1f7-fb77d2a57e09 tempest-VolumesSnapshotsTestJSON-707057637 None] Lock "cinder-12fa523f-3493-4e2d-b085-7489029ca2c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:51:52 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-d67592a1-c33c-4056-85e5-090c8592ad3a req-ce69ac6c-6ddb-4e77-b1f7-fb77d2a57e09 tempest-VolumesSnapshotsTestJSON-707057637 None] Acquiring lock "cinder-quobyte-5dca7741-1abe-4891-9948-a859645ca450" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:51:52 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-d67592a1-c33c-4056-85e5-090c8592ad3a req-ce69ac6c-6ddb-4e77-b1f7-fb77d2a57e09 tempest-VolumesSnapshotsTestJSON-707057637 None] Lock "cinder-quobyte-5dca7741-1abe-4891-9948-a859645ca450" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:51:52 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-d67592a1-c33c-4056-85e5-090c8592ad3a req-ce69ac6c-6ddb-4e77-b1f7-fb77d2a57e09 tempest-VolumesSnapshotsTestJSON-707057637 None] Acquiring lock "cinder-quobyte-12fa523f-3493-4e2d-b085-7489029ca2c8" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:51:52 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-d67592a1-c33c-4056-85e5-090c8592ad3a req-ce69ac6c-6ddb-4e77-b1f7-fb77d2a57e09 tempest-VolumesSnapshotsTestJSON-707057637 None] Lock "cinder-quobyte-12fa523f-3493-4e2d-b085-7489029ca2c8" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:51:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [req-d67592a1-c33c-4056-85e5-090c8592ad3a req-ce69ac6c-6ddb-4e77-b1f7-fb77d2a57e09 tempest-VolumesSnapshotsTestJSON-707057637 None] Deleting offline snapshot 12fa523f-3493-4e2d-b085-7489029ca2c8 of volume 5dca7741-1abe-4891-9948-a859645ca450 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 04:51:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [req-d67592a1-c33c-4056-85e5-090c8592ad3a req-ce69ac6c-6ddb-4e77-b1f7-fb77d2a57e09 tempest-VolumesSnapshotsTestJSON-707057637 None] snapshot_file for this snap is: volume-5dca7741-1abe-4891-9948-a859645ca450.12fa523f-3493-4e2d-b085-7489029ca2c8 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 04:51:52 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[132493ba-5667-4997-85ef-97e250ad8609]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:51:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-d67592a1-c33c-4056-85e5-090c8592ad3a req-ce69ac6c-6ddb-4e77-b1f7-fb77d2a57e09 tempest-VolumesSnapshotsTestJSON-707057637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5dca7741-1abe-4891-9948-a859645ca450.12fa523f-3493-4e2d-b085-7489029ca2c8 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:51:52 devstack sudo[110891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5dca7741-1abe-4891-9948-a859645ca450.12fa523f-3493-4e2d-b085-7489029ca2c8 Aug 11 04:51:52 devstack sudo[110891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:51:53 devstack sudo[110891]: pam_unix(sudo:session): session closed for user root Aug 11 04:51:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-d67592a1-c33c-4056-85e5-090c8592ad3a req-ce69ac6c-6ddb-4e77-b1f7-fb77d2a57e09 tempest-VolumesSnapshotsTestJSON-707057637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5dca7741-1abe-4891-9948-a859645ca450.12fa523f-3493-4e2d-b085-7489029ca2c8" returned: 0 in 0.343s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:51:53 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [req-d67592a1-c33c-4056-85e5-090c8592ad3a req-ce69ac6c-6ddb-4e77-b1f7-fb77d2a57e09 tempest-VolumesSnapshotsTestJSON-707057637 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5dca7741-1abe-4891-9948-a859645ca450(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:51:53 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd7757c-ecbc-4913-8db2-c03953b2ced0]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:51:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-d67592a1-c33c-4056-85e5-090c8592ad3a req-ce69ac6c-6ddb-4e77-b1f7-fb77d2a57e09 tempest-VolumesSnapshotsTestJSON-707057637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5dca7741-1abe-4891-9948-a859645ca450 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:51:53 devstack sudo[110896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5dca7741-1abe-4891-9948-a859645ca450 Aug 11 04:51:53 devstack sudo[110896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:51:53 devstack sudo[110896]: pam_unix(sudo:session): session closed for user root Aug 11 04:51:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-d67592a1-c33c-4056-85e5-090c8592ad3a req-ce69ac6c-6ddb-4e77-b1f7-fb77d2a57e09 tempest-VolumesSnapshotsTestJSON-707057637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5dca7741-1abe-4891-9948-a859645ca450" returned: 0 in 0.379s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:51:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-d67592a1-c33c-4056-85e5-090c8592ad3a req-ce69ac6c-6ddb-4e77-b1f7-fb77d2a57e09 tempest-VolumesSnapshotsTestJSON-707057637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5dca7741-1abe-4891-9948-a859645ca450.12fa523f-3493-4e2d-b085-7489029ca2c8 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:51:53 devstack sudo[110902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5dca7741-1abe-4891-9948-a859645ca450.12fa523f-3493-4e2d-b085-7489029ca2c8 Aug 11 04:51:53 devstack sudo[110902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:51:53 devstack sudo[110902]: pam_unix(sudo:session): session closed for user root Aug 11 04:51:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-d67592a1-c33c-4056-85e5-090c8592ad3a req-ce69ac6c-6ddb-4e77-b1f7-fb77d2a57e09 tempest-VolumesSnapshotsTestJSON-707057637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5dca7741-1abe-4891-9948-a859645ca450.12fa523f-3493-4e2d-b085-7489029ca2c8" returned: 0 in 0.377s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:51:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-d67592a1-c33c-4056-85e5-090c8592ad3a req-ce69ac6c-6ddb-4e77-b1f7-fb77d2a57e09 tempest-VolumesSnapshotsTestJSON-707057637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5dca7741-1abe-4891-9948-a859645ca450.12fa523f-3493-4e2d-b085-7489029ca2c8 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:51:53 devstack sudo[110907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5dca7741-1abe-4891-9948-a859645ca450.12fa523f-3493-4e2d-b085-7489029ca2c8 Aug 11 04:51:53 devstack sudo[110907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:51:54 devstack sudo[110907]: pam_unix(sudo:session): session closed for user root Aug 11 04:51:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-d67592a1-c33c-4056-85e5-090c8592ad3a req-ce69ac6c-6ddb-4e77-b1f7-fb77d2a57e09 tempest-VolumesSnapshotsTestJSON-707057637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5dca7741-1abe-4891-9948-a859645ca450.12fa523f-3493-4e2d-b085-7489029ca2c8" returned: 0 in 0.272s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:51:54 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-d67592a1-c33c-4056-85e5-090c8592ad3a req-ce69ac6c-6ddb-4e77-b1f7-fb77d2a57e09 tempest-VolumesSnapshotsTestJSON-707057637 None] Lock "cinder-quobyte-12fa523f-3493-4e2d-b085-7489029ca2c8" released by "_delete_snapshot" :: held 1.485s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:51:54 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-d67592a1-c33c-4056-85e5-090c8592ad3a req-ce69ac6c-6ddb-4e77-b1f7-fb77d2a57e09 tempest-VolumesSnapshotsTestJSON-707057637 None] Lock "cinder-quobyte-5dca7741-1abe-4891-9948-a859645ca450" released by "delete_snapshot" :: held 1.510s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:51:54 devstack cinder-volume[94472]: DEBUG cinder.quota [req-d67592a1-c33c-4056-85e5-090c8592ad3a req-ce69ac6c-6ddb-4e77-b1f7-fb77d2a57e09 tempest-VolumesSnapshotsTestJSON-707057637 None] Created reservations ['0d9f7817-46ae-4e64-8112-466e84f952c2', '268d2671-4026-46f3-b51b-8c500fb736bb', '2b5b8ce9-3c85-44e1-97ae-97024a0f8cc2', '62d9f485-fcf9-4d58-98b4-a8aeb37341ae'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:51:54 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-d67592a1-c33c-4056-85e5-090c8592ad3a req-ce69ac6c-6ddb-4e77-b1f7-fb77d2a57e09 tempest-VolumesSnapshotsTestJSON-707057637 None] Delete snapshot completed successfully. Aug 11 04:51:54 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-d67592a1-c33c-4056-85e5-090c8592ad3a req-ce69ac6c-6ddb-4e77-b1f7-fb77d2a57e09 tempest-VolumesSnapshotsTestJSON-707057637 None] Lock "cinder-12fa523f-3493-4e2d-b085-7489029ca2c8-delete_snapshot" released by "delete_snapshot" :: held 1.662s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:51:54 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-5c3bed8f-5630-46bd-9333-5874f23d3e49 req-1a0c6791-989c-4601-b986-0f76584cb0f0 tempest-VolumesSnapshotsTestJSON-707057637 None] Acquiring lock "cinder-5dca7741-1abe-4891-9948-a859645ca450-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:51:54 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-5c3bed8f-5630-46bd-9333-5874f23d3e49 req-1a0c6791-989c-4601-b986-0f76584cb0f0 tempest-VolumesSnapshotsTestJSON-707057637 None] Lock "cinder-5dca7741-1abe-4891-9948-a859645ca450-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:51:54 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-5c3bed8f-5630-46bd-9333-5874f23d3e49 req-1a0c6791-989c-4601-b986-0f76584cb0f0 tempest-VolumesSnapshotsTestJSON-707057637 None] Acquiring lock "cinder-quobyte-5dca7741-1abe-4891-9948-a859645ca450" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:51:54 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-5c3bed8f-5630-46bd-9333-5874f23d3e49 req-1a0c6791-989c-4601-b986-0f76584cb0f0 tempest-VolumesSnapshotsTestJSON-707057637 None] Lock "cinder-quobyte-5dca7741-1abe-4891-9948-a859645ca450" acquired by "delete_volume" :: waited 0.014s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:51:54 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df760b1-fa1a-49e1-9ab1-4f28883f5cf1]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:51:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-5c3bed8f-5630-46bd-9333-5874f23d3e49 req-1a0c6791-989c-4601-b986-0f76584cb0f0 tempest-VolumesSnapshotsTestJSON-707057637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5dca7741-1abe-4891-9948-a859645ca450 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:51:55 devstack sudo[110910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5dca7741-1abe-4891-9948-a859645ca450 Aug 11 04:51:55 devstack sudo[110910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:51:55 devstack sudo[110910]: pam_unix(sudo:session): session closed for user root Aug 11 04:51:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-5c3bed8f-5630-46bd-9333-5874f23d3e49 req-1a0c6791-989c-4601-b986-0f76584cb0f0 tempest-VolumesSnapshotsTestJSON-707057637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5dca7741-1abe-4891-9948-a859645ca450" returned: 0 in 0.353s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:51:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-5c3bed8f-5630-46bd-9333-5874f23d3e49 req-1a0c6791-989c-4601-b986-0f76584cb0f0 tempest-VolumesSnapshotsTestJSON-707057637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5dca7741-1abe-4891-9948-a859645ca450 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:51:55 devstack sudo[110915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5dca7741-1abe-4891-9948-a859645ca450 Aug 11 04:51:55 devstack sudo[110915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:51:55 devstack sudo[110915]: pam_unix(sudo:session): session closed for user root Aug 11 04:51:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-5c3bed8f-5630-46bd-9333-5874f23d3e49 req-1a0c6791-989c-4601-b986-0f76584cb0f0 tempest-VolumesSnapshotsTestJSON-707057637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-5dca7741-1abe-4891-9948-a859645ca450" returned: 0 in 0.240s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:51:55 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-5c3bed8f-5630-46bd-9333-5874f23d3e49 req-1a0c6791-989c-4601-b986-0f76584cb0f0 tempest-VolumesSnapshotsTestJSON-707057637 None] Lock "cinder-quobyte-5dca7741-1abe-4891-9948-a859645ca450" released by "delete_volume" :: held 0.653s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:51:55 devstack cinder-volume[94472]: DEBUG cinder.quota [req-5c3bed8f-5630-46bd-9333-5874f23d3e49 req-1a0c6791-989c-4601-b986-0f76584cb0f0 tempest-VolumesSnapshotsTestJSON-707057637 None] Created reservations ['f199f63a-ce98-4ca8-9395-d719820df6de', 'cc6c6fa6-e1eb-487a-aa67-dcbc69601423', 'deb075f9-8b20-41a8-a86a-91c0c7578527', 'ab7a8437-5ee2-49e9-9b9e-092f7031a068'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:51:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-5c3bed8f-5630-46bd-9333-5874f23d3e49 req-1a0c6791-989c-4601-b986-0f76584cb0f0 tempest-VolumesSnapshotsTestJSON-707057637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:51:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-5c3bed8f-5630-46bd-9333-5874f23d3e49 req-1a0c6791-989c-4601-b986-0f76584cb0f0 tempest-VolumesSnapshotsTestJSON-707057637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:51:55 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [req-5c3bed8f-5630-46bd-9333-5874f23d3e49 req-1a0c6791-989c-4601-b986-0f76584cb0f0 tempest-VolumesSnapshotsTestJSON-707057637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:51:55 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [req-5c3bed8f-5630-46bd-9333-5874f23d3e49 req-1a0c6791-989c-4601-b986-0f76584cb0f0 tempest-VolumesSnapshotsTestJSON-707057637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:51:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-5c3bed8f-5630-46bd-9333-5874f23d3e49 req-1a0c6791-989c-4601-b986-0f76584cb0f0 tempest-VolumesSnapshotsTestJSON-707057637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:51:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-5c3bed8f-5630-46bd-9333-5874f23d3e49 req-1a0c6791-989c-4601-b986-0f76584cb0f0 tempest-VolumesSnapshotsTestJSON-707057637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:51:55 devstack sudo[110918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:51:55 devstack sudo[110918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:51:55 devstack sudo[110918]: pam_unix(sudo:session): session closed for user root Aug 11 04:51:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-5c3bed8f-5630-46bd-9333-5874f23d3e49 req-1a0c6791-989c-4601-b986-0f76584cb0f0 tempest-VolumesSnapshotsTestJSON-707057637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.250s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:51:55 devstack cinder-volume[94472]: DEBUG cinder.manager [req-5c3bed8f-5630-46bd-9333-5874f23d3e49 req-1a0c6791-989c-4601-b986-0f76584cb0f0 tempest-VolumesSnapshotsTestJSON-707057637 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:51:55 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-5c3bed8f-5630-46bd-9333-5874f23d3e49 req-1a0c6791-989c-4601-b986-0f76584cb0f0 tempest-VolumesSnapshotsTestJSON-707057637 None] Deleted volume successfully. Aug 11 04:51:56 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-5c3bed8f-5630-46bd-9333-5874f23d3e49 req-1a0c6791-989c-4601-b986-0f76584cb0f0 tempest-VolumesSnapshotsTestJSON-707057637 None] Lock "cinder-5dca7741-1abe-4891-9948-a859645ca450-delete_volume" released by "delete_volume" :: held 1.105s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:51:58 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 04:51:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:51:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:51:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:51:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:51:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:51:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:51:58 devstack sudo[110929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:51:58 devstack sudo[110929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:51:58 devstack sudo[110929]: pam_unix(sudo:session): session closed for user root Aug 11 04:51:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.251s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:51:58 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:51:58 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running periodic task VolumeManager._thread_info {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 04:51:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] thread count: 28 {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 11 04:51:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] thread info: [<_MainThread(MainThread, started 133315846115456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 11 04:51:59 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [req-51724720-b909-4d99-905d-80ba16a8acc1 req-8e67ed85-a7e1-470e-926f-914620122a2b tempest-VolumesGetTestJSON-140156175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:51:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-51724720-b909-4d99-905d-80ba16a8acc1 req-8e67ed85-a7e1-470e-926f-914620122a2b tempest-VolumesGetTestJSON-140156175 None] Flow 'volume_create_manager' (fe63b3e0-bda1-43b8-8362-b411ccacb09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:51:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-51724720-b909-4d99-905d-80ba16a8acc1 req-8e67ed85-a7e1-470e-926f-914620122a2b tempest-VolumesGetTestJSON-140156175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40176784-da6f-4e84-8e6f-a185138970eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:51:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-51724720-b909-4d99-905d-80ba16a8acc1 req-8e67ed85-a7e1-470e-926f-914620122a2b tempest-VolumesGetTestJSON-140156175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40176784-da6f-4e84-8e6f-a185138970eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-107817848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cdf6194-05de-4708-8ecb-0a529284a8cc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e1d03b6582324248a0bae14ce2fc2b1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:52:00Z,use_quota=True,user_id='01d05d3d36054e55ab52e2eecea89647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:51:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-51724720-b909-4d99-905d-80ba16a8acc1 req-8e67ed85-a7e1-470e-926f-914620122a2b tempest-VolumesGetTestJSON-140156175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66641ce1-2730-491f-bca6-dc02219e5591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:51:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-51724720-b909-4d99-905d-80ba16a8acc1 req-8e67ed85-a7e1-470e-926f-914620122a2b tempest-VolumesGetTestJSON-140156175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66641ce1-2730-491f-bca6-dc02219e5591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:51:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-51724720-b909-4d99-905d-80ba16a8acc1 req-8e67ed85-a7e1-470e-926f-914620122a2b tempest-VolumesGetTestJSON-140156175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76baa20d-f295-48ad-a406-befee1c20728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:51:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-51724720-b909-4d99-905d-80ba16a8acc1 req-8e67ed85-a7e1-470e-926f-914620122a2b tempest-VolumesGetTestJSON-140156175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76baa20d-f295-48ad-a406-befee1c20728) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cdf6194-05de-4708-8ecb-0a529284a8cc', 'volume_name': 'volume-7cdf6194-05de-4708-8ecb-0a529284a8cc', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:51:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-51724720-b909-4d99-905d-80ba16a8acc1 req-8e67ed85-a7e1-470e-926f-914620122a2b tempest-VolumesGetTestJSON-140156175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33c33690-9064-4991-a327-84780de37ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:51:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-51724720-b909-4d99-905d-80ba16a8acc1 req-8e67ed85-a7e1-470e-926f-914620122a2b tempest-VolumesGetTestJSON-140156175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33c33690-9064-4991-a327-84780de37ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:51:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-51724720-b909-4d99-905d-80ba16a8acc1 req-8e67ed85-a7e1-470e-926f-914620122a2b tempest-VolumesGetTestJSON-140156175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e22fe021-1115-4af6-8e75-962884792146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:51:59 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [req-51724720-b909-4d99-905d-80ba16a8acc1 req-8e67ed85-a7e1-470e-926f-914620122a2b tempest-VolumesGetTestJSON-140156175 None] Volume 7cdf6194-05de-4708-8ecb-0a529284a8cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cdf6194-05de-4708-8ecb-0a529284a8cc', 'volume_size': 1} Aug 11 04:51:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-51724720-b909-4d99-905d-80ba16a8acc1 req-8e67ed85-a7e1-470e-926f-914620122a2b tempest-VolumesGetTestJSON-140156175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:51:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-51724720-b909-4d99-905d-80ba16a8acc1 req-8e67ed85-a7e1-470e-926f-914620122a2b tempest-VolumesGetTestJSON-140156175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:51:59 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [req-51724720-b909-4d99-905d-80ba16a8acc1 req-8e67ed85-a7e1-470e-926f-914620122a2b tempest-VolumesGetTestJSON-140156175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-107817848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cdf6194-05de-4708-8ecb-0a529284a8cc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e1d03b6582324248a0bae14ce2fc2b1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:52:00Z,use_quota=True,user_id='01d05d3d36054e55ab52e2eecea89647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:51:59 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [req-51724720-b909-4d99-905d-80ba16a8acc1 req-8e67ed85-a7e1-470e-926f-914620122a2b tempest-VolumesGetTestJSON-140156175 None] Creating volume 7cdf6194-05de-4708-8ecb-0a529284a8cc {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:51:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-51724720-b909-4d99-905d-80ba16a8acc1 req-8e67ed85-a7e1-470e-926f-914620122a2b tempest-VolumesGetTestJSON-140156175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:51:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-51724720-b909-4d99-905d-80ba16a8acc1 req-8e67ed85-a7e1-470e-926f-914620122a2b tempest-VolumesGetTestJSON-140156175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:51:59 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [req-51724720-b909-4d99-905d-80ba16a8acc1 req-8e67ed85-a7e1-470e-926f-914620122a2b tempest-VolumesGetTestJSON-140156175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:51:59 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [req-51724720-b909-4d99-905d-80ba16a8acc1 req-8e67ed85-a7e1-470e-926f-914620122a2b tempest-VolumesGetTestJSON-140156175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:51:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-51724720-b909-4d99-905d-80ba16a8acc1 req-8e67ed85-a7e1-470e-926f-914620122a2b tempest-VolumesGetTestJSON-140156175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:51:59 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [req-51724720-b909-4d99-905d-80ba16a8acc1 req-8e67ed85-a7e1-470e-926f-914620122a2b tempest-VolumesGetTestJSON-140156175 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:51:59 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [req-51724720-b909-4d99-905d-80ba16a8acc1 req-8e67ed85-a7e1-470e-926f-914620122a2b tempest-VolumesGetTestJSON-140156175 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:51:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-51724720-b909-4d99-905d-80ba16a8acc1 req-8e67ed85-a7e1-470e-926f-914620122a2b tempest-VolumesGetTestJSON-140156175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7cdf6194-05de-4708-8ecb-0a529284a8cc 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:51:59 devstack sudo[110947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7cdf6194-05de-4708-8ecb-0a529284a8cc 1073741824 Aug 11 04:51:59 devstack sudo[110947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:51:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-fedb130b-e4d0-4a54-86f5-484181212d49 req-18ba7721-3fc0-46b5-bae3-cccbac26b505 tempest-TestStampPattern-1401503402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:52:00 devstack sudo[110947]: pam_unix(sudo:session): session closed for user root Aug 11 04:52:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-51724720-b909-4d99-905d-80ba16a8acc1 req-8e67ed85-a7e1-470e-926f-914620122a2b tempest-VolumesGetTestJSON-140156175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7cdf6194-05de-4708-8ecb-0a529284a8cc 1073741824" returned: 0 in 0.417s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:52:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-51724720-b909-4d99-905d-80ba16a8acc1 req-8e67ed85-a7e1-470e-926f-914620122a2b tempest-VolumesGetTestJSON-140156175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7cdf6194-05de-4708-8ecb-0a529284a8cc {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:52:00 devstack sudo[110953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7cdf6194-05de-4708-8ecb-0a529284a8cc Aug 11 04:52:00 devstack sudo[110953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:52:00 devstack sudo[110953]: pam_unix(sudo:session): session closed for user root Aug 11 04:52:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-51724720-b909-4d99-905d-80ba16a8acc1 req-8e67ed85-a7e1-470e-926f-914620122a2b tempest-VolumesGetTestJSON-140156175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7cdf6194-05de-4708-8ecb-0a529284a8cc" returned: 0 in 0.241s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:52:00 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [req-51724720-b909-4d99-905d-80ba16a8acc1 req-8e67ed85-a7e1-470e-926f-914620122a2b tempest-VolumesGetTestJSON-140156175 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:52:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-51724720-b909-4d99-905d-80ba16a8acc1 req-8e67ed85-a7e1-470e-926f-914620122a2b tempest-VolumesGetTestJSON-140156175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:52:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-fedb130b-e4d0-4a54-86f5-484181212d49 req-18ba7721-3fc0-46b5-bae3-cccbac26b505 tempest-TestStampPattern-1401503402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.660s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:52:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-51724720-b909-4d99-905d-80ba16a8acc1 req-8e67ed85-a7e1-470e-926f-914620122a2b tempest-VolumesGetTestJSON-140156175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e22fe021-1115-4af6-8e75-962884792146) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cdf6194-05de-4708-8ecb-0a529284a8cc', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:52:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-51724720-b909-4d99-905d-80ba16a8acc1 req-8e67ed85-a7e1-470e-926f-914620122a2b tempest-VolumesGetTestJSON-140156175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbcc8ae3-3660-4ed2-b489-f60115e801e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:52:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-fedb130b-e4d0-4a54-86f5-484181212d49 req-18ba7721-3fc0-46b5-bae3-cccbac26b505 tempest-TestStampPattern-1401503402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:52:00 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [req-51724720-b909-4d99-905d-80ba16a8acc1 req-8e67ed85-a7e1-470e-926f-914620122a2b tempest-VolumesGetTestJSON-140156175 None] Volume volume-7cdf6194-05de-4708-8ecb-0a529284a8cc (7cdf6194-05de-4708-8ecb-0a529284a8cc): created successfully Aug 11 04:52:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-51724720-b909-4d99-905d-80ba16a8acc1 req-8e67ed85-a7e1-470e-926f-914620122a2b tempest-VolumesGetTestJSON-140156175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbcc8ae3-3660-4ed2-b489-f60115e801e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:52:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-51724720-b909-4d99-905d-80ba16a8acc1 req-8e67ed85-a7e1-470e-926f-914620122a2b tempest-VolumesGetTestJSON-140156175 None] Flow 'volume_create_manager' (fe63b3e0-bda1-43b8-8362-b411ccacb09e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:52:00 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-51724720-b909-4d99-905d-80ba16a8acc1 req-8e67ed85-a7e1-470e-926f-914620122a2b tempest-VolumesGetTestJSON-140156175 None] Created volume successfully. Aug 11 04:52:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-fedb130b-e4d0-4a54-86f5-484181212d49 req-18ba7721-3fc0-46b5-bae3-cccbac26b505 tempest-TestStampPattern-1401503402 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd', 'name': 'volume-c7882da0-8442-4172-9cbc-fff1eb23344a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2cd053fa-0950-4038-b4cb-9acd8cd4bcd3', 'enforce_multipath': True} {{(pid=94472) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 11 04:52:00 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-fedb130b-e4d0-4a54-86f5-484181212d49 req-18ba7721-3fc0-46b5-bae3-cccbac26b505 tempest-TestStampPattern-1401503402 None] attachment_update completed successfully. Aug 11 04:52:01 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-1b591f94-7e79-4b33-9379-a15dcd480a3f req-033b061f-b506-4b68-8a5c-d819e5eb2ec8 tempest-VolumesGetTestJSON-140156175 None] Acquiring lock "cinder-7cdf6194-05de-4708-8ecb-0a529284a8cc-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:52:01 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-1b591f94-7e79-4b33-9379-a15dcd480a3f req-033b061f-b506-4b68-8a5c-d819e5eb2ec8 tempest-VolumesGetTestJSON-140156175 None] Lock "cinder-7cdf6194-05de-4708-8ecb-0a529284a8cc-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:52:01 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-1b591f94-7e79-4b33-9379-a15dcd480a3f req-033b061f-b506-4b68-8a5c-d819e5eb2ec8 tempest-VolumesGetTestJSON-140156175 None] Acquiring lock "cinder-quobyte-7cdf6194-05de-4708-8ecb-0a529284a8cc" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:52:01 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-1b591f94-7e79-4b33-9379-a15dcd480a3f req-033b061f-b506-4b68-8a5c-d819e5eb2ec8 tempest-VolumesGetTestJSON-140156175 None] Lock "cinder-quobyte-7cdf6194-05de-4708-8ecb-0a529284a8cc" acquired by "delete_volume" :: waited 0.015s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:52:01 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8070fa-b951-4094-9dc6-6a13f97d0f5c]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:52:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-1b591f94-7e79-4b33-9379-a15dcd480a3f req-033b061f-b506-4b68-8a5c-d819e5eb2ec8 tempest-VolumesGetTestJSON-140156175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7cdf6194-05de-4708-8ecb-0a529284a8cc {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:52:01 devstack sudo[111340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7cdf6194-05de-4708-8ecb-0a529284a8cc Aug 11 04:52:01 devstack sudo[111340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:52:01 devstack sudo[111340]: pam_unix(sudo:session): session closed for user root Aug 11 04:52:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-1b591f94-7e79-4b33-9379-a15dcd480a3f req-033b061f-b506-4b68-8a5c-d819e5eb2ec8 tempest-VolumesGetTestJSON-140156175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7cdf6194-05de-4708-8ecb-0a529284a8cc" returned: 0 in 0.384s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:52:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-1b591f94-7e79-4b33-9379-a15dcd480a3f req-033b061f-b506-4b68-8a5c-d819e5eb2ec8 tempest-VolumesGetTestJSON-140156175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7cdf6194-05de-4708-8ecb-0a529284a8cc {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:52:01 devstack sudo[111346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7cdf6194-05de-4708-8ecb-0a529284a8cc Aug 11 04:52:01 devstack sudo[111346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:52:01 devstack sudo[111346]: pam_unix(sudo:session): session closed for user root Aug 11 04:52:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-1b591f94-7e79-4b33-9379-a15dcd480a3f req-033b061f-b506-4b68-8a5c-d819e5eb2ec8 tempest-VolumesGetTestJSON-140156175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7cdf6194-05de-4708-8ecb-0a529284a8cc" returned: 0 in 0.244s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:52:01 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-1b591f94-7e79-4b33-9379-a15dcd480a3f req-033b061f-b506-4b68-8a5c-d819e5eb2ec8 tempest-VolumesGetTestJSON-140156175 None] Lock "cinder-quobyte-7cdf6194-05de-4708-8ecb-0a529284a8cc" released by "delete_volume" :: held 0.680s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:52:01 devstack cinder-volume[94472]: DEBUG cinder.quota [req-1b591f94-7e79-4b33-9379-a15dcd480a3f req-033b061f-b506-4b68-8a5c-d819e5eb2ec8 tempest-VolumesGetTestJSON-140156175 None] Created reservations ['6c237111-7029-4174-85bf-8dcd3dc4fac8', '58f1a55a-542c-47eb-87ea-2983a624fc56', '93cb4721-e663-4e6a-a21f-fe4acc4348e7', 'a51bf460-2ca2-44b6-9580-ed72bbc9704b'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:52:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-1b591f94-7e79-4b33-9379-a15dcd480a3f req-033b061f-b506-4b68-8a5c-d819e5eb2ec8 tempest-VolumesGetTestJSON-140156175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:52:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-1b591f94-7e79-4b33-9379-a15dcd480a3f req-033b061f-b506-4b68-8a5c-d819e5eb2ec8 tempest-VolumesGetTestJSON-140156175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:52:01 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [req-1b591f94-7e79-4b33-9379-a15dcd480a3f req-033b061f-b506-4b68-8a5c-d819e5eb2ec8 tempest-VolumesGetTestJSON-140156175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:52:01 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [req-1b591f94-7e79-4b33-9379-a15dcd480a3f req-033b061f-b506-4b68-8a5c-d819e5eb2ec8 tempest-VolumesGetTestJSON-140156175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:52:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-1b591f94-7e79-4b33-9379-a15dcd480a3f req-033b061f-b506-4b68-8a5c-d819e5eb2ec8 tempest-VolumesGetTestJSON-140156175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:52:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-1b591f94-7e79-4b33-9379-a15dcd480a3f req-033b061f-b506-4b68-8a5c-d819e5eb2ec8 tempest-VolumesGetTestJSON-140156175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:52:02 devstack sudo[111351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:52:02 devstack sudo[111351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:52:02 devstack sudo[111351]: pam_unix(sudo:session): session closed for user root Aug 11 04:52:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-1b591f94-7e79-4b33-9379-a15dcd480a3f req-033b061f-b506-4b68-8a5c-d819e5eb2ec8 tempest-VolumesGetTestJSON-140156175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.249s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:52:02 devstack cinder-volume[94472]: DEBUG cinder.manager [req-1b591f94-7e79-4b33-9379-a15dcd480a3f req-033b061f-b506-4b68-8a5c-d819e5eb2ec8 tempest-VolumesGetTestJSON-140156175 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:52:02 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-1b591f94-7e79-4b33-9379-a15dcd480a3f req-033b061f-b506-4b68-8a5c-d819e5eb2ec8 tempest-VolumesGetTestJSON-140156175 None] Deleted volume successfully. Aug 11 04:52:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-1b591f94-7e79-4b33-9379-a15dcd480a3f req-033b061f-b506-4b68-8a5c-d819e5eb2ec8 tempest-VolumesGetTestJSON-140156175 None] Lock "cinder-7cdf6194-05de-4708-8ecb-0a529284a8cc-delete_volume" released by "delete_volume" :: held 1.135s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:52:05 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-b36b43ce-788b-4cc1-93d5-eab3997ffca0 req-9549b5c9-45f4-4abe-bba1-c02c5e9ef2ae tempest-TestStampPattern-1401503402 None] Terminate volume connection completed successfully. Aug 11 04:52:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-b36b43ce-788b-4cc1-93d5-eab3997ffca0 req-9549b5c9-45f4-4abe-bba1-c02c5e9ef2ae tempest-TestStampPattern-1401503402 None] Deleting attachment 2cd053fa-0950-4038-b4cb-9acd8cd4bcd3. {{(pid=94472) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 11 04:52:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-edebe516-9aa4-4dbb-aa56-2155a3380426 tempest-TestStampPattern-1401503402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:52:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-edebe516-9aa4-4dbb-aa56-2155a3380426 tempest-TestStampPattern-1401503402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:52:06 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-edebe516-9aa4-4dbb-aa56-2155a3380426 tempest-TestStampPattern-1401503402 None] Creating offline snapshot d124a861-f391-404a-b00d-6d293d93dc6c of volume c7882da0-8442-4172-9cbc-fff1eb23344a {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 04:52:06 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6aef41-c891-477c-a68f-523aa06afe89]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:52:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-edebe516-9aa4-4dbb-aa56-2155a3380426 tempest-TestStampPattern-1401503402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:52:06 devstack sudo[111405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a Aug 11 04:52:06 devstack sudo[111405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:52:06 devstack sudo[111405]: pam_unix(sudo:session): session closed for user root Aug 11 04:52:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-edebe516-9aa4-4dbb-aa56-2155a3380426 tempest-TestStampPattern-1401503402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a" returned: 0 in 0.373s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:52:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-edebe516-9aa4-4dbb-aa56-2155a3380426 tempest-TestStampPattern-1401503402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a.d124a861-f391-404a-b00d-6d293d93dc6c 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:52:06 devstack sudo[111410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a.d124a861-f391-404a-b00d-6d293d93dc6c 1G Aug 11 04:52:06 devstack sudo[111410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:52:07 devstack sudo[111410]: pam_unix(sudo:session): session closed for user root Aug 11 04:52:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-edebe516-9aa4-4dbb-aa56-2155a3380426 tempest-TestStampPattern-1401503402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a.d124a861-f391-404a-b00d-6d293d93dc6c 1G" returned: 0 in 0.428s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:52:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-edebe516-9aa4-4dbb-aa56-2155a3380426 tempest-TestStampPattern-1401503402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7882da0-8442-4172-9cbc-fff1eb23344a -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a.d124a861-f391-404a-b00d-6d293d93dc6c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:52:07 devstack sudo[111416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7882da0-8442-4172-9cbc-fff1eb23344a -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a.d124a861-f391-404a-b00d-6d293d93dc6c Aug 11 04:52:07 devstack sudo[111416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:52:07 devstack sudo[111416]: pam_unix(sudo:session): session closed for user root Aug 11 04:52:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-edebe516-9aa4-4dbb-aa56-2155a3380426 tempest-TestStampPattern-1401503402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7882da0-8442-4172-9cbc-fff1eb23344a -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a.d124a861-f391-404a-b00d-6d293d93dc6c" returned: 0 in 0.295s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:52:07 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-edebe516-9aa4-4dbb-aa56-2155a3380426 tempest-TestStampPattern-1401503402 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a.d124a861-f391-404a-b00d-6d293d93dc6c is being set with open permissions: ugo+rw Aug 11 04:52:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-edebe516-9aa4-4dbb-aa56-2155a3380426 tempest-TestStampPattern-1401503402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a.d124a861-f391-404a-b00d-6d293d93dc6c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:52:07 devstack sudo[111421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a.d124a861-f391-404a-b00d-6d293d93dc6c Aug 11 04:52:07 devstack sudo[111421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:52:07 devstack sudo[111421]: pam_unix(sudo:session): session closed for user root Aug 11 04:52:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-edebe516-9aa4-4dbb-aa56-2155a3380426 tempest-TestStampPattern-1401503402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a.d124a861-f391-404a-b00d-6d293d93dc6c" returned: 0 in 0.282s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:52:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-edebe516-9aa4-4dbb-aa56-2155a3380426 tempest-TestStampPattern-1401503402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:52:07 devstack sudo[111424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a.info Aug 11 04:52:07 devstack sudo[111424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:52:07 devstack sudo[111424]: pam_unix(sudo:session): session closed for user root Aug 11 04:52:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-edebe516-9aa4-4dbb-aa56-2155a3380426 tempest-TestStampPattern-1401503402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a.info" returned: 0 in 0.263s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:52:07 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-edebe516-9aa4-4dbb-aa56-2155a3380426 tempest-TestStampPattern-1401503402 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a.info is being set with open permissions: ugo+rw Aug 11 04:52:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-edebe516-9aa4-4dbb-aa56-2155a3380426 tempest-TestStampPattern-1401503402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:52:08 devstack sudo[111427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a.info Aug 11 04:52:08 devstack sudo[111427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:52:08 devstack sudo[111427]: pam_unix(sudo:session): session closed for user root Aug 11 04:52:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-edebe516-9aa4-4dbb-aa56-2155a3380426 tempest-TestStampPattern-1401503402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a.info" returned: 0 in 0.265s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:52:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-edebe516-9aa4-4dbb-aa56-2155a3380426 tempest-TestStampPattern-1401503402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.996s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:52:08 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-edebe516-9aa4-4dbb-aa56-2155a3380426 tempest-TestStampPattern-1401503402 None] Create snapshot completed successfully Aug 11 04:52:15 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-d29c2a17-f463-4863-9418-115730b9ae02 tempest-TestStampPattern-1401503402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:52:15 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d29c2a17-f463-4863-9418-115730b9ae02 tempest-TestStampPattern-1401503402 None] Flow 'volume_create_manager' (7929e7c7-a71d-42f2-93c9-2ce057ccb7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:52:15 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d29c2a17-f463-4863-9418-115730b9ae02 tempest-TestStampPattern-1401503402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (644bc9ee-8f74-4a95-ae9e-56792d9934d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:52:15 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d29c2a17-f463-4863-9418-115730b9ae02 tempest-TestStampPattern-1401503402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (644bc9ee-8f74-4a95-ae9e-56792d9934d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:52:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1805651565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a4c96df-707b-4344-a154-734cf3c3cf7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3402c881b7604cd987926cef40e0a7a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d124a861-f391-404a-b00d-6d293d93dc6c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:52:15Z,use_quota=True,user_id='293791954de14ed5875aae566cdb7a24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:52:15 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d29c2a17-f463-4863-9418-115730b9ae02 tempest-TestStampPattern-1401503402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8513643-4306-419c-98bb-352385bf8ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:52:15 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d29c2a17-f463-4863-9418-115730b9ae02 tempest-TestStampPattern-1401503402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8513643-4306-419c-98bb-352385bf8ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:52:15 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d29c2a17-f463-4863-9418-115730b9ae02 tempest-TestStampPattern-1401503402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d025a7c0-ece1-40dd-b61d-f580cbaae6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:52:15 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d29c2a17-f463-4863-9418-115730b9ae02 tempest-TestStampPattern-1401503402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d025a7c0-ece1-40dd-b61d-f580cbaae6f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8a4c96df-707b-4344-a154-734cf3c3cf7b', 'volume_name': 'volume-8a4c96df-707b-4344-a154-734cf3c3cf7b', 'volume_size': 1, 'snapshot_id': 'd124a861-f391-404a-b00d-6d293d93dc6c'}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:52:15 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d29c2a17-f463-4863-9418-115730b9ae02 tempest-TestStampPattern-1401503402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (042bfa4f-10e6-4f45-a145-9933eaf38c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:52:15 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d29c2a17-f463-4863-9418-115730b9ae02 tempest-TestStampPattern-1401503402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (042bfa4f-10e6-4f45-a145-9933eaf38c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:52:15 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d29c2a17-f463-4863-9418-115730b9ae02 tempest-TestStampPattern-1401503402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f98c8bb-e252-416e-8dd9-1de61dfab125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:52:15 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-d29c2a17-f463-4863-9418-115730b9ae02 tempest-TestStampPattern-1401503402 None] Volume 8a4c96df-707b-4344-a154-734cf3c3cf7b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8a4c96df-707b-4344-a154-734cf3c3cf7b', 'volume_size': 1, 'snapshot_id': 'd124a861-f391-404a-b00d-6d293d93dc6c'} Aug 11 04:52:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d29c2a17-f463-4863-9418-115730b9ae02 tempest-TestStampPattern-1401503402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:52:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d29c2a17-f463-4863-9418-115730b9ae02 tempest-TestStampPattern-1401503402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:52:15 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d29c2a17-f463-4863-9418-115730b9ae02 tempest-TestStampPattern-1401503402 None] Acquiring lock "cinder-quobyte-d124a861-f391-404a-b00d-6d293d93dc6c-8a4c96df-707b-4344-a154-734cf3c3cf7b" by "_create_volume_from_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:52:15 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d29c2a17-f463-4863-9418-115730b9ae02 tempest-TestStampPattern-1401503402 None] Lock "cinder-quobyte-d124a861-f391-404a-b00d-6d293d93dc6c-8a4c96df-707b-4344-a154-734cf3c3cf7b" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:52:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d29c2a17-f463-4863-9418-115730b9ae02 tempest-TestStampPattern-1401503402 None] Creating volume 8a4c96df-707b-4344-a154-734cf3c3cf7b from snapshot d124a861-f391-404a-b00d-6d293d93dc6c {{(pid=94472) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 11 04:52:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d29c2a17-f463-4863-9418-115730b9ae02 tempest-TestStampPattern-1401503402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:52:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d29c2a17-f463-4863-9418-115730b9ae02 tempest-TestStampPattern-1401503402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:52:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d29c2a17-f463-4863-9418-115730b9ae02 tempest-TestStampPattern-1401503402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:52:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d29c2a17-f463-4863-9418-115730b9ae02 tempest-TestStampPattern-1401503402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:52:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d29c2a17-f463-4863-9418-115730b9ae02 tempest-TestStampPattern-1401503402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:52:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d29c2a17-f463-4863-9418-115730b9ae02 tempest-TestStampPattern-1401503402 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:52:15 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d29c2a17-f463-4863-9418-115730b9ae02 tempest-TestStampPattern-1401503402 None] Acquiring lock "cinder-quobyte-8a4c96df-707b-4344-a154-734cf3c3cf7b" by "_copy_volume_from_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:52:15 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d29c2a17-f463-4863-9418-115730b9ae02 tempest-TestStampPattern-1401503402 None] Lock "cinder-quobyte-8a4c96df-707b-4344-a154-734cf3c3cf7b" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:52:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d29c2a17-f463-4863-9418-115730b9ae02 tempest-TestStampPattern-1401503402 None] snapshot: d124a861-f391-404a-b00d-6d293d93dc6c, volume: 8a4c96df-707b-4344-a154-734cf3c3cf7b, {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 11 04:52:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d29c2a17-f463-4863-9418-115730b9ae02 tempest-TestStampPattern-1401503402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:52:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d29c2a17-f463-4863-9418-115730b9ae02 tempest-TestStampPattern-1401503402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:52:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d29c2a17-f463-4863-9418-115730b9ae02 tempest-TestStampPattern-1401503402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:52:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d29c2a17-f463-4863-9418-115730b9ae02 tempest-TestStampPattern-1401503402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:52:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d29c2a17-f463-4863-9418-115730b9ae02 tempest-TestStampPattern-1401503402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:52:15 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b12e71-da58-4f13-a96a-c6dbefcb9354]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:52:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d29c2a17-f463-4863-9418-115730b9ae02 tempest-TestStampPattern-1401503402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a.d124a861-f391-404a-b00d-6d293d93dc6c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:52:15 devstack sudo[111468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a.d124a861-f391-404a-b00d-6d293d93dc6c Aug 11 04:52:15 devstack sudo[111468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:52:15 devstack sudo[111468]: pam_unix(sudo:session): session closed for user root Aug 11 04:52:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d29c2a17-f463-4863-9418-115730b9ae02 tempest-TestStampPattern-1401503402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a.d124a861-f391-404a-b00d-6d293d93dc6c" returned: 0 in 0.398s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:52:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-d29c2a17-f463-4863-9418-115730b9ae02 tempest-TestStampPattern-1401503402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7882da0-8442-4172-9cbc-fff1eb23344a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:52:15 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[421589f8-71de-4601-8572-d0f4397ff963]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:52:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d29c2a17-f463-4863-9418-115730b9ae02 tempest-TestStampPattern-1401503402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:52:16 devstack sudo[111473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a Aug 11 04:52:16 devstack sudo[111473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:52:16 devstack sudo[111473]: pam_unix(sudo:session): session closed for user root Aug 11 04:52:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d29c2a17-f463-4863-9418-115730b9ae02 tempest-TestStampPattern-1401503402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a" returned: 0 in 0.435s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:52:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d29c2a17-f463-4863-9418-115730b9ae02 tempest-TestStampPattern-1401503402 None] will copy from snapshot at /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 11 04:52:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d29c2a17-f463-4863-9418-115730b9ae02 tempest-TestStampPattern-1401503402 None] Creating direct copy from snapshot {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 11 04:52:16 devstack cinder-volume[94472]: DEBUG cinder.utils [None req-d29c2a17-f463-4863-9418-115730b9ae02 tempest-TestStampPattern-1401503402 None] Path /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8a4c96df-707b-4344-a154-734cf3c3cf7b not found in is_blk_device check {{(pid=94472) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 11 04:52:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d29c2a17-f463-4863-9418-115730b9ae02 tempest-TestStampPattern-1401503402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8a4c96df-707b-4344-a154-734cf3c3cf7b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:52:16 devstack sudo[111481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8a4c96df-707b-4344-a154-734cf3c3cf7b Aug 11 04:52:16 devstack sudo[111481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:52:23 devstack sudo[111481]: pam_unix(sudo:session): session closed for user root Aug 11 04:52:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d29c2a17-f463-4863-9418-115730b9ae02 tempest-TestStampPattern-1401503402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8a4c96df-707b-4344-a154-734cf3c3cf7b" returned: 0 in 6.622s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:52:23 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-d29c2a17-f463-4863-9418-115730b9ae02 tempest-TestStampPattern-1401503402 None] Image conversion details: src /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a, size 1024.00 MB, duration 6.62 sec, destination /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8a4c96df-707b-4344-a154-734cf3c3cf7b {{(pid=94472) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 11 04:52:23 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-d29c2a17-f463-4863-9418-115730b9ae02 tempest-TestStampPattern-1401503402 None] Converted 1024.00 MB image at 154.60 MB/s Aug 11 04:52:23 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-d29c2a17-f463-4863-9418-115730b9ae02 tempest-TestStampPattern-1401503402 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8a4c96df-707b-4344-a154-734cf3c3cf7b is being set with open permissions: ugo+rw Aug 11 04:52:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d29c2a17-f463-4863-9418-115730b9ae02 tempest-TestStampPattern-1401503402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8a4c96df-707b-4344-a154-734cf3c3cf7b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:52:23 devstack sudo[111531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8a4c96df-707b-4344-a154-734cf3c3cf7b Aug 11 04:52:23 devstack sudo[111531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:52:23 devstack sudo[111531]: pam_unix(sudo:session): session closed for user root Aug 11 04:52:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d29c2a17-f463-4863-9418-115730b9ae02 tempest-TestStampPattern-1401503402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8a4c96df-707b-4344-a154-734cf3c3cf7b" returned: 0 in 0.328s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:52:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d29c2a17-f463-4863-9418-115730b9ae02 tempest-TestStampPattern-1401503402 None] Lock "cinder-quobyte-8a4c96df-707b-4344-a154-734cf3c3cf7b" released by "_copy_volume_from_snapshot" :: held 7.902s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:52:23 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:UPDATE=76,cinder:DELETE=4,cinder:SELECT=70,cinder:INSERT=15 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:52:23 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=75,cinder:INSERT=16,cinder:UPDATE=62,cinder:DELETE=8 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:52:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d29c2a17-f463-4863-9418-115730b9ae02 tempest-TestStampPattern-1401503402 None] Lock "cinder-quobyte-d124a861-f391-404a-b00d-6d293d93dc6c-8a4c96df-707b-4344-a154-734cf3c3cf7b" released by "_create_volume_from_snapshot" :: held 8.017s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:52:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d29c2a17-f463-4863-9418-115730b9ae02 tempest-TestStampPattern-1401503402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.042s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:52:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d29c2a17-f463-4863-9418-115730b9ae02 tempest-TestStampPattern-1401503402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f98c8bb-e252-416e-8dd9-1de61dfab125) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a4c96df-707b-4344-a154-734cf3c3cf7b', 'volume_size': 1, 'snapshot_id': 'd124a861-f391-404a-b00d-6d293d93dc6c'}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:52:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d29c2a17-f463-4863-9418-115730b9ae02 tempest-TestStampPattern-1401503402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba26b58f-71df-4465-97fc-d305ca80f1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:52:23 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-d29c2a17-f463-4863-9418-115730b9ae02 tempest-TestStampPattern-1401503402 None] Volume volume-8a4c96df-707b-4344-a154-734cf3c3cf7b (8a4c96df-707b-4344-a154-734cf3c3cf7b): created successfully Aug 11 04:52:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d29c2a17-f463-4863-9418-115730b9ae02 tempest-TestStampPattern-1401503402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba26b58f-71df-4465-97fc-d305ca80f1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:52:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d29c2a17-f463-4863-9418-115730b9ae02 tempest-TestStampPattern-1401503402 None] Flow 'volume_create_manager' (7929e7c7-a71d-42f2-93c9-2ce057ccb7f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:52:23 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-d29c2a17-f463-4863-9418-115730b9ae02 tempest-TestStampPattern-1401503402 None] Created volume successfully. Aug 11 04:52:27 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-917d4582-9f12-437d-84ba-f6d91bfa0e64 tempest-VolumeTypesAccessTest-600079332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:52:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-917d4582-9f12-437d-84ba-f6d91bfa0e64 tempest-VolumeTypesAccessTest-600079332 None] Flow 'volume_create_manager' (c17bff9f-b9d0-4b4f-b7dc-fd034202a689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:52:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-917d4582-9f12-437d-84ba-f6d91bfa0e64 tempest-VolumeTypesAccessTest-600079332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (520343e3-c2b3-4cab-86cb-61998803c7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:52:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-917d4582-9f12-437d-84ba-f6d91bfa0e64 tempest-VolumeTypesAccessTest-600079332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (520343e3-c2b3-4cab-86cb-61998803c7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:52:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1287441646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=101a3eee-5b79-4d96-975b-a46fa20234aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1709407e8fbf4ac285589eaebc9bea4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:52:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:52:27Z,use_quota=True,user_id='128eec9d4fe14dac82ebb799f7b4a644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41c46f28-cfa7-4f11-ac93-3ccaba11b5b1),volume_type_id=41c46f28-cfa7-4f11-ac93-3ccaba11b5b1)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:52:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-917d4582-9f12-437d-84ba-f6d91bfa0e64 tempest-VolumeTypesAccessTest-600079332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf865c14-2d4f-4a72-976d-ded8df436b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:52:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-917d4582-9f12-437d-84ba-f6d91bfa0e64 tempest-VolumeTypesAccessTest-600079332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf865c14-2d4f-4a72-976d-ded8df436b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:52:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-917d4582-9f12-437d-84ba-f6d91bfa0e64 tempest-VolumeTypesAccessTest-600079332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d5465eb-fe75-44dc-83ed-ea82181c0b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:52:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-917d4582-9f12-437d-84ba-f6d91bfa0e64 tempest-VolumeTypesAccessTest-600079332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d5465eb-fe75-44dc-83ed-ea82181c0b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '101a3eee-5b79-4d96-975b-a46fa20234aa', 'volume_name': 'volume-101a3eee-5b79-4d96-975b-a46fa20234aa', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:52:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-917d4582-9f12-437d-84ba-f6d91bfa0e64 tempest-VolumeTypesAccessTest-600079332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a295b79f-98e7-4624-914d-25109c572860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:52:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-917d4582-9f12-437d-84ba-f6d91bfa0e64 tempest-VolumeTypesAccessTest-600079332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a295b79f-98e7-4624-914d-25109c572860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:52:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-917d4582-9f12-437d-84ba-f6d91bfa0e64 tempest-VolumeTypesAccessTest-600079332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecaed03a-783a-4512-943d-320c9126bdc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:52:27 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-917d4582-9f12-437d-84ba-f6d91bfa0e64 tempest-VolumeTypesAccessTest-600079332 None] Volume 101a3eee-5b79-4d96-975b-a46fa20234aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-101a3eee-5b79-4d96-975b-a46fa20234aa', 'volume_size': 1} Aug 11 04:52:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-917d4582-9f12-437d-84ba-f6d91bfa0e64 tempest-VolumeTypesAccessTest-600079332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:52:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-917d4582-9f12-437d-84ba-f6d91bfa0e64 tempest-VolumeTypesAccessTest-600079332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:52:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-917d4582-9f12-437d-84ba-f6d91bfa0e64 tempest-VolumeTypesAccessTest-600079332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:52:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1287441646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=101a3eee-5b79-4d96-975b-a46fa20234aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1709407e8fbf4ac285589eaebc9bea4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:52:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:52:27Z,use_quota=True,user_id='128eec9d4fe14dac82ebb799f7b4a644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41c46f28-cfa7-4f11-ac93-3ccaba11b5b1),volume_type_id=41c46f28-cfa7-4f11-ac93-3ccaba11b5b1)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:52:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-917d4582-9f12-437d-84ba-f6d91bfa0e64 tempest-VolumeTypesAccessTest-600079332 None] Creating volume 101a3eee-5b79-4d96-975b-a46fa20234aa {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:52:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-917d4582-9f12-437d-84ba-f6d91bfa0e64 tempest-VolumeTypesAccessTest-600079332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:52:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-917d4582-9f12-437d-84ba-f6d91bfa0e64 tempest-VolumeTypesAccessTest-600079332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:52:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-917d4582-9f12-437d-84ba-f6d91bfa0e64 tempest-VolumeTypesAccessTest-600079332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:52:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-917d4582-9f12-437d-84ba-f6d91bfa0e64 tempest-VolumeTypesAccessTest-600079332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:52:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-917d4582-9f12-437d-84ba-f6d91bfa0e64 tempest-VolumeTypesAccessTest-600079332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:52:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-917d4582-9f12-437d-84ba-f6d91bfa0e64 tempest-VolumeTypesAccessTest-600079332 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:52:27 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-917d4582-9f12-437d-84ba-f6d91bfa0e64 tempest-VolumeTypesAccessTest-600079332 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:52:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-917d4582-9f12-437d-84ba-f6d91bfa0e64 tempest-VolumeTypesAccessTest-600079332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-101a3eee-5b79-4d96-975b-a46fa20234aa 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:52:27 devstack sudo[111628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-101a3eee-5b79-4d96-975b-a46fa20234aa 1073741824 Aug 11 04:52:27 devstack sudo[111628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:52:27 devstack sudo[111628]: pam_unix(sudo:session): session closed for user root Aug 11 04:52:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-917d4582-9f12-437d-84ba-f6d91bfa0e64 tempest-VolumeTypesAccessTest-600079332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-101a3eee-5b79-4d96-975b-a46fa20234aa 1073741824" returned: 0 in 0.539s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:52:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-917d4582-9f12-437d-84ba-f6d91bfa0e64 tempest-VolumeTypesAccessTest-600079332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-101a3eee-5b79-4d96-975b-a46fa20234aa {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:52:27 devstack sudo[111634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-101a3eee-5b79-4d96-975b-a46fa20234aa Aug 11 04:52:27 devstack sudo[111634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:52:28 devstack sudo[111634]: pam_unix(sudo:session): session closed for user root Aug 11 04:52:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-917d4582-9f12-437d-84ba-f6d91bfa0e64 tempest-VolumeTypesAccessTest-600079332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-101a3eee-5b79-4d96-975b-a46fa20234aa" returned: 0 in 0.273s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:52:28 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-917d4582-9f12-437d-84ba-f6d91bfa0e64 tempest-VolumeTypesAccessTest-600079332 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:52:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-917d4582-9f12-437d-84ba-f6d91bfa0e64 tempest-VolumeTypesAccessTest-600079332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:52:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-917d4582-9f12-437d-84ba-f6d91bfa0e64 tempest-VolumeTypesAccessTest-600079332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecaed03a-783a-4512-943d-320c9126bdc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-101a3eee-5b79-4d96-975b-a46fa20234aa', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:52:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-917d4582-9f12-437d-84ba-f6d91bfa0e64 tempest-VolumeTypesAccessTest-600079332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69717ee6-3670-4b00-8e8d-dab8fc3d6274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:52:28 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-917d4582-9f12-437d-84ba-f6d91bfa0e64 tempest-VolumeTypesAccessTest-600079332 None] Volume volume-101a3eee-5b79-4d96-975b-a46fa20234aa (101a3eee-5b79-4d96-975b-a46fa20234aa): created successfully Aug 11 04:52:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-917d4582-9f12-437d-84ba-f6d91bfa0e64 tempest-VolumeTypesAccessTest-600079332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69717ee6-3670-4b00-8e8d-dab8fc3d6274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:52:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-917d4582-9f12-437d-84ba-f6d91bfa0e64 tempest-VolumeTypesAccessTest-600079332 None] Flow 'volume_create_manager' (c17bff9f-b9d0-4b4f-b7dc-fd034202a689) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:52:28 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-917d4582-9f12-437d-84ba-f6d91bfa0e64 tempest-VolumeTypesAccessTest-600079332 None] Created volume successfully. Aug 11 04:52:29 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8b6ed484-696e-4394-ac7f-87cc187a3d7d tempest-VolumeTypesAccessTest-600079332 None] Acquiring lock "cinder-101a3eee-5b79-4d96-975b-a46fa20234aa-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:52:29 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8b6ed484-696e-4394-ac7f-87cc187a3d7d tempest-VolumeTypesAccessTest-600079332 None] Lock "cinder-101a3eee-5b79-4d96-975b-a46fa20234aa-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:52:29 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8b6ed484-696e-4394-ac7f-87cc187a3d7d tempest-VolumeTypesAccessTest-600079332 None] Acquiring lock "cinder-quobyte-101a3eee-5b79-4d96-975b-a46fa20234aa" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:52:29 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8b6ed484-696e-4394-ac7f-87cc187a3d7d tempest-VolumeTypesAccessTest-600079332 None] Lock "cinder-quobyte-101a3eee-5b79-4d96-975b-a46fa20234aa" acquired by "delete_volume" :: waited 0.020s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:52:29 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[2029a731-a281-40db-ab12-bbf29d55d88a]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:52:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8b6ed484-696e-4394-ac7f-87cc187a3d7d tempest-VolumeTypesAccessTest-600079332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-101a3eee-5b79-4d96-975b-a46fa20234aa {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:52:29 devstack sudo[111637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-101a3eee-5b79-4d96-975b-a46fa20234aa Aug 11 04:52:29 devstack sudo[111637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:52:29 devstack sudo[111637]: pam_unix(sudo:session): session closed for user root Aug 11 04:52:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8b6ed484-696e-4394-ac7f-87cc187a3d7d tempest-VolumeTypesAccessTest-600079332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-101a3eee-5b79-4d96-975b-a46fa20234aa" returned: 0 in 0.459s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:52:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8b6ed484-696e-4394-ac7f-87cc187a3d7d tempest-VolumeTypesAccessTest-600079332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-101a3eee-5b79-4d96-975b-a46fa20234aa {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:52:29 devstack sudo[111643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-101a3eee-5b79-4d96-975b-a46fa20234aa Aug 11 04:52:29 devstack sudo[111643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:52:30 devstack sudo[111643]: pam_unix(sudo:session): session closed for user root Aug 11 04:52:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8b6ed484-696e-4394-ac7f-87cc187a3d7d tempest-VolumeTypesAccessTest-600079332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-101a3eee-5b79-4d96-975b-a46fa20234aa" returned: 0 in 0.308s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:52:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8b6ed484-696e-4394-ac7f-87cc187a3d7d tempest-VolumeTypesAccessTest-600079332 None] Lock "cinder-quobyte-101a3eee-5b79-4d96-975b-a46fa20234aa" released by "delete_volume" :: held 0.844s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:52:30 devstack cinder-volume[94472]: WARNING cinder.quota [None req-8b6ed484-696e-4394-ac7f-87cc187a3d7d tempest-VolumeTypesAccessTest-600079332 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-742429155 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-742429155, it is now deprecated. Please use the default quota class for default quota. Aug 11 04:52:30 devstack cinder-volume[94472]: WARNING cinder.quota [None req-8b6ed484-696e-4394-ac7f-87cc187a3d7d tempest-VolumeTypesAccessTest-600079332 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-742429155 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-742429155, it is now deprecated. Please use the default quota class for default quota. Aug 11 04:52:30 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-8b6ed484-696e-4394-ac7f-87cc187a3d7d tempest-VolumeTypesAccessTest-600079332 None] Created reservations ['a9984612-7a77-46a8-898a-de13b8ecdec0', '1353289e-e290-4847-9546-87b8abba51bd', '8b6fdaa2-f7f9-4fe2-81b7-88efd3bc8387', '6a991fcb-dc89-4a1d-97b1-798cfbec2ba8'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:52:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8b6ed484-696e-4394-ac7f-87cc187a3d7d tempest-VolumeTypesAccessTest-600079332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:52:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8b6ed484-696e-4394-ac7f-87cc187a3d7d tempest-VolumeTypesAccessTest-600079332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:52:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-8b6ed484-696e-4394-ac7f-87cc187a3d7d tempest-VolumeTypesAccessTest-600079332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:52:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-8b6ed484-696e-4394-ac7f-87cc187a3d7d tempest-VolumeTypesAccessTest-600079332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:52:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8b6ed484-696e-4394-ac7f-87cc187a3d7d tempest-VolumeTypesAccessTest-600079332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:52:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8b6ed484-696e-4394-ac7f-87cc187a3d7d tempest-VolumeTypesAccessTest-600079332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:52:30 devstack sudo[111647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:52:30 devstack sudo[111647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:52:30 devstack sudo[111647]: pam_unix(sudo:session): session closed for user root Aug 11 04:52:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8b6ed484-696e-4394-ac7f-87cc187a3d7d tempest-VolumeTypesAccessTest-600079332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.293s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:52:30 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-8b6ed484-696e-4394-ac7f-87cc187a3d7d tempest-VolumeTypesAccessTest-600079332 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:52:30 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-8b6ed484-696e-4394-ac7f-87cc187a3d7d tempest-VolumeTypesAccessTest-600079332 None] Deleted volume successfully. Aug 11 04:52:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8b6ed484-696e-4394-ac7f-87cc187a3d7d tempest-VolumeTypesAccessTest-600079332 None] Lock "cinder-101a3eee-5b79-4d96-975b-a46fa20234aa-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:52:40 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=7,cinder:INSERT=3,cinder:UPDATE=14,cinder:DELETE=1 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:52:40 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=9,cinder:UPDATE=12,cinder:INSERT=3,cinder:DELETE=2 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:52:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-58cc5069-0244-4da0-9f03-1940f1de2845 req-4fb1773b-b105-4d09-957a-ef07ac2eef87 tempest-TestStampPattern-1401503402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:52:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-58cc5069-0244-4da0-9f03-1940f1de2845 req-4fb1773b-b105-4d09-957a-ef07ac2eef87 tempest-TestStampPattern-1401503402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:52:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-58cc5069-0244-4da0-9f03-1940f1de2845 req-4fb1773b-b105-4d09-957a-ef07ac2eef87 tempest-TestStampPattern-1401503402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:52:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-58cc5069-0244-4da0-9f03-1940f1de2845 req-4fb1773b-b105-4d09-957a-ef07ac2eef87 tempest-TestStampPattern-1401503402 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd', 'name': 'volume-8a4c96df-707b-4344-a154-734cf3c3cf7b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bdf90c8e-48e5-4ed6-996c-1e2f5cff2107', 'enforce_multipath': True} {{(pid=94472) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 11 04:52:53 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-58cc5069-0244-4da0-9f03-1940f1de2845 req-4fb1773b-b105-4d09-957a-ef07ac2eef87 tempest-TestStampPattern-1401503402 None] attachment_update completed successfully. Aug 11 04:52:57 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-151ff8a5-b8d6-4ae6-8e1f-9c24f915d136 req-7c47478e-89c6-4c00-be6b-9d0338cde97f tempest-TestStampPattern-1401503402 None] Terminate volume connection completed successfully. Aug 11 04:52:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-151ff8a5-b8d6-4ae6-8e1f-9c24f915d136 req-7c47478e-89c6-4c00-be6b-9d0338cde97f tempest-TestStampPattern-1401503402 None] Deleting attachment bdf90c8e-48e5-4ed6-996c-1e2f5cff2107. {{(pid=94472) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 11 04:52:58 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 04:52:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:52:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:52:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:52:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:52:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:52:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:52:58 devstack sudo[112134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:52:58 devstack sudo[112134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:52:58 devstack sudo[112134]: pam_unix(sudo:session): session closed for user root Aug 11 04:52:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.350s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:52:58 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:52:58 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running periodic task VolumeManager._thread_info {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 04:52:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] thread count: 28 {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 11 04:52:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] thread info: [<_MainThread(MainThread, started 133315846115456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 11 04:53:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9813d3d0-fcc9-485d-8de1-84a1e5c9b89d tempest-TestStampPattern-1401503402 None] Acquiring lock "cinder-8a4c96df-707b-4344-a154-734cf3c3cf7b-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:53:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9813d3d0-fcc9-485d-8de1-84a1e5c9b89d tempest-TestStampPattern-1401503402 None] Lock "cinder-8a4c96df-707b-4344-a154-734cf3c3cf7b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:53:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9813d3d0-fcc9-485d-8de1-84a1e5c9b89d tempest-TestStampPattern-1401503402 None] Acquiring lock "cinder-quobyte-8a4c96df-707b-4344-a154-734cf3c3cf7b" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:53:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9813d3d0-fcc9-485d-8de1-84a1e5c9b89d tempest-TestStampPattern-1401503402 None] Lock "cinder-quobyte-8a4c96df-707b-4344-a154-734cf3c3cf7b" acquired by "delete_volume" :: waited 0.030s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:53:02 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee04b6d-3ab4-4caf-8366-a4ab2392d6dd]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:53:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9813d3d0-fcc9-485d-8de1-84a1e5c9b89d tempest-TestStampPattern-1401503402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8a4c96df-707b-4344-a154-734cf3c3cf7b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:02 devstack sudo[112254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8a4c96df-707b-4344-a154-734cf3c3cf7b Aug 11 04:53:02 devstack sudo[112254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:02 devstack sudo[112254]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9813d3d0-fcc9-485d-8de1-84a1e5c9b89d tempest-TestStampPattern-1401503402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8a4c96df-707b-4344-a154-734cf3c3cf7b" returned: 0 in 0.380s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9813d3d0-fcc9-485d-8de1-84a1e5c9b89d tempest-TestStampPattern-1401503402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8a4c96df-707b-4344-a154-734cf3c3cf7b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:02 devstack sudo[112259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8a4c96df-707b-4344-a154-734cf3c3cf7b Aug 11 04:53:02 devstack sudo[112259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:03 devstack sudo[112259]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9813d3d0-fcc9-485d-8de1-84a1e5c9b89d tempest-TestStampPattern-1401503402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8a4c96df-707b-4344-a154-734cf3c3cf7b" returned: 0 in 0.273s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:03 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9813d3d0-fcc9-485d-8de1-84a1e5c9b89d tempest-TestStampPattern-1401503402 None] Lock "cinder-quobyte-8a4c96df-707b-4344-a154-734cf3c3cf7b" released by "delete_volume" :: held 0.721s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:53:03 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-9813d3d0-fcc9-485d-8de1-84a1e5c9b89d tempest-TestStampPattern-1401503402 None] Created reservations ['d83f747b-0ebb-49c3-b7b5-33a96e0ca767', '583b1452-e8ca-4d4e-b9ba-7ad0624fd564', '7ac2442a-cd9d-403c-b501-cf72a61db657', 'd15b0882-ae01-4a7c-be1e-63b87f4f1893'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:53:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9813d3d0-fcc9-485d-8de1-84a1e5c9b89d tempest-TestStampPattern-1401503402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:53:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9813d3d0-fcc9-485d-8de1-84a1e5c9b89d tempest-TestStampPattern-1401503402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:53:03 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9813d3d0-fcc9-485d-8de1-84a1e5c9b89d tempest-TestStampPattern-1401503402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:53:03 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9813d3d0-fcc9-485d-8de1-84a1e5c9b89d tempest-TestStampPattern-1401503402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:53:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9813d3d0-fcc9-485d-8de1-84a1e5c9b89d tempest-TestStampPattern-1401503402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:53:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9813d3d0-fcc9-485d-8de1-84a1e5c9b89d tempest-TestStampPattern-1401503402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:03 devstack sudo[112263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:53:03 devstack sudo[112263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:03 devstack sudo[112263]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9813d3d0-fcc9-485d-8de1-84a1e5c9b89d tempest-TestStampPattern-1401503402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.375s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:03 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-9813d3d0-fcc9-485d-8de1-84a1e5c9b89d tempest-TestStampPattern-1401503402 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:53:03 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-9813d3d0-fcc9-485d-8de1-84a1e5c9b89d tempest-TestStampPattern-1401503402 None] Deleted volume successfully. Aug 11 04:53:03 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9813d3d0-fcc9-485d-8de1-84a1e5c9b89d tempest-TestStampPattern-1401503402 None] Lock "cinder-8a4c96df-707b-4344-a154-734cf3c3cf7b-delete_volume" released by "delete_volume" :: held 1.378s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:53:04 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8cc6649f-d0db-4e15-b225-27c12f124cd2 tempest-TestStampPattern-1401503402 None] Acquiring lock "cinder-d124a861-f391-404a-b00d-6d293d93dc6c-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:53:04 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8cc6649f-d0db-4e15-b225-27c12f124cd2 tempest-TestStampPattern-1401503402 None] Lock "cinder-d124a861-f391-404a-b00d-6d293d93dc6c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:53:04 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8cc6649f-d0db-4e15-b225-27c12f124cd2 tempest-TestStampPattern-1401503402 None] Acquiring lock "cinder-quobyte-c7882da0-8442-4172-9cbc-fff1eb23344a" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:53:04 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8cc6649f-d0db-4e15-b225-27c12f124cd2 tempest-TestStampPattern-1401503402 None] Lock "cinder-quobyte-c7882da0-8442-4172-9cbc-fff1eb23344a" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:53:04 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8cc6649f-d0db-4e15-b225-27c12f124cd2 tempest-TestStampPattern-1401503402 None] Acquiring lock "cinder-quobyte-d124a861-f391-404a-b00d-6d293d93dc6c" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:53:04 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8cc6649f-d0db-4e15-b225-27c12f124cd2 tempest-TestStampPattern-1401503402 None] Lock "cinder-quobyte-d124a861-f391-404a-b00d-6d293d93dc6c" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:53:04 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-8cc6649f-d0db-4e15-b225-27c12f124cd2 tempest-TestStampPattern-1401503402 None] Deleting offline snapshot d124a861-f391-404a-b00d-6d293d93dc6c of volume c7882da0-8442-4172-9cbc-fff1eb23344a {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 04:53:04 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-8cc6649f-d0db-4e15-b225-27c12f124cd2 tempest-TestStampPattern-1401503402 None] snapshot_file for this snap is: volume-c7882da0-8442-4172-9cbc-fff1eb23344a.d124a861-f391-404a-b00d-6d293d93dc6c {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 04:53:04 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1e9775-9a2f-4b92-a3cb-6d4fa4e56a1e]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:53:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8cc6649f-d0db-4e15-b225-27c12f124cd2 tempest-TestStampPattern-1401503402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a.d124a861-f391-404a-b00d-6d293d93dc6c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:04 devstack sudo[112266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a.d124a861-f391-404a-b00d-6d293d93dc6c Aug 11 04:53:04 devstack sudo[112266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:04 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-15dede62-c576-45a6-8f3d-a560de863fc3 tempest-VolumesActionsTest-1176500285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:53:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-15dede62-c576-45a6-8f3d-a560de863fc3 tempest-VolumesActionsTest-1176500285 None] Flow 'volume_create_manager' (7419a8fb-7714-4d1e-9976-7bdffe2d0beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:53:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-15dede62-c576-45a6-8f3d-a560de863fc3 tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4e65066-f499-4c68-b561-5cf4ed9df64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-15dede62-c576-45a6-8f3d-a560de863fc3 tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4e65066-f499-4c68-b561-5cf4ed9df64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1626429874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33fcab26-dbe2-4277-9cd1-18539964d777,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a9b228e1b4d444f8fb7b7d54d8ff281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:53:04Z,use_quota=True,user_id='58888af2ad8e4cfb861a6bdac6ca640d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-15dede62-c576-45a6-8f3d-a560de863fc3 tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a29e5dfd-1f3c-4f86-ba86-ab4a88b02ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-15dede62-c576-45a6-8f3d-a560de863fc3 tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a29e5dfd-1f3c-4f86-ba86-ab4a88b02ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-15dede62-c576-45a6-8f3d-a560de863fc3 tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b94d9cc-e276-4ad0-8c29-9952eb2400a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-15dede62-c576-45a6-8f3d-a560de863fc3 tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b94d9cc-e276-4ad0-8c29-9952eb2400a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33fcab26-dbe2-4277-9cd1-18539964d777', 'volume_name': 'volume-33fcab26-dbe2-4277-9cd1-18539964d777', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-15dede62-c576-45a6-8f3d-a560de863fc3 tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08679df8-24cd-4854-93dc-d8a4c710f106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-15dede62-c576-45a6-8f3d-a560de863fc3 tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08679df8-24cd-4854-93dc-d8a4c710f106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-15dede62-c576-45a6-8f3d-a560de863fc3 tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5805d35-af0f-481e-a320-1424ebf849f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:04 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-15dede62-c576-45a6-8f3d-a560de863fc3 tempest-VolumesActionsTest-1176500285 None] Volume 33fcab26-dbe2-4277-9cd1-18539964d777: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33fcab26-dbe2-4277-9cd1-18539964d777', 'volume_size': 1} Aug 11 04:53:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-15dede62-c576-45a6-8f3d-a560de863fc3 tempest-VolumesActionsTest-1176500285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:53:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-15dede62-c576-45a6-8f3d-a560de863fc3 tempest-VolumesActionsTest-1176500285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:53:04 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-15dede62-c576-45a6-8f3d-a560de863fc3 tempest-VolumesActionsTest-1176500285 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1626429874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33fcab26-dbe2-4277-9cd1-18539964d777,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a9b228e1b4d444f8fb7b7d54d8ff281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:53:04Z,use_quota=True,user_id='58888af2ad8e4cfb861a6bdac6ca640d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:53:04 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-15dede62-c576-45a6-8f3d-a560de863fc3 tempest-VolumesActionsTest-1176500285 None] Creating volume 33fcab26-dbe2-4277-9cd1-18539964d777 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:53:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-15dede62-c576-45a6-8f3d-a560de863fc3 tempest-VolumesActionsTest-1176500285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:53:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-15dede62-c576-45a6-8f3d-a560de863fc3 tempest-VolumesActionsTest-1176500285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:53:04 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-15dede62-c576-45a6-8f3d-a560de863fc3 tempest-VolumesActionsTest-1176500285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:53:04 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-15dede62-c576-45a6-8f3d-a560de863fc3 tempest-VolumesActionsTest-1176500285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:53:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-15dede62-c576-45a6-8f3d-a560de863fc3 tempest-VolumesActionsTest-1176500285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:53:04 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-15dede62-c576-45a6-8f3d-a560de863fc3 tempest-VolumesActionsTest-1176500285 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:53:04 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-15dede62-c576-45a6-8f3d-a560de863fc3 tempest-VolumesActionsTest-1176500285 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:53:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-15dede62-c576-45a6-8f3d-a560de863fc3 tempest-VolumesActionsTest-1176500285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-33fcab26-dbe2-4277-9cd1-18539964d777 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:04 devstack sudo[112266]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8cc6649f-d0db-4e15-b225-27c12f124cd2 tempest-TestStampPattern-1401503402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a.d124a861-f391-404a-b00d-6d293d93dc6c" returned: 0 in 0.425s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:04 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-8cc6649f-d0db-4e15-b225-27c12f124cd2 tempest-TestStampPattern-1401503402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7882da0-8442-4172-9cbc-fff1eb23344a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:53:04 devstack sudo[112272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-33fcab26-dbe2-4277-9cd1-18539964d777 1073741824 Aug 11 04:53:04 devstack sudo[112272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:04 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5eaa48-d497-4423-a0b7-177043903c77]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:53:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8cc6649f-d0db-4e15-b225-27c12f124cd2 tempest-TestStampPattern-1401503402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:04 devstack sudo[112274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a Aug 11 04:53:04 devstack sudo[112274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:05 devstack sudo[112272]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-15dede62-c576-45a6-8f3d-a560de863fc3 tempest-VolumesActionsTest-1176500285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-33fcab26-dbe2-4277-9cd1-18539964d777 1073741824" returned: 0 in 0.467s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-15dede62-c576-45a6-8f3d-a560de863fc3 tempest-VolumesActionsTest-1176500285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-33fcab26-dbe2-4277-9cd1-18539964d777 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:05 devstack sudo[112282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-33fcab26-dbe2-4277-9cd1-18539964d777 Aug 11 04:53:05 devstack sudo[112282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:05 devstack sudo[112274]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8cc6649f-d0db-4e15-b225-27c12f124cd2 tempest-TestStampPattern-1401503402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a" returned: 0 in 0.603s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8cc6649f-d0db-4e15-b225-27c12f124cd2 tempest-TestStampPattern-1401503402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a.d124a861-f391-404a-b00d-6d293d93dc6c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:05 devstack sudo[112285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a.d124a861-f391-404a-b00d-6d293d93dc6c Aug 11 04:53:05 devstack sudo[112285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:05 devstack sudo[112282]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-15dede62-c576-45a6-8f3d-a560de863fc3 tempest-VolumesActionsTest-1176500285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-33fcab26-dbe2-4277-9cd1-18539964d777" returned: 0 in 0.293s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:05 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-15dede62-c576-45a6-8f3d-a560de863fc3 tempest-VolumesActionsTest-1176500285 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:53:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-15dede62-c576-45a6-8f3d-a560de863fc3 tempest-VolumesActionsTest-1176500285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:53:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-15dede62-c576-45a6-8f3d-a560de863fc3 tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5805d35-af0f-481e-a320-1424ebf849f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33fcab26-dbe2-4277-9cd1-18539964d777', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-15dede62-c576-45a6-8f3d-a560de863fc3 tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5abe31f3-1793-4d48-8081-c27ce3256bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:05 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-15dede62-c576-45a6-8f3d-a560de863fc3 tempest-VolumesActionsTest-1176500285 None] Volume volume-33fcab26-dbe2-4277-9cd1-18539964d777 (33fcab26-dbe2-4277-9cd1-18539964d777): created successfully Aug 11 04:53:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-15dede62-c576-45a6-8f3d-a560de863fc3 tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5abe31f3-1793-4d48-8081-c27ce3256bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-15dede62-c576-45a6-8f3d-a560de863fc3 tempest-VolumesActionsTest-1176500285 None] Flow 'volume_create_manager' (7419a8fb-7714-4d1e-9976-7bdffe2d0beb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:53:05 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-15dede62-c576-45a6-8f3d-a560de863fc3 tempest-VolumesActionsTest-1176500285 None] Created volume successfully. Aug 11 04:53:05 devstack sudo[112285]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8cc6649f-d0db-4e15-b225-27c12f124cd2 tempest-TestStampPattern-1401503402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a.d124a861-f391-404a-b00d-6d293d93dc6c" returned: 0 in 0.367s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8cc6649f-d0db-4e15-b225-27c12f124cd2 tempest-TestStampPattern-1401503402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a.d124a861-f391-404a-b00d-6d293d93dc6c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:05 devstack sudo[112291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a.d124a861-f391-404a-b00d-6d293d93dc6c Aug 11 04:53:05 devstack sudo[112291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:05 devstack sudo[112291]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8cc6649f-d0db-4e15-b225-27c12f124cd2 tempest-TestStampPattern-1401503402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a.d124a861-f391-404a-b00d-6d293d93dc6c" returned: 0 in 0.252s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:05 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8cc6649f-d0db-4e15-b225-27c12f124cd2 tempest-TestStampPattern-1401503402 None] Lock "cinder-quobyte-d124a861-f391-404a-b00d-6d293d93dc6c" released by "_delete_snapshot" :: held 1.787s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:53:05 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8cc6649f-d0db-4e15-b225-27c12f124cd2 tempest-TestStampPattern-1401503402 None] Lock "cinder-quobyte-c7882da0-8442-4172-9cbc-fff1eb23344a" released by "delete_snapshot" :: held 1.819s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:53:06 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-8cc6649f-d0db-4e15-b225-27c12f124cd2 tempest-TestStampPattern-1401503402 None] Created reservations ['aed2393b-5b59-460a-9cd7-57c6e431ad0f', '9dbcacf4-9494-4ca1-b1ee-9318f24d3629', '1455eae9-08e1-4f90-bc51-051ccc2d756b', 'f713c6a7-e628-46b6-839d-84738a40d6b8'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:53:06 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-8cc6649f-d0db-4e15-b225-27c12f124cd2 tempest-TestStampPattern-1401503402 None] Delete snapshot completed successfully. Aug 11 04:53:06 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8cc6649f-d0db-4e15-b225-27c12f124cd2 tempest-TestStampPattern-1401503402 None] Lock "cinder-d124a861-f391-404a-b00d-6d293d93dc6c-delete_snapshot" released by "delete_snapshot" :: held 2.008s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:53:06 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-dd8760c4-5b4a-4c0a-a1de-25beeec7af46 tempest-VolumesActionsTest-1176500285 None] Acquiring lock "cinder-33fcab26-dbe2-4277-9cd1-18539964d777" by "attach_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:53:06 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-dd8760c4-5b4a-4c0a-a1de-25beeec7af46 tempest-VolumesActionsTest-1176500285 None] Lock "cinder-33fcab26-dbe2-4277-9cd1-18539964d777" acquired by "attach_volume" :: waited 0.024s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:53:06 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-dd8760c4-5b4a-4c0a-a1de-25beeec7af46 tempest-VolumesActionsTest-1176500285 None] Attaching volume 33fcab26-dbe2-4277-9cd1-18539964d777 to instance c786cc25-c6f3-44d7-837e-9c0bfca7be29 at mountpoint /dev/vdb on host None. Aug 11 04:53:06 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-dd8760c4-5b4a-4c0a-a1de-25beeec7af46 tempest-VolumesActionsTest-1176500285 None] Attach volume completed successfully. Aug 11 04:53:06 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-dd8760c4-5b4a-4c0a-a1de-25beeec7af46 tempest-VolumesActionsTest-1176500285 None] Lock "cinder-33fcab26-dbe2-4277-9cd1-18539964d777" released by "attach_volume" :: held 0.087s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:53:07 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-9379edf7-f1d1-4c44-ad73-6a49d2da3dd8 tempest-VolumesActionsTest-964545261 None] Terminate volume connection completed successfully. Aug 11 04:53:07 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9379edf7-f1d1-4c44-ad73-6a49d2da3dd8 tempest-VolumesActionsTest-964545261 None] Acquiring lock "cinder-33fcab26-dbe2-4277-9cd1-18539964d777-detach_volume" by "detach_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:53:07 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9379edf7-f1d1-4c44-ad73-6a49d2da3dd8 tempest-VolumesActionsTest-964545261 None] Lock "cinder-33fcab26-dbe2-4277-9cd1-18539964d777-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:53:07 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-9379edf7-f1d1-4c44-ad73-6a49d2da3dd8 tempest-VolumesActionsTest-964545261 None] Detaching volume 33fcab26-dbe2-4277-9cd1-18539964d777 from instance c786cc25-c6f3-44d7-837e-9c0bfca7be29. Aug 11 04:53:07 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-9379edf7-f1d1-4c44-ad73-6a49d2da3dd8 tempest-VolumesActionsTest-964545261 None] Detach volume completed successfully. Aug 11 04:53:07 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9379edf7-f1d1-4c44-ad73-6a49d2da3dd8 tempest-VolumesActionsTest-964545261 None] Lock "cinder-33fcab26-dbe2-4277-9cd1-18539964d777-detach_volume" released by "detach_volume" :: held 0.176s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:53:07 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9d4d86f2-118d-4bb5-803a-ffb2b8169a40 tempest-VolumesActionsTest-1176500285 None] Acquiring lock "cinder-33fcab26-dbe2-4277-9cd1-18539964d777-detach_volume" by "detach_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:53:07 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9d4d86f2-118d-4bb5-803a-ffb2b8169a40 tempest-VolumesActionsTest-1176500285 None] Lock "cinder-33fcab26-dbe2-4277-9cd1-18539964d777-detach_volume" acquired by "detach_volume" :: waited 0.036s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:53:07 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-9d4d86f2-118d-4bb5-803a-ffb2b8169a40 tempest-VolumesActionsTest-1176500285 None] Volume detach called, but volume not attached. Aug 11 04:53:07 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9d4d86f2-118d-4bb5-803a-ffb2b8169a40 tempest-VolumesActionsTest-1176500285 None] Lock "cinder-33fcab26-dbe2-4277-9cd1-18539964d777-detach_volume" released by "detach_volume" :: held 0.025s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:53:08 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-49b60773-6ab4-4e34-b450-6f7ff9fc31f3 tempest-VolumesActionsTest-1176500285 None] Acquiring lock "cinder-33fcab26-dbe2-4277-9cd1-18539964d777-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:53:08 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-49b60773-6ab4-4e34-b450-6f7ff9fc31f3 tempest-VolumesActionsTest-1176500285 None] Lock "cinder-33fcab26-dbe2-4277-9cd1-18539964d777-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:53:08 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-49b60773-6ab4-4e34-b450-6f7ff9fc31f3 tempest-VolumesActionsTest-1176500285 None] Acquiring lock "cinder-quobyte-33fcab26-dbe2-4277-9cd1-18539964d777" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:53:08 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-49b60773-6ab4-4e34-b450-6f7ff9fc31f3 tempest-VolumesActionsTest-1176500285 None] Lock "cinder-quobyte-33fcab26-dbe2-4277-9cd1-18539964d777" acquired by "delete_volume" :: waited 0.021s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:53:08 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0752d7a-a642-4b8d-8cf3-7a5588628ef6]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:53:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-49b60773-6ab4-4e34-b450-6f7ff9fc31f3 tempest-VolumesActionsTest-1176500285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-33fcab26-dbe2-4277-9cd1-18539964d777 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:08 devstack sudo[112321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-33fcab26-dbe2-4277-9cd1-18539964d777 Aug 11 04:53:08 devstack sudo[112321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:09 devstack sudo[112321]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-49b60773-6ab4-4e34-b450-6f7ff9fc31f3 tempest-VolumesActionsTest-1176500285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-33fcab26-dbe2-4277-9cd1-18539964d777" returned: 0 in 0.527s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-49b60773-6ab4-4e34-b450-6f7ff9fc31f3 tempest-VolumesActionsTest-1176500285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-33fcab26-dbe2-4277-9cd1-18539964d777 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:09 devstack sudo[112328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-33fcab26-dbe2-4277-9cd1-18539964d777 Aug 11 04:53:09 devstack sudo[112328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:09 devstack sudo[112328]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-49b60773-6ab4-4e34-b450-6f7ff9fc31f3 tempest-VolumesActionsTest-1176500285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-33fcab26-dbe2-4277-9cd1-18539964d777" returned: 0 in 0.353s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:09 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-49b60773-6ab4-4e34-b450-6f7ff9fc31f3 tempest-VolumesActionsTest-1176500285 None] Lock "cinder-quobyte-33fcab26-dbe2-4277-9cd1-18539964d777" released by "delete_volume" :: held 0.976s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:53:09 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-49b60773-6ab4-4e34-b450-6f7ff9fc31f3 tempest-VolumesActionsTest-1176500285 None] Created reservations ['fc9c3086-8213-4db8-b58f-a225b3c2fee1', 'af2185c9-2c3a-4583-b998-05dd1a1a3053', '3656febe-9f63-4468-af27-d54a41ba2fc1', '4a207b16-4dca-4efc-a656-cddb3f6676f4'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:53:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-49b60773-6ab4-4e34-b450-6f7ff9fc31f3 tempest-VolumesActionsTest-1176500285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:53:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-49b60773-6ab4-4e34-b450-6f7ff9fc31f3 tempest-VolumesActionsTest-1176500285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:53:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-49b60773-6ab4-4e34-b450-6f7ff9fc31f3 tempest-VolumesActionsTest-1176500285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:53:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-49b60773-6ab4-4e34-b450-6f7ff9fc31f3 tempest-VolumesActionsTest-1176500285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:53:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-49b60773-6ab4-4e34-b450-6f7ff9fc31f3 tempest-VolumesActionsTest-1176500285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:53:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-49b60773-6ab4-4e34-b450-6f7ff9fc31f3 tempest-VolumesActionsTest-1176500285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:09 devstack sudo[112333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:53:09 devstack sudo[112333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:10 devstack sudo[112333]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-49b60773-6ab4-4e34-b450-6f7ff9fc31f3 tempest-VolumesActionsTest-1176500285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.283s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:10 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-49b60773-6ab4-4e34-b450-6f7ff9fc31f3 tempest-VolumesActionsTest-1176500285 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:53:10 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-49b60773-6ab4-4e34-b450-6f7ff9fc31f3 tempest-VolumesActionsTest-1176500285 None] Deleted volume successfully. Aug 11 04:53:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-49b60773-6ab4-4e34-b450-6f7ff9fc31f3 tempest-VolumesActionsTest-1176500285 None] Lock "cinder-33fcab26-dbe2-4277-9cd1-18539964d777-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:53:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ccb31dab-f04c-4a77-8baf-255fba1f39ab tempest-TestStampPattern-1401503402 None] Acquiring lock "cinder-c7882da0-8442-4172-9cbc-fff1eb23344a-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:53:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ccb31dab-f04c-4a77-8baf-255fba1f39ab tempest-TestStampPattern-1401503402 None] Lock "cinder-c7882da0-8442-4172-9cbc-fff1eb23344a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:53:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ccb31dab-f04c-4a77-8baf-255fba1f39ab tempest-TestStampPattern-1401503402 None] Acquiring lock "cinder-quobyte-c7882da0-8442-4172-9cbc-fff1eb23344a" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:53:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ccb31dab-f04c-4a77-8baf-255fba1f39ab tempest-TestStampPattern-1401503402 None] Lock "cinder-quobyte-c7882da0-8442-4172-9cbc-fff1eb23344a" acquired by "delete_volume" :: waited 0.023s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:53:10 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5206cc-c8d6-485a-be05-15bddd813b5b]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:53:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ccb31dab-f04c-4a77-8baf-255fba1f39ab tempest-TestStampPattern-1401503402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:10 devstack sudo[112336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a Aug 11 04:53:10 devstack sudo[112336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:11 devstack sudo[112336]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ccb31dab-f04c-4a77-8baf-255fba1f39ab tempest-TestStampPattern-1401503402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a" returned: 0 in 0.475s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ccb31dab-f04c-4a77-8baf-255fba1f39ab tempest-TestStampPattern-1401503402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:11 devstack sudo[112342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a Aug 11 04:53:11 devstack sudo[112342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:11 devstack sudo[112342]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ccb31dab-f04c-4a77-8baf-255fba1f39ab tempest-TestStampPattern-1401503402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c7882da0-8442-4172-9cbc-fff1eb23344a" returned: 0 in 0.254s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ccb31dab-f04c-4a77-8baf-255fba1f39ab tempest-TestStampPattern-1401503402 None] Lock "cinder-quobyte-c7882da0-8442-4172-9cbc-fff1eb23344a" released by "delete_volume" :: held 0.797s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:53:11 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-ccb31dab-f04c-4a77-8baf-255fba1f39ab tempest-TestStampPattern-1401503402 None] Created reservations ['a05135af-e1ca-410f-9061-58594437a47a', '9209fc8c-5835-48f4-9265-ff7b3d52ad3b', 'd765a2ef-0d6b-47b9-8c2f-f58dab84a060', '64513948-3838-439e-9386-b7a19035e7ed'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:53:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ccb31dab-f04c-4a77-8baf-255fba1f39ab tempest-TestStampPattern-1401503402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:53:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ccb31dab-f04c-4a77-8baf-255fba1f39ab tempest-TestStampPattern-1401503402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:53:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ccb31dab-f04c-4a77-8baf-255fba1f39ab tempest-TestStampPattern-1401503402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:53:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ccb31dab-f04c-4a77-8baf-255fba1f39ab tempest-TestStampPattern-1401503402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:53:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ccb31dab-f04c-4a77-8baf-255fba1f39ab tempest-TestStampPattern-1401503402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:53:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ccb31dab-f04c-4a77-8baf-255fba1f39ab tempest-TestStampPattern-1401503402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:11 devstack sudo[112363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:53:11 devstack sudo[112363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:11 devstack sudo[112363]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ccb31dab-f04c-4a77-8baf-255fba1f39ab tempest-TestStampPattern-1401503402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.267s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:11 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-ccb31dab-f04c-4a77-8baf-255fba1f39ab tempest-TestStampPattern-1401503402 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:53:11 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-ccb31dab-f04c-4a77-8baf-255fba1f39ab tempest-TestStampPattern-1401503402 None] Deleted volume successfully. Aug 11 04:53:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ccb31dab-f04c-4a77-8baf-255fba1f39ab tempest-TestStampPattern-1401503402 None] Lock "cinder-c7882da0-8442-4172-9cbc-fff1eb23344a-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:53:14 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b728818-0aaf-4ba0-b96c-bf9c21b4de92 tempest-VolumesActionsTest-1176500285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:53:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5b728818-0aaf-4ba0-b96c-bf9c21b4de92 tempest-VolumesActionsTest-1176500285 None] Flow 'volume_create_manager' (2311e59b-0aea-4e1d-847f-11bb36670979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:53:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5b728818-0aaf-4ba0-b96c-bf9c21b4de92 tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (005987b4-4eda-4bd0-9017-2ea981b2928d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5b728818-0aaf-4ba0-b96c-bf9c21b4de92 tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (005987b4-4eda-4bd0-9017-2ea981b2928d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1701197046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2333f55-995c-4991-ac4a-4f4791a068ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a9b228e1b4d444f8fb7b7d54d8ff281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:53:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:53:14Z,use_quota=True,user_id='58888af2ad8e4cfb861a6bdac6ca640d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5b728818-0aaf-4ba0-b96c-bf9c21b4de92 tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8711448-a7b7-4825-b5fe-03eb5ba2c72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5b728818-0aaf-4ba0-b96c-bf9c21b4de92 tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8711448-a7b7-4825-b5fe-03eb5ba2c72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5b728818-0aaf-4ba0-b96c-bf9c21b4de92 tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11055c5c-7893-481a-8be0-e55d99848a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5b728818-0aaf-4ba0-b96c-bf9c21b4de92 tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11055c5c-7893-481a-8be0-e55d99848a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2333f55-995c-4991-ac4a-4f4791a068ad', 'volume_name': 'volume-a2333f55-995c-4991-ac4a-4f4791a068ad', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5b728818-0aaf-4ba0-b96c-bf9c21b4de92 tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c397011-7110-4257-ac88-0ba0aa0d108d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5b728818-0aaf-4ba0-b96c-bf9c21b4de92 tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c397011-7110-4257-ac88-0ba0aa0d108d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5b728818-0aaf-4ba0-b96c-bf9c21b4de92 tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08252f5f-1165-45a5-87df-bdf711bb06d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:14 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-5b728818-0aaf-4ba0-b96c-bf9c21b4de92 tempest-VolumesActionsTest-1176500285 None] Volume a2333f55-995c-4991-ac4a-4f4791a068ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2333f55-995c-4991-ac4a-4f4791a068ad', 'volume_size': 1} Aug 11 04:53:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5b728818-0aaf-4ba0-b96c-bf9c21b4de92 tempest-VolumesActionsTest-1176500285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:53:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5b728818-0aaf-4ba0-b96c-bf9c21b4de92 tempest-VolumesActionsTest-1176500285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:53:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-5b728818-0aaf-4ba0-b96c-bf9c21b4de92 tempest-VolumesActionsTest-1176500285 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1701197046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2333f55-995c-4991-ac4a-4f4791a068ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a9b228e1b4d444f8fb7b7d54d8ff281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:53:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:53:14Z,use_quota=True,user_id='58888af2ad8e4cfb861a6bdac6ca640d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:53:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-5b728818-0aaf-4ba0-b96c-bf9c21b4de92 tempest-VolumesActionsTest-1176500285 None] Creating volume a2333f55-995c-4991-ac4a-4f4791a068ad {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:53:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5b728818-0aaf-4ba0-b96c-bf9c21b4de92 tempest-VolumesActionsTest-1176500285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:53:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5b728818-0aaf-4ba0-b96c-bf9c21b4de92 tempest-VolumesActionsTest-1176500285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:53:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-5b728818-0aaf-4ba0-b96c-bf9c21b4de92 tempest-VolumesActionsTest-1176500285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:53:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-5b728818-0aaf-4ba0-b96c-bf9c21b4de92 tempest-VolumesActionsTest-1176500285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:53:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5b728818-0aaf-4ba0-b96c-bf9c21b4de92 tempest-VolumesActionsTest-1176500285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:53:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-5b728818-0aaf-4ba0-b96c-bf9c21b4de92 tempest-VolumesActionsTest-1176500285 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:53:14 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-5b728818-0aaf-4ba0-b96c-bf9c21b4de92 tempest-VolumesActionsTest-1176500285 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:53:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5b728818-0aaf-4ba0-b96c-bf9c21b4de92 tempest-VolumesActionsTest-1176500285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a2333f55-995c-4991-ac4a-4f4791a068ad 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:14 devstack sudo[112374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a2333f55-995c-4991-ac4a-4f4791a068ad 1073741824 Aug 11 04:53:14 devstack sudo[112374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:14 devstack sudo[112374]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5b728818-0aaf-4ba0-b96c-bf9c21b4de92 tempest-VolumesActionsTest-1176500285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a2333f55-995c-4991-ac4a-4f4791a068ad 1073741824" returned: 0 in 0.431s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5b728818-0aaf-4ba0-b96c-bf9c21b4de92 tempest-VolumesActionsTest-1176500285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a2333f55-995c-4991-ac4a-4f4791a068ad {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:14 devstack sudo[112380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a2333f55-995c-4991-ac4a-4f4791a068ad Aug 11 04:53:14 devstack sudo[112380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:15 devstack sudo[112380]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5b728818-0aaf-4ba0-b96c-bf9c21b4de92 tempest-VolumesActionsTest-1176500285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a2333f55-995c-4991-ac4a-4f4791a068ad" returned: 0 in 0.249s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-5b728818-0aaf-4ba0-b96c-bf9c21b4de92 tempest-VolumesActionsTest-1176500285 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:53:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5b728818-0aaf-4ba0-b96c-bf9c21b4de92 tempest-VolumesActionsTest-1176500285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:53:15 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5b728818-0aaf-4ba0-b96c-bf9c21b4de92 tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08252f5f-1165-45a5-87df-bdf711bb06d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2333f55-995c-4991-ac4a-4f4791a068ad', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:15 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5b728818-0aaf-4ba0-b96c-bf9c21b4de92 tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cf409af-adf0-42fa-9773-8f9c7fb44403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:15 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-5b728818-0aaf-4ba0-b96c-bf9c21b4de92 tempest-VolumesActionsTest-1176500285 None] Volume volume-a2333f55-995c-4991-ac4a-4f4791a068ad (a2333f55-995c-4991-ac4a-4f4791a068ad): created successfully Aug 11 04:53:15 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5b728818-0aaf-4ba0-b96c-bf9c21b4de92 tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cf409af-adf0-42fa-9773-8f9c7fb44403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:15 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5b728818-0aaf-4ba0-b96c-bf9c21b4de92 tempest-VolumesActionsTest-1176500285 None] Flow 'volume_create_manager' (2311e59b-0aea-4e1d-847f-11bb36670979) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:53:15 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-5b728818-0aaf-4ba0-b96c-bf9c21b4de92 tempest-VolumesActionsTest-1176500285 None] Created volume successfully. Aug 11 04:53:15 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-93fc9fff-37f6-427f-b207-8cf2c62cb80d tempest-VolumesActionsTest-964545261 None] Acquiring lock "cinder-a2333f55-995c-4991-ac4a-4f4791a068ad-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:53:15 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-93fc9fff-37f6-427f-b207-8cf2c62cb80d tempest-VolumesActionsTest-964545261 None] Lock "cinder-a2333f55-995c-4991-ac4a-4f4791a068ad-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:53:15 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-93fc9fff-37f6-427f-b207-8cf2c62cb80d tempest-VolumesActionsTest-964545261 None] Acquiring lock "cinder-quobyte-a2333f55-995c-4991-ac4a-4f4791a068ad" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:53:15 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-93fc9fff-37f6-427f-b207-8cf2c62cb80d tempest-VolumesActionsTest-964545261 None] Lock "cinder-quobyte-a2333f55-995c-4991-ac4a-4f4791a068ad" acquired by "delete_volume" :: waited 0.038s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:53:15 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9ac8f4-42f2-47a6-afec-5b380da48449]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:53:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-93fc9fff-37f6-427f-b207-8cf2c62cb80d tempest-VolumesActionsTest-964545261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a2333f55-995c-4991-ac4a-4f4791a068ad {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:15 devstack sudo[112383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a2333f55-995c-4991-ac4a-4f4791a068ad Aug 11 04:53:15 devstack sudo[112383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:15 devstack sudo[112383]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-93fc9fff-37f6-427f-b207-8cf2c62cb80d tempest-VolumesActionsTest-964545261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a2333f55-995c-4991-ac4a-4f4791a068ad" returned: 0 in 0.416s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-93fc9fff-37f6-427f-b207-8cf2c62cb80d tempest-VolumesActionsTest-964545261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a2333f55-995c-4991-ac4a-4f4791a068ad {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:15 devstack sudo[112389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a2333f55-995c-4991-ac4a-4f4791a068ad Aug 11 04:53:15 devstack sudo[112389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:16 devstack sudo[112389]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-93fc9fff-37f6-427f-b207-8cf2c62cb80d tempest-VolumesActionsTest-964545261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a2333f55-995c-4991-ac4a-4f4791a068ad" returned: 0 in 0.284s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:16 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-93fc9fff-37f6-427f-b207-8cf2c62cb80d tempest-VolumesActionsTest-964545261 None] Lock "cinder-quobyte-a2333f55-995c-4991-ac4a-4f4791a068ad" released by "delete_volume" :: held 0.750s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:53:16 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-93fc9fff-37f6-427f-b207-8cf2c62cb80d tempest-VolumesActionsTest-964545261 None] Created reservations ['c3659fb2-798b-4367-85bb-97afd7f9afa8', 'e71fb5a3-6fb7-42b6-a3be-dac7db2f249d', '0e3b67b3-f5ed-47bf-a631-0a9d17b8b41a', '80600a2c-ffde-4e4a-83b9-044e05e86813'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:53:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-93fc9fff-37f6-427f-b207-8cf2c62cb80d tempest-VolumesActionsTest-964545261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:53:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-93fc9fff-37f6-427f-b207-8cf2c62cb80d tempest-VolumesActionsTest-964545261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:53:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-93fc9fff-37f6-427f-b207-8cf2c62cb80d tempest-VolumesActionsTest-964545261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:53:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-93fc9fff-37f6-427f-b207-8cf2c62cb80d tempest-VolumesActionsTest-964545261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:53:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-93fc9fff-37f6-427f-b207-8cf2c62cb80d tempest-VolumesActionsTest-964545261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:53:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-93fc9fff-37f6-427f-b207-8cf2c62cb80d tempest-VolumesActionsTest-964545261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:16 devstack sudo[112393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:53:16 devstack sudo[112393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:16 devstack sudo[112393]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-93fc9fff-37f6-427f-b207-8cf2c62cb80d tempest-VolumesActionsTest-964545261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.292s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:16 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-93fc9fff-37f6-427f-b207-8cf2c62cb80d tempest-VolumesActionsTest-964545261 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:53:16 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-93fc9fff-37f6-427f-b207-8cf2c62cb80d tempest-VolumesActionsTest-964545261 None] Deleted volume successfully. Aug 11 04:53:16 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-93fc9fff-37f6-427f-b207-8cf2c62cb80d tempest-VolumesActionsTest-964545261 None] Lock "cinder-a2333f55-995c-4991-ac4a-4f4791a068ad-delete_volume" released by "delete_volume" :: held 1.290s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:53:17 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-db84057b-1f7b-497e-97f8-c6a29cc1b4f1 tempest-VolumesActionsTest-1176500285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:53:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-db84057b-1f7b-497e-97f8-c6a29cc1b4f1 tempest-VolumesActionsTest-1176500285 None] Flow 'volume_create_manager' (f7cb49f7-cc0b-46f9-aa46-8f6358c8db60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:53:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-db84057b-1f7b-497e-97f8-c6a29cc1b4f1 tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1283c52-481c-40b8-b6f7-4bbf810b788b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-db84057b-1f7b-497e-97f8-c6a29cc1b4f1 tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1283c52-481c-40b8-b6f7-4bbf810b788b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:53:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1446259180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e54a5655-e865-42d3-854f-dea5b16cd493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a9b228e1b4d444f8fb7b7d54d8ff281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:53:17Z,use_quota=True,user_id='58888af2ad8e4cfb861a6bdac6ca640d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-db84057b-1f7b-497e-97f8-c6a29cc1b4f1 tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (036df26e-8e43-4993-a049-caa231becc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-db84057b-1f7b-497e-97f8-c6a29cc1b4f1 tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (036df26e-8e43-4993-a049-caa231becc33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-db84057b-1f7b-497e-97f8-c6a29cc1b4f1 tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e992e205-9f83-4e1b-a810-db83e83543fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-db84057b-1f7b-497e-97f8-c6a29cc1b4f1 tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e992e205-9f83-4e1b-a810-db83e83543fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e54a5655-e865-42d3-854f-dea5b16cd493', 'volume_name': 'volume-e54a5655-e865-42d3-854f-dea5b16cd493', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-db84057b-1f7b-497e-97f8-c6a29cc1b4f1 tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc48e21e-ccf6-4df3-bb7c-2e630d086b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-db84057b-1f7b-497e-97f8-c6a29cc1b4f1 tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc48e21e-ccf6-4df3-bb7c-2e630d086b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-db84057b-1f7b-497e-97f8-c6a29cc1b4f1 tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffa08bc1-73c5-4525-b544-0f5487ea8dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:17 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-db84057b-1f7b-497e-97f8-c6a29cc1b4f1 tempest-VolumesActionsTest-1176500285 None] Volume e54a5655-e865-42d3-854f-dea5b16cd493: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e54a5655-e865-42d3-854f-dea5b16cd493', 'volume_size': 1} Aug 11 04:53:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-db84057b-1f7b-497e-97f8-c6a29cc1b4f1 tempest-VolumesActionsTest-1176500285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:53:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-db84057b-1f7b-497e-97f8-c6a29cc1b4f1 tempest-VolumesActionsTest-1176500285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:53:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-db84057b-1f7b-497e-97f8-c6a29cc1b4f1 tempest-VolumesActionsTest-1176500285 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:53:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1446259180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e54a5655-e865-42d3-854f-dea5b16cd493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a9b228e1b4d444f8fb7b7d54d8ff281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:53:17Z,use_quota=True,user_id='58888af2ad8e4cfb861a6bdac6ca640d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:53:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-db84057b-1f7b-497e-97f8-c6a29cc1b4f1 tempest-VolumesActionsTest-1176500285 None] Creating volume e54a5655-e865-42d3-854f-dea5b16cd493 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:53:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-db84057b-1f7b-497e-97f8-c6a29cc1b4f1 tempest-VolumesActionsTest-1176500285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:53:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-db84057b-1f7b-497e-97f8-c6a29cc1b4f1 tempest-VolumesActionsTest-1176500285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:53:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-db84057b-1f7b-497e-97f8-c6a29cc1b4f1 tempest-VolumesActionsTest-1176500285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:53:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-db84057b-1f7b-497e-97f8-c6a29cc1b4f1 tempest-VolumesActionsTest-1176500285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:53:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-db84057b-1f7b-497e-97f8-c6a29cc1b4f1 tempest-VolumesActionsTest-1176500285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:53:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-db84057b-1f7b-497e-97f8-c6a29cc1b4f1 tempest-VolumesActionsTest-1176500285 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:53:17 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-db84057b-1f7b-497e-97f8-c6a29cc1b4f1 tempest-VolumesActionsTest-1176500285 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:53:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-db84057b-1f7b-497e-97f8-c6a29cc1b4f1 tempest-VolumesActionsTest-1176500285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e54a5655-e865-42d3-854f-dea5b16cd493 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:17 devstack sudo[112396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e54a5655-e865-42d3-854f-dea5b16cd493 1073741824 Aug 11 04:53:17 devstack sudo[112396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:17 devstack sudo[112396]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-db84057b-1f7b-497e-97f8-c6a29cc1b4f1 tempest-VolumesActionsTest-1176500285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e54a5655-e865-42d3-854f-dea5b16cd493 1073741824" returned: 0 in 0.418s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-db84057b-1f7b-497e-97f8-c6a29cc1b4f1 tempest-VolumesActionsTest-1176500285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e54a5655-e865-42d3-854f-dea5b16cd493 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:17 devstack sudo[112401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e54a5655-e865-42d3-854f-dea5b16cd493 Aug 11 04:53:17 devstack sudo[112401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:17 devstack sudo[112401]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-db84057b-1f7b-497e-97f8-c6a29cc1b4f1 tempest-VolumesActionsTest-1176500285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e54a5655-e865-42d3-854f-dea5b16cd493" returned: 0 in 0.251s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-db84057b-1f7b-497e-97f8-c6a29cc1b4f1 tempest-VolumesActionsTest-1176500285 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:53:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-db84057b-1f7b-497e-97f8-c6a29cc1b4f1 tempest-VolumesActionsTest-1176500285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:53:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-db84057b-1f7b-497e-97f8-c6a29cc1b4f1 tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffa08bc1-73c5-4525-b544-0f5487ea8dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e54a5655-e865-42d3-854f-dea5b16cd493', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-db84057b-1f7b-497e-97f8-c6a29cc1b4f1 tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (550f1fea-8501-48e7-9554-99930881b2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:17 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-db84057b-1f7b-497e-97f8-c6a29cc1b4f1 tempest-VolumesActionsTest-1176500285 None] Volume volume-e54a5655-e865-42d3-854f-dea5b16cd493 (e54a5655-e865-42d3-854f-dea5b16cd493): created successfully Aug 11 04:53:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-db84057b-1f7b-497e-97f8-c6a29cc1b4f1 tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (550f1fea-8501-48e7-9554-99930881b2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-db84057b-1f7b-497e-97f8-c6a29cc1b4f1 tempest-VolumesActionsTest-1176500285 None] Flow 'volume_create_manager' (f7cb49f7-cc0b-46f9-aa46-8f6358c8db60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:53:18 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-db84057b-1f7b-497e-97f8-c6a29cc1b4f1 tempest-VolumesActionsTest-1176500285 None] Created volume successfully. Aug 11 04:53:18 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4160ceb1-01cd-4b37-93e1-b19602739e27 tempest-VolumesActionsTest-964545261 None] Acquiring lock "cinder-e54a5655-e865-42d3-854f-dea5b16cd493-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:53:18 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4160ceb1-01cd-4b37-93e1-b19602739e27 tempest-VolumesActionsTest-964545261 None] Lock "cinder-e54a5655-e865-42d3-854f-dea5b16cd493-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:53:18 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4160ceb1-01cd-4b37-93e1-b19602739e27 tempest-VolumesActionsTest-964545261 None] Acquiring lock "cinder-quobyte-e54a5655-e865-42d3-854f-dea5b16cd493" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:53:18 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4160ceb1-01cd-4b37-93e1-b19602739e27 tempest-VolumesActionsTest-964545261 None] Lock "cinder-quobyte-e54a5655-e865-42d3-854f-dea5b16cd493" acquired by "delete_volume" :: waited 0.018s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:53:18 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e212997-5e9f-4c80-b654-b26e498270fe]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:53:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4160ceb1-01cd-4b37-93e1-b19602739e27 tempest-VolumesActionsTest-964545261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e54a5655-e865-42d3-854f-dea5b16cd493 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:18 devstack sudo[112404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e54a5655-e865-42d3-854f-dea5b16cd493 Aug 11 04:53:18 devstack sudo[112404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:18 devstack sudo[112404]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4160ceb1-01cd-4b37-93e1-b19602739e27 tempest-VolumesActionsTest-964545261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e54a5655-e865-42d3-854f-dea5b16cd493" returned: 0 in 0.396s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4160ceb1-01cd-4b37-93e1-b19602739e27 tempest-VolumesActionsTest-964545261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e54a5655-e865-42d3-854f-dea5b16cd493 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:18 devstack sudo[112424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e54a5655-e865-42d3-854f-dea5b16cd493 Aug 11 04:53:18 devstack sudo[112424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:19 devstack sudo[112424]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4160ceb1-01cd-4b37-93e1-b19602739e27 tempest-VolumesActionsTest-964545261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e54a5655-e865-42d3-854f-dea5b16cd493" returned: 0 in 0.277s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4160ceb1-01cd-4b37-93e1-b19602739e27 tempest-VolumesActionsTest-964545261 None] Lock "cinder-quobyte-e54a5655-e865-42d3-854f-dea5b16cd493" released by "delete_volume" :: held 0.716s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:53:19 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-4160ceb1-01cd-4b37-93e1-b19602739e27 tempest-VolumesActionsTest-964545261 None] Created reservations ['13468a95-0ece-4dfd-acc1-516afa63da76', '5cf86fbe-63c4-47f6-b95d-19c3be8adcaf', 'b21962bf-3185-4a9a-9beb-5f63cc23a842', '260e554a-8fec-4c11-aa8c-9a3b2a5978a8'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:53:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4160ceb1-01cd-4b37-93e1-b19602739e27 tempest-VolumesActionsTest-964545261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:53:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4160ceb1-01cd-4b37-93e1-b19602739e27 tempest-VolumesActionsTest-964545261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:53:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4160ceb1-01cd-4b37-93e1-b19602739e27 tempest-VolumesActionsTest-964545261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:53:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4160ceb1-01cd-4b37-93e1-b19602739e27 tempest-VolumesActionsTest-964545261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:53:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4160ceb1-01cd-4b37-93e1-b19602739e27 tempest-VolumesActionsTest-964545261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:53:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4160ceb1-01cd-4b37-93e1-b19602739e27 tempest-VolumesActionsTest-964545261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:19 devstack sudo[112449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:53:19 devstack sudo[112449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:19 devstack sudo[112449]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4160ceb1-01cd-4b37-93e1-b19602739e27 tempest-VolumesActionsTest-964545261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.256s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:19 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-4160ceb1-01cd-4b37-93e1-b19602739e27 tempest-VolumesActionsTest-964545261 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:53:19 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-4160ceb1-01cd-4b37-93e1-b19602739e27 tempest-VolumesActionsTest-964545261 None] Deleted volume successfully. Aug 11 04:53:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4160ceb1-01cd-4b37-93e1-b19602739e27 tempest-VolumesActionsTest-964545261 None] Lock "cinder-e54a5655-e865-42d3-854f-dea5b16cd493-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:53:20 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-c08735d7-43cc-4aaf-9d68-6778311b055e tempest-VolumesActionsTest-1176500285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:53:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c08735d7-43cc-4aaf-9d68-6778311b055e tempest-VolumesActionsTest-1176500285 None] Flow 'volume_create_manager' (f7a1e29c-7ac3-4bc9-ab7e-f48305417107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:53:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c08735d7-43cc-4aaf-9d68-6778311b055e tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67b219f3-fac0-4a5f-9192-9be9244d7ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c08735d7-43cc-4aaf-9d68-6778311b055e tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67b219f3-fac0-4a5f-9192-9be9244d7ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:53:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-24445562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e81d6f7-54f9-4339-b756-4344714720c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a9b228e1b4d444f8fb7b7d54d8ff281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:53:20Z,use_quota=True,user_id='58888af2ad8e4cfb861a6bdac6ca640d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c08735d7-43cc-4aaf-9d68-6778311b055e tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adf1dba2-f943-4ad8-8e96-f41b6c7bf03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c08735d7-43cc-4aaf-9d68-6778311b055e tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adf1dba2-f943-4ad8-8e96-f41b6c7bf03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c08735d7-43cc-4aaf-9d68-6778311b055e tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0ca2ec6-2912-4f5a-8f2b-497fdb54f973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c08735d7-43cc-4aaf-9d68-6778311b055e tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0ca2ec6-2912-4f5a-8f2b-497fdb54f973) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e81d6f7-54f9-4339-b756-4344714720c2', 'volume_name': 'volume-8e81d6f7-54f9-4339-b756-4344714720c2', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c08735d7-43cc-4aaf-9d68-6778311b055e tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14629d74-0d7a-49cc-9899-1afa6df5feb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c08735d7-43cc-4aaf-9d68-6778311b055e tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14629d74-0d7a-49cc-9899-1afa6df5feb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c08735d7-43cc-4aaf-9d68-6778311b055e tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28d62a11-3761-4c73-b26e-e9c58470df58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:20 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-c08735d7-43cc-4aaf-9d68-6778311b055e tempest-VolumesActionsTest-1176500285 None] Volume 8e81d6f7-54f9-4339-b756-4344714720c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e81d6f7-54f9-4339-b756-4344714720c2', 'volume_size': 1} Aug 11 04:53:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c08735d7-43cc-4aaf-9d68-6778311b055e tempest-VolumesActionsTest-1176500285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:53:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c08735d7-43cc-4aaf-9d68-6778311b055e tempest-VolumesActionsTest-1176500285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:53:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c08735d7-43cc-4aaf-9d68-6778311b055e tempest-VolumesActionsTest-1176500285 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:53:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-24445562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e81d6f7-54f9-4339-b756-4344714720c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a9b228e1b4d444f8fb7b7d54d8ff281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:53:20Z,use_quota=True,user_id='58888af2ad8e4cfb861a6bdac6ca640d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:53:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-c08735d7-43cc-4aaf-9d68-6778311b055e tempest-VolumesActionsTest-1176500285 None] Creating volume 8e81d6f7-54f9-4339-b756-4344714720c2 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:53:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c08735d7-43cc-4aaf-9d68-6778311b055e tempest-VolumesActionsTest-1176500285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:53:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c08735d7-43cc-4aaf-9d68-6778311b055e tempest-VolumesActionsTest-1176500285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:53:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c08735d7-43cc-4aaf-9d68-6778311b055e tempest-VolumesActionsTest-1176500285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:53:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c08735d7-43cc-4aaf-9d68-6778311b055e tempest-VolumesActionsTest-1176500285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:53:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c08735d7-43cc-4aaf-9d68-6778311b055e tempest-VolumesActionsTest-1176500285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:53:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c08735d7-43cc-4aaf-9d68-6778311b055e tempest-VolumesActionsTest-1176500285 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:53:20 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-c08735d7-43cc-4aaf-9d68-6778311b055e tempest-VolumesActionsTest-1176500285 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:53:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c08735d7-43cc-4aaf-9d68-6778311b055e tempest-VolumesActionsTest-1176500285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8e81d6f7-54f9-4339-b756-4344714720c2 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:20 devstack sudo[112452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8e81d6f7-54f9-4339-b756-4344714720c2 1073741824 Aug 11 04:53:20 devstack sudo[112452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:20 devstack sudo[112452]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c08735d7-43cc-4aaf-9d68-6778311b055e tempest-VolumesActionsTest-1176500285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8e81d6f7-54f9-4339-b756-4344714720c2 1073741824" returned: 0 in 0.471s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c08735d7-43cc-4aaf-9d68-6778311b055e tempest-VolumesActionsTest-1176500285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8e81d6f7-54f9-4339-b756-4344714720c2 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:20 devstack sudo[112458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8e81d6f7-54f9-4339-b756-4344714720c2 Aug 11 04:53:20 devstack sudo[112458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:20 devstack sudo[112458]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c08735d7-43cc-4aaf-9d68-6778311b055e tempest-VolumesActionsTest-1176500285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8e81d6f7-54f9-4339-b756-4344714720c2" returned: 0 in 0.241s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c08735d7-43cc-4aaf-9d68-6778311b055e tempest-VolumesActionsTest-1176500285 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:53:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c08735d7-43cc-4aaf-9d68-6778311b055e tempest-VolumesActionsTest-1176500285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:53:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c08735d7-43cc-4aaf-9d68-6778311b055e tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28d62a11-3761-4c73-b26e-e9c58470df58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e81d6f7-54f9-4339-b756-4344714720c2', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c08735d7-43cc-4aaf-9d68-6778311b055e tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f1353ac-ad37-4d05-b9a6-a92b86602520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:20 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-c08735d7-43cc-4aaf-9d68-6778311b055e tempest-VolumesActionsTest-1176500285 None] Volume volume-8e81d6f7-54f9-4339-b756-4344714720c2 (8e81d6f7-54f9-4339-b756-4344714720c2): created successfully Aug 11 04:53:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c08735d7-43cc-4aaf-9d68-6778311b055e tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f1353ac-ad37-4d05-b9a6-a92b86602520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c08735d7-43cc-4aaf-9d68-6778311b055e tempest-VolumesActionsTest-1176500285 None] Flow 'volume_create_manager' (f7a1e29c-7ac3-4bc9-ab7e-f48305417107) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:53:20 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-c08735d7-43cc-4aaf-9d68-6778311b055e tempest-VolumesActionsTest-1176500285 None] Created volume successfully. Aug 11 04:53:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9ad4b484-dc1d-4586-b9c6-79b3ea95825d tempest-VolumesActionsTest-964545261 None] Acquiring lock "cinder-8e81d6f7-54f9-4339-b756-4344714720c2-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:53:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9ad4b484-dc1d-4586-b9c6-79b3ea95825d tempest-VolumesActionsTest-964545261 None] Lock "cinder-8e81d6f7-54f9-4339-b756-4344714720c2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:53:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9ad4b484-dc1d-4586-b9c6-79b3ea95825d tempest-VolumesActionsTest-964545261 None] Acquiring lock "cinder-quobyte-8e81d6f7-54f9-4339-b756-4344714720c2" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:53:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9ad4b484-dc1d-4586-b9c6-79b3ea95825d tempest-VolumesActionsTest-964545261 None] Lock "cinder-quobyte-8e81d6f7-54f9-4339-b756-4344714720c2" acquired by "delete_volume" :: waited 0.017s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:53:21 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a96fcf8-547d-449c-9897-b280eaf915b3]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:53:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9ad4b484-dc1d-4586-b9c6-79b3ea95825d tempest-VolumesActionsTest-964545261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8e81d6f7-54f9-4339-b756-4344714720c2 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:21 devstack sudo[112461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8e81d6f7-54f9-4339-b756-4344714720c2 Aug 11 04:53:21 devstack sudo[112461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:21 devstack sudo[112461]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9ad4b484-dc1d-4586-b9c6-79b3ea95825d tempest-VolumesActionsTest-964545261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8e81d6f7-54f9-4339-b756-4344714720c2" returned: 0 in 0.405s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9ad4b484-dc1d-4586-b9c6-79b3ea95825d tempest-VolumesActionsTest-964545261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8e81d6f7-54f9-4339-b756-4344714720c2 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:21 devstack sudo[112466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8e81d6f7-54f9-4339-b756-4344714720c2 Aug 11 04:53:21 devstack sudo[112466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:21 devstack sudo[112466]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9ad4b484-dc1d-4586-b9c6-79b3ea95825d tempest-VolumesActionsTest-964545261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8e81d6f7-54f9-4339-b756-4344714720c2" returned: 0 in 0.262s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9ad4b484-dc1d-4586-b9c6-79b3ea95825d tempest-VolumesActionsTest-964545261 None] Lock "cinder-quobyte-8e81d6f7-54f9-4339-b756-4344714720c2" released by "delete_volume" :: held 0.738s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:53:22 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-9ad4b484-dc1d-4586-b9c6-79b3ea95825d tempest-VolumesActionsTest-964545261 None] Created reservations ['594d7b86-1a4a-4239-995d-46143f9910c0', 'b12fa28a-bac1-4fc1-a14e-033ecd492191', '07b85a72-ff1c-45cd-bf44-b34560d96102', '088240c6-c13b-49b8-b587-d8148f97adb9'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:53:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9ad4b484-dc1d-4586-b9c6-79b3ea95825d tempest-VolumesActionsTest-964545261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:53:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9ad4b484-dc1d-4586-b9c6-79b3ea95825d tempest-VolumesActionsTest-964545261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:53:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9ad4b484-dc1d-4586-b9c6-79b3ea95825d tempest-VolumesActionsTest-964545261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:53:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9ad4b484-dc1d-4586-b9c6-79b3ea95825d tempest-VolumesActionsTest-964545261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:53:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9ad4b484-dc1d-4586-b9c6-79b3ea95825d tempest-VolumesActionsTest-964545261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:53:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9ad4b484-dc1d-4586-b9c6-79b3ea95825d tempest-VolumesActionsTest-964545261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:22 devstack sudo[112470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:53:22 devstack sudo[112470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:22 devstack sudo[112470]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9ad4b484-dc1d-4586-b9c6-79b3ea95825d tempest-VolumesActionsTest-964545261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.268s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:22 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-9ad4b484-dc1d-4586-b9c6-79b3ea95825d tempest-VolumesActionsTest-964545261 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:53:22 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-9ad4b484-dc1d-4586-b9c6-79b3ea95825d tempest-VolumesActionsTest-964545261 None] Deleted volume successfully. Aug 11 04:53:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9ad4b484-dc1d-4586-b9c6-79b3ea95825d tempest-VolumesActionsTest-964545261 None] Lock "cinder-8e81d6f7-54f9-4339-b756-4344714720c2-delete_volume" released by "delete_volume" :: held 1.268s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:53:22 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-1884409c-04ba-4d71-bcbe-df8767b9d5f6 tempest-VolumesActionsTest-1176500285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:53:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1884409c-04ba-4d71-bcbe-df8767b9d5f6 tempest-VolumesActionsTest-1176500285 None] Flow 'volume_create_manager' (a5254f9a-1467-4e44-a884-096c26fe0b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:53:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1884409c-04ba-4d71-bcbe-df8767b9d5f6 tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbacf333-8204-482c-b595-3cc62dad2dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1884409c-04ba-4d71-bcbe-df8767b9d5f6 tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbacf333-8204-482c-b595-3cc62dad2dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-57158763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d12d3050-e570-4e95-a100-598525545d3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a9b228e1b4d444f8fb7b7d54d8ff281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:53:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:53:23Z,use_quota=True,user_id='58888af2ad8e4cfb861a6bdac6ca640d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1884409c-04ba-4d71-bcbe-df8767b9d5f6 tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a250471-72d4-4824-be0f-6c1d01075856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1884409c-04ba-4d71-bcbe-df8767b9d5f6 tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a250471-72d4-4824-be0f-6c1d01075856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1884409c-04ba-4d71-bcbe-df8767b9d5f6 tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db1b98b0-990f-45d9-b077-4bfa2a0231bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1884409c-04ba-4d71-bcbe-df8767b9d5f6 tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db1b98b0-990f-45d9-b077-4bfa2a0231bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd12d3050-e570-4e95-a100-598525545d3f', 'volume_name': 'volume-d12d3050-e570-4e95-a100-598525545d3f', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1884409c-04ba-4d71-bcbe-df8767b9d5f6 tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9234b56-a6f9-4375-bf53-ae6dd00c9bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1884409c-04ba-4d71-bcbe-df8767b9d5f6 tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9234b56-a6f9-4375-bf53-ae6dd00c9bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1884409c-04ba-4d71-bcbe-df8767b9d5f6 tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (001064ca-1eac-4a14-b940-158f8e10363b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:22 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-1884409c-04ba-4d71-bcbe-df8767b9d5f6 tempest-VolumesActionsTest-1176500285 None] Volume d12d3050-e570-4e95-a100-598525545d3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d12d3050-e570-4e95-a100-598525545d3f', 'volume_size': 1} Aug 11 04:53:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1884409c-04ba-4d71-bcbe-df8767b9d5f6 tempest-VolumesActionsTest-1176500285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:53:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1884409c-04ba-4d71-bcbe-df8767b9d5f6 tempest-VolumesActionsTest-1176500285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:53:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1884409c-04ba-4d71-bcbe-df8767b9d5f6 tempest-VolumesActionsTest-1176500285 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-57158763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d12d3050-e570-4e95-a100-598525545d3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a9b228e1b4d444f8fb7b7d54d8ff281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:53:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:53:23Z,use_quota=True,user_id='58888af2ad8e4cfb861a6bdac6ca640d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:53:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-1884409c-04ba-4d71-bcbe-df8767b9d5f6 tempest-VolumesActionsTest-1176500285 None] Creating volume d12d3050-e570-4e95-a100-598525545d3f {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:53:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1884409c-04ba-4d71-bcbe-df8767b9d5f6 tempest-VolumesActionsTest-1176500285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:53:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1884409c-04ba-4d71-bcbe-df8767b9d5f6 tempest-VolumesActionsTest-1176500285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:53:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1884409c-04ba-4d71-bcbe-df8767b9d5f6 tempest-VolumesActionsTest-1176500285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:53:23 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1884409c-04ba-4d71-bcbe-df8767b9d5f6 tempest-VolumesActionsTest-1176500285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:53:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1884409c-04ba-4d71-bcbe-df8767b9d5f6 tempest-VolumesActionsTest-1176500285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:53:23 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1884409c-04ba-4d71-bcbe-df8767b9d5f6 tempest-VolumesActionsTest-1176500285 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:53:23 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-1884409c-04ba-4d71-bcbe-df8767b9d5f6 tempest-VolumesActionsTest-1176500285 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:53:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1884409c-04ba-4d71-bcbe-df8767b9d5f6 tempest-VolumesActionsTest-1176500285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d12d3050-e570-4e95-a100-598525545d3f 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:23 devstack sudo[112473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d12d3050-e570-4e95-a100-598525545d3f 1073741824 Aug 11 04:53:23 devstack sudo[112473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:23 devstack sudo[112473]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1884409c-04ba-4d71-bcbe-df8767b9d5f6 tempest-VolumesActionsTest-1176500285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d12d3050-e570-4e95-a100-598525545d3f 1073741824" returned: 0 in 0.443s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1884409c-04ba-4d71-bcbe-df8767b9d5f6 tempest-VolumesActionsTest-1176500285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d12d3050-e570-4e95-a100-598525545d3f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:23 devstack sudo[112481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d12d3050-e570-4e95-a100-598525545d3f Aug 11 04:53:23 devstack sudo[112481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:23 devstack sudo[112481]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1884409c-04ba-4d71-bcbe-df8767b9d5f6 tempest-VolumesActionsTest-1176500285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d12d3050-e570-4e95-a100-598525545d3f" returned: 0 in 0.290s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:23 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1884409c-04ba-4d71-bcbe-df8767b9d5f6 tempest-VolumesActionsTest-1176500285 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:53:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1884409c-04ba-4d71-bcbe-df8767b9d5f6 tempest-VolumesActionsTest-1176500285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:53:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1884409c-04ba-4d71-bcbe-df8767b9d5f6 tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (001064ca-1eac-4a14-b940-158f8e10363b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d12d3050-e570-4e95-a100-598525545d3f', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1884409c-04ba-4d71-bcbe-df8767b9d5f6 tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (762f2fc2-23e7-4bc6-83c2-2ead1aaff7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:23 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-1884409c-04ba-4d71-bcbe-df8767b9d5f6 tempest-VolumesActionsTest-1176500285 None] Volume volume-d12d3050-e570-4e95-a100-598525545d3f (d12d3050-e570-4e95-a100-598525545d3f): created successfully Aug 11 04:53:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1884409c-04ba-4d71-bcbe-df8767b9d5f6 tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (762f2fc2-23e7-4bc6-83c2-2ead1aaff7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1884409c-04ba-4d71-bcbe-df8767b9d5f6 tempest-VolumesActionsTest-1176500285 None] Flow 'volume_create_manager' (a5254f9a-1467-4e44-a884-096c26fe0b9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:53:23 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-1884409c-04ba-4d71-bcbe-df8767b9d5f6 tempest-VolumesActionsTest-1176500285 None] Created volume successfully. Aug 11 04:53:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f5247e77-6f45-483c-b98d-5dfa4f347787 tempest-VolumesActionsTest-964545261 None] Acquiring lock "cinder-d12d3050-e570-4e95-a100-598525545d3f-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:53:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f5247e77-6f45-483c-b98d-5dfa4f347787 tempest-VolumesActionsTest-964545261 None] Lock "cinder-d12d3050-e570-4e95-a100-598525545d3f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:53:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f5247e77-6f45-483c-b98d-5dfa4f347787 tempest-VolumesActionsTest-964545261 None] Acquiring lock "cinder-quobyte-d12d3050-e570-4e95-a100-598525545d3f" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:53:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f5247e77-6f45-483c-b98d-5dfa4f347787 tempest-VolumesActionsTest-964545261 None] Lock "cinder-quobyte-d12d3050-e570-4e95-a100-598525545d3f" acquired by "delete_volume" :: waited 0.017s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:53:25 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[17dc7f49-b539-4bad-9699-0a31c82c7e9f]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:53:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f5247e77-6f45-483c-b98d-5dfa4f347787 tempest-VolumesActionsTest-964545261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d12d3050-e570-4e95-a100-598525545d3f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:25 devstack sudo[112490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d12d3050-e570-4e95-a100-598525545d3f Aug 11 04:53:25 devstack sudo[112490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:25 devstack sudo[112490]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f5247e77-6f45-483c-b98d-5dfa4f347787 tempest-VolumesActionsTest-964545261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d12d3050-e570-4e95-a100-598525545d3f" returned: 0 in 0.369s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f5247e77-6f45-483c-b98d-5dfa4f347787 tempest-VolumesActionsTest-964545261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d12d3050-e570-4e95-a100-598525545d3f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:25 devstack sudo[112495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d12d3050-e570-4e95-a100-598525545d3f Aug 11 04:53:25 devstack sudo[112495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:25 devstack sudo[112495]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f5247e77-6f45-483c-b98d-5dfa4f347787 tempest-VolumesActionsTest-964545261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d12d3050-e570-4e95-a100-598525545d3f" returned: 0 in 0.262s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f5247e77-6f45-483c-b98d-5dfa4f347787 tempest-VolumesActionsTest-964545261 None] Lock "cinder-quobyte-d12d3050-e570-4e95-a100-598525545d3f" released by "delete_volume" :: held 0.668s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:53:25 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-f5247e77-6f45-483c-b98d-5dfa4f347787 tempest-VolumesActionsTest-964545261 None] Created reservations ['c36c5b04-1b05-4db4-b39b-a48aaa805a8f', 'c2984e9e-a4c3-48b9-b5d8-39e469bb83e1', 'e2d92576-0405-4dcc-92ac-5c564c321de9', 'b3a35d93-99cd-4b55-bce9-c0f6c9debeaa'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:53:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f5247e77-6f45-483c-b98d-5dfa4f347787 tempest-VolumesActionsTest-964545261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:53:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f5247e77-6f45-483c-b98d-5dfa4f347787 tempest-VolumesActionsTest-964545261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:53:25 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f5247e77-6f45-483c-b98d-5dfa4f347787 tempest-VolumesActionsTest-964545261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:53:25 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f5247e77-6f45-483c-b98d-5dfa4f347787 tempest-VolumesActionsTest-964545261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:53:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f5247e77-6f45-483c-b98d-5dfa4f347787 tempest-VolumesActionsTest-964545261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:53:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f5247e77-6f45-483c-b98d-5dfa4f347787 tempest-VolumesActionsTest-964545261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:26 devstack sudo[112498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:53:26 devstack sudo[112498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:26 devstack sudo[112498]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f5247e77-6f45-483c-b98d-5dfa4f347787 tempest-VolumesActionsTest-964545261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.250s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:26 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-f5247e77-6f45-483c-b98d-5dfa4f347787 tempest-VolumesActionsTest-964545261 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:53:26 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-f5247e77-6f45-483c-b98d-5dfa4f347787 tempest-VolumesActionsTest-964545261 None] Deleted volume successfully. Aug 11 04:53:26 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f5247e77-6f45-483c-b98d-5dfa4f347787 tempest-VolumesActionsTest-964545261 None] Lock "cinder-d12d3050-e570-4e95-a100-598525545d3f-delete_volume" released by "delete_volume" :: held 1.131s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:53:26 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-c04c51b1-e4da-44ae-a2c6-45c4ddda9b4f tempest-VolumesActionsTest-1176500285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:53:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c04c51b1-e4da-44ae-a2c6-45c4ddda9b4f tempest-VolumesActionsTest-1176500285 None] Flow 'volume_create_manager' (19e15f63-4e6a-4730-a302-1923325b523b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:53:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c04c51b1-e4da-44ae-a2c6-45c4ddda9b4f tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d85a6962-6a85-4d64-9abe-2d627be1163b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c04c51b1-e4da-44ae-a2c6-45c4ddda9b4f tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d85a6962-6a85-4d64-9abe-2d627be1163b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1551548973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e08ae4f4-1a69-4598-b467-c5e635d76801,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a9b228e1b4d444f8fb7b7d54d8ff281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:53:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:53:27Z,use_quota=True,user_id='58888af2ad8e4cfb861a6bdac6ca640d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c04c51b1-e4da-44ae-a2c6-45c4ddda9b4f tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a3b3547-cf48-4872-bf4d-508debaea3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c04c51b1-e4da-44ae-a2c6-45c4ddda9b4f tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a3b3547-cf48-4872-bf4d-508debaea3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c04c51b1-e4da-44ae-a2c6-45c4ddda9b4f tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5515164-da39-4d59-9f4a-2b7ed5b5be0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c04c51b1-e4da-44ae-a2c6-45c4ddda9b4f tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5515164-da39-4d59-9f4a-2b7ed5b5be0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e08ae4f4-1a69-4598-b467-c5e635d76801', 'volume_name': 'volume-e08ae4f4-1a69-4598-b467-c5e635d76801', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c04c51b1-e4da-44ae-a2c6-45c4ddda9b4f tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d636c2e5-5544-45d2-8fec-4cffc29568b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c04c51b1-e4da-44ae-a2c6-45c4ddda9b4f tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d636c2e5-5544-45d2-8fec-4cffc29568b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c04c51b1-e4da-44ae-a2c6-45c4ddda9b4f tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cc492e5-1382-482f-9ae5-ae04bceb36ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:26 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-c04c51b1-e4da-44ae-a2c6-45c4ddda9b4f tempest-VolumesActionsTest-1176500285 None] Volume e08ae4f4-1a69-4598-b467-c5e635d76801: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e08ae4f4-1a69-4598-b467-c5e635d76801', 'volume_size': 1} Aug 11 04:53:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c04c51b1-e4da-44ae-a2c6-45c4ddda9b4f tempest-VolumesActionsTest-1176500285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:53:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c04c51b1-e4da-44ae-a2c6-45c4ddda9b4f tempest-VolumesActionsTest-1176500285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:53:26 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c04c51b1-e4da-44ae-a2c6-45c4ddda9b4f tempest-VolumesActionsTest-1176500285 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1551548973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e08ae4f4-1a69-4598-b467-c5e635d76801,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a9b228e1b4d444f8fb7b7d54d8ff281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:53:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:53:27Z,use_quota=True,user_id='58888af2ad8e4cfb861a6bdac6ca640d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:53:26 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-c04c51b1-e4da-44ae-a2c6-45c4ddda9b4f tempest-VolumesActionsTest-1176500285 None] Creating volume e08ae4f4-1a69-4598-b467-c5e635d76801 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:53:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c04c51b1-e4da-44ae-a2c6-45c4ddda9b4f tempest-VolumesActionsTest-1176500285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:53:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c04c51b1-e4da-44ae-a2c6-45c4ddda9b4f tempest-VolumesActionsTest-1176500285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:53:26 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c04c51b1-e4da-44ae-a2c6-45c4ddda9b4f tempest-VolumesActionsTest-1176500285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:53:26 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c04c51b1-e4da-44ae-a2c6-45c4ddda9b4f tempest-VolumesActionsTest-1176500285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:53:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c04c51b1-e4da-44ae-a2c6-45c4ddda9b4f tempest-VolumesActionsTest-1176500285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:53:26 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c04c51b1-e4da-44ae-a2c6-45c4ddda9b4f tempest-VolumesActionsTest-1176500285 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:53:26 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-c04c51b1-e4da-44ae-a2c6-45c4ddda9b4f tempest-VolumesActionsTest-1176500285 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:53:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c04c51b1-e4da-44ae-a2c6-45c4ddda9b4f tempest-VolumesActionsTest-1176500285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e08ae4f4-1a69-4598-b467-c5e635d76801 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:26 devstack sudo[112501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e08ae4f4-1a69-4598-b467-c5e635d76801 1073741824 Aug 11 04:53:26 devstack sudo[112501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:27 devstack sudo[112501]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c04c51b1-e4da-44ae-a2c6-45c4ddda9b4f tempest-VolumesActionsTest-1176500285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e08ae4f4-1a69-4598-b467-c5e635d76801 1073741824" returned: 0 in 0.470s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c04c51b1-e4da-44ae-a2c6-45c4ddda9b4f tempest-VolumesActionsTest-1176500285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e08ae4f4-1a69-4598-b467-c5e635d76801 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:27 devstack sudo[112507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e08ae4f4-1a69-4598-b467-c5e635d76801 Aug 11 04:53:27 devstack sudo[112507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:27 devstack sudo[112507]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c04c51b1-e4da-44ae-a2c6-45c4ddda9b4f tempest-VolumesActionsTest-1176500285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e08ae4f4-1a69-4598-b467-c5e635d76801" returned: 0 in 0.267s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c04c51b1-e4da-44ae-a2c6-45c4ddda9b4f tempest-VolumesActionsTest-1176500285 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:53:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c04c51b1-e4da-44ae-a2c6-45c4ddda9b4f tempest-VolumesActionsTest-1176500285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:53:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c04c51b1-e4da-44ae-a2c6-45c4ddda9b4f tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cc492e5-1382-482f-9ae5-ae04bceb36ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e08ae4f4-1a69-4598-b467-c5e635d76801', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c04c51b1-e4da-44ae-a2c6-45c4ddda9b4f tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9a9e0f1-e410-498f-bbe8-cd3f7f18e74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:27 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-c04c51b1-e4da-44ae-a2c6-45c4ddda9b4f tempest-VolumesActionsTest-1176500285 None] Volume volume-e08ae4f4-1a69-4598-b467-c5e635d76801 (e08ae4f4-1a69-4598-b467-c5e635d76801): created successfully Aug 11 04:53:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c04c51b1-e4da-44ae-a2c6-45c4ddda9b4f tempest-VolumesActionsTest-1176500285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9a9e0f1-e410-498f-bbe8-cd3f7f18e74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c04c51b1-e4da-44ae-a2c6-45c4ddda9b4f tempest-VolumesActionsTest-1176500285 None] Flow 'volume_create_manager' (19e15f63-4e6a-4730-a302-1923325b523b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:53:27 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-c04c51b1-e4da-44ae-a2c6-45c4ddda9b4f tempest-VolumesActionsTest-1176500285 None] Created volume successfully. Aug 11 04:53:28 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:53:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Flow 'volume_create_manager' (596b081a-38fe-4bc0-8bf4-37c6c0e17a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:53:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e004890-c47e-426c-a494-de7d17c4eaf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e004890-c47e-426c-a494-de7d17c4eaf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b040707a-5c3f-4f89-acb2-21f601f1aab9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75260b43317e4812b81ebaf4abf674b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:53:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:53:29Z,use_quota=True,user_id='cd2b94f398184501bd15209d3b4af6e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cd9757de-3292-4d47-bb4c-8a5228718b12),volume_type_id=cd9757de-3292-4d47-bb4c-8a5228718b12)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f5df6ef-d297-4da1-acbd-8b3642cac3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f5df6ef-d297-4da1-acbd-8b3642cac3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b310e02d-22a8-4437-9883-9cb2cae7c5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:28 devstack cinder-volume[94472]: DEBUG cinder.image.glance [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Creating Keystone auth plugin from conf {{(pid=94472) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 11 04:53:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b310e02d-22a8-4437-9883-9cb2cae7c5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b040707a-5c3f-4f89-acb2-21f601f1aab9', 'volume_name': 'volume-b040707a-5c3f-4f89-acb2-21f601f1aab9', 'volume_size': 1, 'image_id': '1814c9b8-0d7e-418d-a632-41dd5c141d74', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1814c9b8-0d7e-418d-a632-41dd5c141d74', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '27bab6057f03a4c9c59c80f816f36380', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '75260b43317e4812b81ebaf4abf674b4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ff9f518ab40d47040e9d879f538254bf69ebfe78061c5325796d2f667275aa64a892513f657dd36b6a7e16f4689912d0c08fb9599824aabf8882a643aca516f3', 'id': '1814c9b8-0d7e-418d-a632-41dd5c141d74', 'created_at': datetime.datetime(2026, 8, 11, 2, 53, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 2, 53, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1814c9b8-0d7e-418d-a632-41dd5c141d74/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72313af7-344e-45d8-b5e5-09e8f7f06fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72313af7-344e-45d8-b5e5-09e8f7f06fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac303cfe-8ce5-460a-8c84-37f2d2a60798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:29 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Volume b040707a-5c3f-4f89-acb2-21f601f1aab9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b040707a-5c3f-4f89-acb2-21f601f1aab9', 'volume_size': 1, 'image_id': '1814c9b8-0d7e-418d-a632-41dd5c141d74', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1814c9b8-0d7e-418d-a632-41dd5c141d74', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '27bab6057f03a4c9c59c80f816f36380', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '75260b43317e4812b81ebaf4abf674b4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ff9f518ab40d47040e9d879f538254bf69ebfe78061c5325796d2f667275aa64a892513f657dd36b6a7e16f4689912d0c08fb9599824aabf8882a643aca516f3', 'id': '1814c9b8-0d7e-418d-a632-41dd5c141d74', 'created_at': datetime.datetime(2026, 8, 11, 2, 53, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 2, 53, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1814c9b8-0d7e-418d-a632-41dd5c141d74/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 11 04:53:29 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Trying to clone b040707a-5c3f-4f89-acb2-21f601f1aab9 from image 1814c9b8-0d7e-418d-a632-41dd5c141d74 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1814c9b8-0d7e-418d-a632-41dd5c141d74', 'metadata': {}}]). {{(pid=94472) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 11 04:53:29 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1814c9b8-0d7e-418d-a632-41dd5c141d74_37ejj2hddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 11 04:53:29 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Image download 0.00 MB at 0.00 MB/s Aug 11 04:53:29 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b6ea83-f5ef-4b88-80b1-ffdf2f410916]: (4, 'raw') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:53:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1814c9b8-0d7e-418d-a632-41dd5c141d74_37ejj2hddevstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:29 devstack sudo[112510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1814c9b8-0d7e-418d-a632-41dd5c141d74_37ejj2hddevstack@QuobyteHD Aug 11 04:53:29 devstack sudo[112510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:29 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-61d63329-b2c5-48c6-8921-9e5a4507b228 tempest-VolumesActionsTest-1176500285 None] Acquiring lock "cinder-e08ae4f4-1a69-4598-b467-c5e635d76801-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:53:29 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-61d63329-b2c5-48c6-8921-9e5a4507b228 tempest-VolumesActionsTest-1176500285 None] Lock "cinder-e08ae4f4-1a69-4598-b467-c5e635d76801-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:53:29 devstack sudo[112510]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1814c9b8-0d7e-418d-a632-41dd5c141d74_37ejj2hddevstack@QuobyteHD" returned: 0 in 0.376s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1814c9b8-0d7e-418d-a632-41dd5c141d74_37ejj2hddevstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:29 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-61d63329-b2c5-48c6-8921-9e5a4507b228 tempest-VolumesActionsTest-1176500285 None] Acquiring lock "cinder-quobyte-e08ae4f4-1a69-4598-b467-c5e635d76801" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:53:29 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-61d63329-b2c5-48c6-8921-9e5a4507b228 tempest-VolumesActionsTest-1176500285 None] Lock "cinder-quobyte-e08ae4f4-1a69-4598-b467-c5e635d76801" acquired by "delete_volume" :: waited 0.015s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:53:29 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[d457fcbc-9601-4377-9eb2-daaf45d7e16f]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:53:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-61d63329-b2c5-48c6-8921-9e5a4507b228 tempest-VolumesActionsTest-1176500285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e08ae4f4-1a69-4598-b467-c5e635d76801 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:29 devstack sudo[112514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1814c9b8-0d7e-418d-a632-41dd5c141d74_37ejj2hddevstack@QuobyteHD Aug 11 04:53:29 devstack sudo[112514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:29 devstack sudo[112515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e08ae4f4-1a69-4598-b467-c5e635d76801 Aug 11 04:53:29 devstack sudo[112515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:29 devstack sudo[112514]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1814c9b8-0d7e-418d-a632-41dd5c141d74_37ejj2hddevstack@QuobyteHD" returned: 1 in 0.333s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1814c9b8-0d7e-418d-a632-41dd5c141d74_37ejj2hddevstack@QuobyteHD' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 11 04:53:29 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Temporary image 1814c9b8-0d7e-418d-a632-41dd5c141d74 is fetched for user cd2b94f398184501bd15209d3b4af6e6. {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 11 04:53:30 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd79f65-ac0d-464e-ae3a-7f00194480d7]: (4, 'raw') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:53:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1814c9b8-0d7e-418d-a632-41dd5c141d74_37ejj2hddevstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:30 devstack sudo[112515]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-61d63329-b2c5-48c6-8921-9e5a4507b228 tempest-VolumesActionsTest-1176500285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e08ae4f4-1a69-4598-b467-c5e635d76801" returned: 0 in 0.363s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-61d63329-b2c5-48c6-8921-9e5a4507b228 tempest-VolumesActionsTest-1176500285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e08ae4f4-1a69-4598-b467-c5e635d76801 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:30 devstack sudo[112525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e08ae4f4-1a69-4598-b467-c5e635d76801 Aug 11 04:53:30 devstack sudo[112525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:30 devstack sudo[112524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1814c9b8-0d7e-418d-a632-41dd5c141d74_37ejj2hddevstack@QuobyteHD Aug 11 04:53:30 devstack sudo[112524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:30 devstack sudo[112525]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-61d63329-b2c5-48c6-8921-9e5a4507b228 tempest-VolumesActionsTest-1176500285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e08ae4f4-1a69-4598-b467-c5e635d76801" returned: 0 in 0.250s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-61d63329-b2c5-48c6-8921-9e5a4507b228 tempest-VolumesActionsTest-1176500285 None] Lock "cinder-quobyte-e08ae4f4-1a69-4598-b467-c5e635d76801" released by "delete_volume" :: held 0.659s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:53:30 devstack sudo[112524]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1814c9b8-0d7e-418d-a632-41dd5c141d74_37ejj2hddevstack@QuobyteHD" returned: 0 in 0.335s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1814c9b8-0d7e-418d-a632-41dd5c141d74_37ejj2hddevstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:30 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-61d63329-b2c5-48c6-8921-9e5a4507b228 tempest-VolumesActionsTest-1176500285 None] Created reservations ['74f47410-dc6d-4e76-834b-8189aa6b9a7b', 'f21e157a-2d71-4172-95f8-3f176192322e', '1f73b3b9-84c1-44cf-bbcc-4b88f81aa770', '67737d24-b76d-4302-9b10-1862dcd3a312'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:53:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-61d63329-b2c5-48c6-8921-9e5a4507b228 tempest-VolumesActionsTest-1176500285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:53:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-61d63329-b2c5-48c6-8921-9e5a4507b228 tempest-VolumesActionsTest-1176500285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:53:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-61d63329-b2c5-48c6-8921-9e5a4507b228 tempest-VolumesActionsTest-1176500285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:53:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-61d63329-b2c5-48c6-8921-9e5a4507b228 tempest-VolumesActionsTest-1176500285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:53:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-61d63329-b2c5-48c6-8921-9e5a4507b228 tempest-VolumesActionsTest-1176500285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:53:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-61d63329-b2c5-48c6-8921-9e5a4507b228 tempest-VolumesActionsTest-1176500285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:30 devstack sudo[112531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1814c9b8-0d7e-418d-a632-41dd5c141d74_37ejj2hddevstack@QuobyteHD Aug 11 04:53:30 devstack sudo[112531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:30 devstack sudo[112533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:53:30 devstack sudo[112533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:30 devstack sudo[112531]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1814c9b8-0d7e-418d-a632-41dd5c141d74_37ejj2hddevstack@QuobyteHD" returned: 1 in 0.359s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1814c9b8-0d7e-418d-a632-41dd5c141d74_37ejj2hddevstack@QuobyteHD' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 11 04:53:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:53:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:53:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b040707a-5c3f-4f89-acb2-21f601f1aab9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75260b43317e4812b81ebaf4abf674b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:53:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:53:29Z,use_quota=True,user_id='cd2b94f398184501bd15209d3b4af6e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cd9757de-3292-4d47-bb4c-8a5228718b12),volume_type_id=cd9757de-3292-4d47-bb4c-8a5228718b12)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:53:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Creating volume b040707a-5c3f-4f89-acb2-21f601f1aab9 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:53:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:53:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:53:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:53:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:53:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:53:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:53:30 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:53:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b040707a-5c3f-4f89-acb2-21f601f1aab9 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:30 devstack sudo[112533]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-61d63329-b2c5-48c6-8921-9e5a4507b228 tempest-VolumesActionsTest-1176500285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.271s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:30 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-61d63329-b2c5-48c6-8921-9e5a4507b228 tempest-VolumesActionsTest-1176500285 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:53:30 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-61d63329-b2c5-48c6-8921-9e5a4507b228 tempest-VolumesActionsTest-1176500285 None] Deleted volume successfully. Aug 11 04:53:30 devstack sudo[112539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b040707a-5c3f-4f89-acb2-21f601f1aab9 1073741824 Aug 11 04:53:30 devstack sudo[112539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-61d63329-b2c5-48c6-8921-9e5a4507b228 tempest-VolumesActionsTest-1176500285 None] Lock "cinder-e08ae4f4-1a69-4598-b467-c5e635d76801-delete_volume" released by "delete_volume" :: held 1.181s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:53:31 devstack sudo[112539]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b040707a-5c3f-4f89-acb2-21f601f1aab9 1073741824" returned: 0 in 0.430s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b040707a-5c3f-4f89-acb2-21f601f1aab9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:31 devstack sudo[112545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b040707a-5c3f-4f89-acb2-21f601f1aab9 Aug 11 04:53:31 devstack sudo[112545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:31 devstack sudo[112545]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b040707a-5c3f-4f89-acb2-21f601f1aab9" returned: 0 in 0.265s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:31 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:53:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:53:31 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Attempting download of 1814c9b8-0d7e-418d-a632-41dd5c141d74 ((None, [{'url': 'file:///opt/stack/data/glance/images/1814c9b8-0d7e-418d-a632-41dd5c141d74', 'metadata': {}}])) to volume b040707a-5c3f-4f89-acb2-21f601f1aab9. {{(pid=94472) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 11 04:53:31 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedb1da6-0ef8-4f89-bb18-241d3428e39c]: (4, 'raw') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:53:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1814c9b8-0d7e-418d-a632-41dd5c141d74_e57z6yn1 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:31 devstack sudo[112548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1814c9b8-0d7e-418d-a632-41dd5c141d74_e57z6yn1 Aug 11 04:53:31 devstack sudo[112548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:31 devstack sudo[112548]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1814c9b8-0d7e-418d-a632-41dd5c141d74_e57z6yn1" returned: 0 in 0.345s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1814c9b8-0d7e-418d-a632-41dd5c141d74_e57z6yn1 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:31 devstack sudo[112552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1814c9b8-0d7e-418d-a632-41dd5c141d74_e57z6yn1 Aug 11 04:53:31 devstack sudo[112552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:32 devstack sudo[112552]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1814c9b8-0d7e-418d-a632-41dd5c141d74_e57z6yn1" returned: 1 in 0.358s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1814c9b8-0d7e-418d-a632-41dd5c141d74_e57z6yn1' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 11 04:53:32 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7b3ab8-3611-4774-a0f9-44883b69b7f4]: (4, 'raw') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:53:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1814c9b8-0d7e-418d-a632-41dd5c141d74_37ejj2hddevstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:32 devstack sudo[112557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1814c9b8-0d7e-418d-a632-41dd5c141d74_37ejj2hddevstack@QuobyteHD Aug 11 04:53:32 devstack sudo[112557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:32 devstack sudo[112557]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1814c9b8-0d7e-418d-a632-41dd5c141d74_37ejj2hddevstack@QuobyteHD" returned: 0 in 0.336s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1814c9b8-0d7e-418d-a632-41dd5c141d74_37ejj2hddevstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:32 devstack sudo[112561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1814c9b8-0d7e-418d-a632-41dd5c141d74_37ejj2hddevstack@QuobyteHD Aug 11 04:53:32 devstack sudo[112561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:32 devstack sudo[112561]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1814c9b8-0d7e-418d-a632-41dd5c141d74_37ejj2hddevstack@QuobyteHD" returned: 1 in 0.347s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1814c9b8-0d7e-418d-a632-41dd5c141d74_37ejj2hddevstack@QuobyteHD' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 11 04:53:32 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] 1814c9b8-0d7e-418d-a632-41dd5c141d74 was raw, converting to qcow2 {{(pid=94472) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 11 04:53:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1814c9b8-0d7e-418d-a632-41dd5c141d74_37ejj2hddevstack@QuobyteHD /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b040707a-5c3f-4f89-acb2-21f601f1aab9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:32 devstack sudo[112566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1814c9b8-0d7e-418d-a632-41dd5c141d74_37ejj2hddevstack@QuobyteHD /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b040707a-5c3f-4f89-acb2-21f601f1aab9 Aug 11 04:53:32 devstack sudo[112566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:33 devstack sudo[112566]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1814c9b8-0d7e-418d-a632-41dd5c141d74_37ejj2hddevstack@QuobyteHD /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b040707a-5c3f-4f89-acb2-21f601f1aab9" returned: 0 in 0.468s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:33 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1814c9b8-0d7e-418d-a632-41dd5c141d74_37ejj2hddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b040707a-5c3f-4f89-acb2-21f601f1aab9 {{(pid=94472) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 11 04:53:33 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Converted 0.00 MB image at 0.00 MB/s Aug 11 04:53:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b040707a-5c3f-4f89-acb2-21f601f1aab9 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:33 devstack sudo[112573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b040707a-5c3f-4f89-acb2-21f601f1aab9 1G Aug 11 04:53:33 devstack sudo[112573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:33 devstack sudo[112573]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b040707a-5c3f-4f89-acb2-21f601f1aab9 1G" returned: 0 in 0.296s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:33 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Downloaded image 1814c9b8-0d7e-418d-a632-41dd5c141d74 ((None, [{'url': 'file:///opt/stack/data/glance/images/1814c9b8-0d7e-418d-a632-41dd5c141d74', 'metadata': {}}])) to volume b040707a-5c3f-4f89-acb2-21f601f1aab9 successfully. {{(pid=94472) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 11 04:53:33 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Temporary image 1814c9b8-0d7e-418d-a632-41dd5c141d74 for user cd2b94f398184501bd15209d3b4af6e6 is deleted. {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 11 04:53:33 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Marking volume b040707a-5c3f-4f89-acb2-21f601f1aab9 as bootable. {{(pid=94472) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 11 04:53:33 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Copying metadata from image 1814c9b8-0d7e-418d-a632-41dd5c141d74 to b040707a-5c3f-4f89-acb2-21f601f1aab9. {{(pid=94472) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 11 04:53:33 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Creating volume glance metadata for volume b040707a-5c3f-4f89-acb2-21f601f1aab9 backed by image 1814c9b8-0d7e-418d-a632-41dd5c141d74 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '1814c9b8-0d7e-418d-a632-41dd5c141d74', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '27bab6057f03a4c9c59c80f816f36380', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94472) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 11 04:53:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac303cfe-8ce5-460a-8c84-37f2d2a60798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b040707a-5c3f-4f89-acb2-21f601f1aab9', 'volume_size': 1, 'image_id': '1814c9b8-0d7e-418d-a632-41dd5c141d74', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1814c9b8-0d7e-418d-a632-41dd5c141d74', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '27bab6057f03a4c9c59c80f816f36380', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '75260b43317e4812b81ebaf4abf674b4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ff9f518ab40d47040e9d879f538254bf69ebfe78061c5325796d2f667275aa64a892513f657dd36b6a7e16f4689912d0c08fb9599824aabf8882a643aca516f3', 'id': '1814c9b8-0d7e-418d-a632-41dd5c141d74', 'created_at': datetime.datetime(2026, 8, 11, 2, 53, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 2, 53, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1814c9b8-0d7e-418d-a632-41dd5c141d74/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36dc2387-7a58-4530-9c04-d72f9c465407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:33 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Volume volume-b040707a-5c3f-4f89-acb2-21f601f1aab9 (b040707a-5c3f-4f89-acb2-21f601f1aab9): created successfully Aug 11 04:53:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36dc2387-7a58-4530-9c04-d72f9c465407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Flow 'volume_create_manager' (596b081a-38fe-4bc0-8bf4-37c6c0e17a63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:53:33 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-8d58d2d0-b5e3-4e8e-b0b7-23af2eeefe68 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Created volume successfully. Aug 11 04:53:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-33e56a4f-cf23-466d-b8c2-c22f1b44b178 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Acquiring lock "cinder-b040707a-5c3f-4f89-acb2-21f601f1aab9-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:53:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-33e56a4f-cf23-466d-b8c2-c22f1b44b178 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Lock "cinder-b040707a-5c3f-4f89-acb2-21f601f1aab9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:53:34 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-33e56a4f-cf23-466d-b8c2-c22f1b44b178 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Acquiring lock "cinder-quobyte-b040707a-5c3f-4f89-acb2-21f601f1aab9" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:53:34 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-33e56a4f-cf23-466d-b8c2-c22f1b44b178 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Lock "cinder-quobyte-b040707a-5c3f-4f89-acb2-21f601f1aab9" acquired by "delete_volume" :: waited 0.032s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:53:34 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[48738c8f-87d8-43b0-acaf-1cf6a603859e]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:53:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-33e56a4f-cf23-466d-b8c2-c22f1b44b178 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b040707a-5c3f-4f89-acb2-21f601f1aab9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:34 devstack sudo[112578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b040707a-5c3f-4f89-acb2-21f601f1aab9 Aug 11 04:53:34 devstack sudo[112578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:34 devstack sudo[112578]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-33e56a4f-cf23-466d-b8c2-c22f1b44b178 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b040707a-5c3f-4f89-acb2-21f601f1aab9" returned: 0 in 0.387s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-33e56a4f-cf23-466d-b8c2-c22f1b44b178 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b040707a-5c3f-4f89-acb2-21f601f1aab9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:34 devstack sudo[112583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b040707a-5c3f-4f89-acb2-21f601f1aab9 Aug 11 04:53:34 devstack sudo[112583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:34 devstack sudo[112583]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-33e56a4f-cf23-466d-b8c2-c22f1b44b178 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b040707a-5c3f-4f89-acb2-21f601f1aab9" returned: 0 in 0.266s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:34 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-33e56a4f-cf23-466d-b8c2-c22f1b44b178 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Lock "cinder-quobyte-b040707a-5c3f-4f89-acb2-21f601f1aab9" released by "delete_volume" :: held 0.728s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:53:34 devstack cinder-volume[94472]: WARNING cinder.quota [None req-33e56a4f-cf23-466d-b8c2-c22f1b44b178 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 11 04:53:34 devstack cinder-volume[94472]: WARNING cinder.quota [None req-33e56a4f-cf23-466d-b8c2-c22f1b44b178 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 11 04:53:34 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-33e56a4f-cf23-466d-b8c2-c22f1b44b178 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Created reservations ['3033af6e-fc0e-4a75-b178-d35acb620fc1', '14b9ce3d-0e46-453d-bc52-fab2f5878593', 'cfcad231-0c17-4b97-890a-73375883498d', 'e0533550-6022-4b76-b6d1-82c39d782d75'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:53:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-33e56a4f-cf23-466d-b8c2-c22f1b44b178 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:53:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-33e56a4f-cf23-466d-b8c2-c22f1b44b178 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:53:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-33e56a4f-cf23-466d-b8c2-c22f1b44b178 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:53:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-33e56a4f-cf23-466d-b8c2-c22f1b44b178 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:53:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-33e56a4f-cf23-466d-b8c2-c22f1b44b178 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:53:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-33e56a4f-cf23-466d-b8c2-c22f1b44b178 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:34 devstack sudo[112587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:53:34 devstack sudo[112587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:35 devstack sudo[112587]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-33e56a4f-cf23-466d-b8c2-c22f1b44b178 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.267s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:35 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-33e56a4f-cf23-466d-b8c2-c22f1b44b178 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:53:35 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-33e56a4f-cf23-466d-b8c2-c22f1b44b178 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Deleted volume successfully. Aug 11 04:53:35 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-33e56a4f-cf23-466d-b8c2-c22f1b44b178 tempest-VolumeAndVolumeTypeFromImageTest-1442425749 None] Lock "cinder-b040707a-5c3f-4f89-acb2-21f601f1aab9-delete_volume" released by "delete_volume" :: held 1.292s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:53:39 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1bb0fff-d83b-463d-9849-602e9aa035a9 tempest-CreateVolumesFromImageTest-98408093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:53:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a1bb0fff-d83b-463d-9849-602e9aa035a9 tempest-CreateVolumesFromImageTest-98408093 None] Flow 'volume_create_manager' (5834afbc-a637-48a2-b168-00b81b023583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:53:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a1bb0fff-d83b-463d-9849-602e9aa035a9 tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (873b3336-bdb9-47b1-8fad-9d704fc89141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a1bb0fff-d83b-463d-9849-602e9aa035a9 tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (873b3336-bdb9-47b1-8fad-9d704fc89141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:53:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1359068500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60844c25-e42b-421c-b0ee-ebbc778f7a2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbc724133b194ac8b144423f7621e7ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:53:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:53:40Z,use_quota=True,user_id='1f99a1dbc0184ed4a0cc3e5e235cdfaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a1bb0fff-d83b-463d-9849-602e9aa035a9 tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0a9aa60-43fb-440d-980e-e590715ad1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a1bb0fff-d83b-463d-9849-602e9aa035a9 tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0a9aa60-43fb-440d-980e-e590715ad1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a1bb0fff-d83b-463d-9849-602e9aa035a9 tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dd0837c-c3dc-4e41-8d5d-5bab4961440b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a1bb0fff-d83b-463d-9849-602e9aa035a9 tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dd0837c-c3dc-4e41-8d5d-5bab4961440b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60844c25-e42b-421c-b0ee-ebbc778f7a2a', 'volume_name': 'volume-60844c25-e42b-421c-b0ee-ebbc778f7a2a', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a1bb0fff-d83b-463d-9849-602e9aa035a9 tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eccfb801-7007-4187-9c50-1a5d9663912d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a1bb0fff-d83b-463d-9849-602e9aa035a9 tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eccfb801-7007-4187-9c50-1a5d9663912d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a1bb0fff-d83b-463d-9849-602e9aa035a9 tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d650d33e-825d-4baa-81b7-c902a75a421c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:39 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-a1bb0fff-d83b-463d-9849-602e9aa035a9 tempest-CreateVolumesFromImageTest-98408093 None] Volume 60844c25-e42b-421c-b0ee-ebbc778f7a2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60844c25-e42b-421c-b0ee-ebbc778f7a2a', 'volume_size': 1} Aug 11 04:53:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a1bb0fff-d83b-463d-9849-602e9aa035a9 tempest-CreateVolumesFromImageTest-98408093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:53:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a1bb0fff-d83b-463d-9849-602e9aa035a9 tempest-CreateVolumesFromImageTest-98408093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:53:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a1bb0fff-d83b-463d-9849-602e9aa035a9 tempest-CreateVolumesFromImageTest-98408093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:53:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1359068500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60844c25-e42b-421c-b0ee-ebbc778f7a2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbc724133b194ac8b144423f7621e7ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:53:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:53:40Z,use_quota=True,user_id='1f99a1dbc0184ed4a0cc3e5e235cdfaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:53:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-a1bb0fff-d83b-463d-9849-602e9aa035a9 tempest-CreateVolumesFromImageTest-98408093 None] Creating volume 60844c25-e42b-421c-b0ee-ebbc778f7a2a {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:53:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a1bb0fff-d83b-463d-9849-602e9aa035a9 tempest-CreateVolumesFromImageTest-98408093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:53:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a1bb0fff-d83b-463d-9849-602e9aa035a9 tempest-CreateVolumesFromImageTest-98408093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:53:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a1bb0fff-d83b-463d-9849-602e9aa035a9 tempest-CreateVolumesFromImageTest-98408093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:53:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a1bb0fff-d83b-463d-9849-602e9aa035a9 tempest-CreateVolumesFromImageTest-98408093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:53:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a1bb0fff-d83b-463d-9849-602e9aa035a9 tempest-CreateVolumesFromImageTest-98408093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:53:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a1bb0fff-d83b-463d-9849-602e9aa035a9 tempest-CreateVolumesFromImageTest-98408093 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:53:39 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-a1bb0fff-d83b-463d-9849-602e9aa035a9 tempest-CreateVolumesFromImageTest-98408093 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:53:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a1bb0fff-d83b-463d-9849-602e9aa035a9 tempest-CreateVolumesFromImageTest-98408093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-60844c25-e42b-421c-b0ee-ebbc778f7a2a 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:39 devstack sudo[112593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-60844c25-e42b-421c-b0ee-ebbc778f7a2a 1073741824 Aug 11 04:53:39 devstack sudo[112593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:40 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e808eb1-35d0-49f8-95a4-498db537e4c6 tempest-CreateVolumesFromImageTest-98408093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:53:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0e808eb1-35d0-49f8-95a4-498db537e4c6 tempest-CreateVolumesFromImageTest-98408093 None] Flow 'volume_create_manager' (6c1cdd09-f5ad-4fa3-bed7-9acae1b10022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:53:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0e808eb1-35d0-49f8-95a4-498db537e4c6 tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c76bf39e-4adc-4c76-b0f5-8a60359e4a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0e808eb1-35d0-49f8-95a4-498db537e4c6 tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c76bf39e-4adc-4c76-b0f5-8a60359e4a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:53:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1829055108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c025e0f-b6b0-4cde-af96-99bf41acb2d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbc724133b194ac8b144423f7621e7ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:53:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:53:40Z,use_quota=True,user_id='1f99a1dbc0184ed4a0cc3e5e235cdfaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0e808eb1-35d0-49f8-95a4-498db537e4c6 tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3683d02d-e9b0-49cb-a456-f9ace969425f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0e808eb1-35d0-49f8-95a4-498db537e4c6 tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3683d02d-e9b0-49cb-a456-f9ace969425f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0e808eb1-35d0-49f8-95a4-498db537e4c6 tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21645130-3110-416f-9e4d-eb13d63b9ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0e808eb1-35d0-49f8-95a4-498db537e4c6 tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21645130-3110-416f-9e4d-eb13d63b9ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c025e0f-b6b0-4cde-af96-99bf41acb2d6', 'volume_name': 'volume-9c025e0f-b6b0-4cde-af96-99bf41acb2d6', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0e808eb1-35d0-49f8-95a4-498db537e4c6 tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4e5bce3-2d5c-4ac2-bc2d-728656012656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0e808eb1-35d0-49f8-95a4-498db537e4c6 tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4e5bce3-2d5c-4ac2-bc2d-728656012656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0e808eb1-35d0-49f8-95a4-498db537e4c6 tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9e1fc23-4329-4de3-b672-bd979147ee26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:40 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-0e808eb1-35d0-49f8-95a4-498db537e4c6 tempest-CreateVolumesFromImageTest-98408093 None] Volume 9c025e0f-b6b0-4cde-af96-99bf41acb2d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c025e0f-b6b0-4cde-af96-99bf41acb2d6', 'volume_size': 1} Aug 11 04:53:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0e808eb1-35d0-49f8-95a4-498db537e4c6 tempest-CreateVolumesFromImageTest-98408093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:53:40 devstack sudo[112593]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a1bb0fff-d83b-463d-9849-602e9aa035a9 tempest-CreateVolumesFromImageTest-98408093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-60844c25-e42b-421c-b0ee-ebbc778f7a2a 1073741824" returned: 0 in 0.506s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a1bb0fff-d83b-463d-9849-602e9aa035a9 tempest-CreateVolumesFromImageTest-98408093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-60844c25-e42b-421c-b0ee-ebbc778f7a2a {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:40 devstack sudo[112599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-60844c25-e42b-421c-b0ee-ebbc778f7a2a Aug 11 04:53:40 devstack sudo[112599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:40 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:UPDATE=98,cinder:SELECT=95,cinder:INSERT=32,cinder:DELETE=5 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:53:40 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e92f2c0-f8bb-4b55-ba88-e50f49d4dbfa tempest-CreateVolumesFromImageTest-98408093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:53:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1e92f2c0-f8bb-4b55-ba88-e50f49d4dbfa tempest-CreateVolumesFromImageTest-98408093 None] Flow 'volume_create_manager' (08d7a958-4d23-4b33-8190-49ecb5059417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:53:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1e92f2c0-f8bb-4b55-ba88-e50f49d4dbfa tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0b4733c-7de8-4132-85d6-3e7715d33a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1e92f2c0-f8bb-4b55-ba88-e50f49d4dbfa tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0b4733c-7de8-4132-85d6-3e7715d33a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:53:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2001516996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=064df28b-d85f-403d-9a7b-c8e0e98c94c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbc724133b194ac8b144423f7621e7ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:53:41Z,use_quota=True,user_id='1f99a1dbc0184ed4a0cc3e5e235cdfaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1e92f2c0-f8bb-4b55-ba88-e50f49d4dbfa tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80bb25d4-d1df-4818-b808-f1c8fdce971e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1e92f2c0-f8bb-4b55-ba88-e50f49d4dbfa tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80bb25d4-d1df-4818-b808-f1c8fdce971e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1e92f2c0-f8bb-4b55-ba88-e50f49d4dbfa tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (124dac06-0ef6-4693-ac3d-5fb3eb2f7919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1e92f2c0-f8bb-4b55-ba88-e50f49d4dbfa tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (124dac06-0ef6-4693-ac3d-5fb3eb2f7919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '064df28b-d85f-403d-9a7b-c8e0e98c94c5', 'volume_name': 'volume-064df28b-d85f-403d-9a7b-c8e0e98c94c5', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1e92f2c0-f8bb-4b55-ba88-e50f49d4dbfa tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aa172a8-d8da-4453-8a2f-ff035382f61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1e92f2c0-f8bb-4b55-ba88-e50f49d4dbfa tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aa172a8-d8da-4453-8a2f-ff035382f61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1e92f2c0-f8bb-4b55-ba88-e50f49d4dbfa tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dac6fe7-5857-4e3e-8595-d26b2c87b19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:40 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-1e92f2c0-f8bb-4b55-ba88-e50f49d4dbfa tempest-CreateVolumesFromImageTest-98408093 None] Volume 064df28b-d85f-403d-9a7b-c8e0e98c94c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-064df28b-d85f-403d-9a7b-c8e0e98c94c5', 'volume_size': 1} Aug 11 04:53:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1e92f2c0-f8bb-4b55-ba88-e50f49d4dbfa tempest-CreateVolumesFromImageTest-98408093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:53:40 devstack sudo[112599]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a1bb0fff-d83b-463d-9849-602e9aa035a9 tempest-CreateVolumesFromImageTest-98408093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-60844c25-e42b-421c-b0ee-ebbc778f7a2a" returned: 0 in 0.406s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:40 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a1bb0fff-d83b-463d-9849-602e9aa035a9 tempest-CreateVolumesFromImageTest-98408093 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:53:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a1bb0fff-d83b-463d-9849-602e9aa035a9 tempest-CreateVolumesFromImageTest-98408093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:53:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0e808eb1-35d0-49f8-95a4-498db537e4c6 tempest-CreateVolumesFromImageTest-98408093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.581s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:53:40 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0e808eb1-35d0-49f8-95a4-498db537e4c6 tempest-CreateVolumesFromImageTest-98408093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:53:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1829055108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c025e0f-b6b0-4cde-af96-99bf41acb2d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbc724133b194ac8b144423f7621e7ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:53:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:53:40Z,use_quota=True,user_id='1f99a1dbc0184ed4a0cc3e5e235cdfaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:53:40 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-0e808eb1-35d0-49f8-95a4-498db537e4c6 tempest-CreateVolumesFromImageTest-98408093 None] Creating volume 9c025e0f-b6b0-4cde-af96-99bf41acb2d6 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:53:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0e808eb1-35d0-49f8-95a4-498db537e4c6 tempest-CreateVolumesFromImageTest-98408093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:53:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0e808eb1-35d0-49f8-95a4-498db537e4c6 tempest-CreateVolumesFromImageTest-98408093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:53:40 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0e808eb1-35d0-49f8-95a4-498db537e4c6 tempest-CreateVolumesFromImageTest-98408093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:53:40 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0e808eb1-35d0-49f8-95a4-498db537e4c6 tempest-CreateVolumesFromImageTest-98408093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:53:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0e808eb1-35d0-49f8-95a4-498db537e4c6 tempest-CreateVolumesFromImageTest-98408093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:53:40 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0e808eb1-35d0-49f8-95a4-498db537e4c6 tempest-CreateVolumesFromImageTest-98408093 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:53:40 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-0e808eb1-35d0-49f8-95a4-498db537e4c6 tempest-CreateVolumesFromImageTest-98408093 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:53:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0e808eb1-35d0-49f8-95a4-498db537e4c6 tempest-CreateVolumesFromImageTest-98408093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9c025e0f-b6b0-4cde-af96-99bf41acb2d6 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:40 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=85,cinder:INSERT=28,cinder:UPDATE=119,cinder:DELETE=11 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:53:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a1bb0fff-d83b-463d-9849-602e9aa035a9 tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d650d33e-825d-4baa-81b7-c902a75a421c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60844c25-e42b-421c-b0ee-ebbc778f7a2a', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:40 devstack sudo[112602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9c025e0f-b6b0-4cde-af96-99bf41acb2d6 1073741824 Aug 11 04:53:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a1bb0fff-d83b-463d-9849-602e9aa035a9 tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb86dffa-8459-4836-9cff-c1905fcc3c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:40 devstack sudo[112602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:40 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-a1bb0fff-d83b-463d-9849-602e9aa035a9 tempest-CreateVolumesFromImageTest-98408093 None] Volume volume-60844c25-e42b-421c-b0ee-ebbc778f7a2a (60844c25-e42b-421c-b0ee-ebbc778f7a2a): created successfully Aug 11 04:53:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a1bb0fff-d83b-463d-9849-602e9aa035a9 tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb86dffa-8459-4836-9cff-c1905fcc3c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a1bb0fff-d83b-463d-9849-602e9aa035a9 tempest-CreateVolumesFromImageTest-98408093 None] Flow 'volume_create_manager' (5834afbc-a637-48a2-b168-00b81b023583) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:53:41 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-a1bb0fff-d83b-463d-9849-602e9aa035a9 tempest-CreateVolumesFromImageTest-98408093 None] Created volume successfully. Aug 11 04:53:41 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d2b32d7-5e1c-4e64-8340-4db17b66dcf0 tempest-CreateVolumesFromImageTest-98408093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:53:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7d2b32d7-5e1c-4e64-8340-4db17b66dcf0 tempest-CreateVolumesFromImageTest-98408093 None] Flow 'volume_create_manager' (c9a76e16-7d2e-40bd-8a3c-a2f699c79060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:53:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7d2b32d7-5e1c-4e64-8340-4db17b66dcf0 tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b9189e8-4742-4484-9c23-05c3c4bd30ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7d2b32d7-5e1c-4e64-8340-4db17b66dcf0 tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b9189e8-4742-4484-9c23-05c3c4bd30ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1190243007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=075b903d-20b0-437b-b871-185eb45e21ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbc724133b194ac8b144423f7621e7ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:53:41Z,use_quota=True,user_id='1f99a1dbc0184ed4a0cc3e5e235cdfaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7d2b32d7-5e1c-4e64-8340-4db17b66dcf0 tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61d7ac19-ad48-4170-b844-ce76843c7d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7d2b32d7-5e1c-4e64-8340-4db17b66dcf0 tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61d7ac19-ad48-4170-b844-ce76843c7d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7d2b32d7-5e1c-4e64-8340-4db17b66dcf0 tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c2c1ba3-4b7e-485d-ba72-7484574e6e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7d2b32d7-5e1c-4e64-8340-4db17b66dcf0 tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c2c1ba3-4b7e-485d-ba72-7484574e6e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '075b903d-20b0-437b-b871-185eb45e21ec', 'volume_name': 'volume-075b903d-20b0-437b-b871-185eb45e21ec', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7d2b32d7-5e1c-4e64-8340-4db17b66dcf0 tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79b58a03-7419-4202-a0b3-13f01973f762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7d2b32d7-5e1c-4e64-8340-4db17b66dcf0 tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79b58a03-7419-4202-a0b3-13f01973f762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7d2b32d7-5e1c-4e64-8340-4db17b66dcf0 tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75df909f-92fd-40b9-9c4d-87440d85df1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:41 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-7d2b32d7-5e1c-4e64-8340-4db17b66dcf0 tempest-CreateVolumesFromImageTest-98408093 None] Volume 075b903d-20b0-437b-b871-185eb45e21ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-075b903d-20b0-437b-b871-185eb45e21ec', 'volume_size': 1} Aug 11 04:53:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7d2b32d7-5e1c-4e64-8340-4db17b66dcf0 tempest-CreateVolumesFromImageTest-98408093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:53:41 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-13126e88-4c0a-4895-ab45-799ccca53097 tempest-CreateVolumesFromImageTest-98408093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:53:41 devstack sudo[112602]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-13126e88-4c0a-4895-ab45-799ccca53097 tempest-CreateVolumesFromImageTest-98408093 None] Flow 'volume_create_manager' (5737e465-63ae-40b1-8c8c-75ebab7e9ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:53:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-13126e88-4c0a-4895-ab45-799ccca53097 tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28202bd6-f2bb-48a5-bae9-fa02a6985f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0e808eb1-35d0-49f8-95a4-498db537e4c6 tempest-CreateVolumesFromImageTest-98408093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9c025e0f-b6b0-4cde-af96-99bf41acb2d6 1073741824" returned: 0 in 0.669s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-13126e88-4c0a-4895-ab45-799ccca53097 tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28202bd6-f2bb-48a5-bae9-fa02a6985f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1453608708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1fea4b6-1909-4ab7-a117-ffe084df5b42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbc724133b194ac8b144423f7621e7ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:53:41Z,use_quota=True,user_id='1f99a1dbc0184ed4a0cc3e5e235cdfaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-13126e88-4c0a-4895-ab45-799ccca53097 tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c599580-ac95-46e8-a154-e3ce8fe05ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-13126e88-4c0a-4895-ab45-799ccca53097 tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c599580-ac95-46e8-a154-e3ce8fe05ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-13126e88-4c0a-4895-ab45-799ccca53097 tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d0d69fb-172a-452e-934d-4ddc1f0bd8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-13126e88-4c0a-4895-ab45-799ccca53097 tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d0d69fb-172a-452e-934d-4ddc1f0bd8cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1fea4b6-1909-4ab7-a117-ffe084df5b42', 'volume_name': 'volume-e1fea4b6-1909-4ab7-a117-ffe084df5b42', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-13126e88-4c0a-4895-ab45-799ccca53097 tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9cf2f57-2071-48f2-9795-eea4e70354ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-13126e88-4c0a-4895-ab45-799ccca53097 tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9cf2f57-2071-48f2-9795-eea4e70354ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-13126e88-4c0a-4895-ab45-799ccca53097 tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e4dfac8-eb12-4f6f-81b0-38b1a87d1056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:41 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-13126e88-4c0a-4895-ab45-799ccca53097 tempest-CreateVolumesFromImageTest-98408093 None] Volume e1fea4b6-1909-4ab7-a117-ffe084df5b42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1fea4b6-1909-4ab7-a117-ffe084df5b42', 'volume_size': 1} Aug 11 04:53:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-13126e88-4c0a-4895-ab45-799ccca53097 tempest-CreateVolumesFromImageTest-98408093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:53:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0e808eb1-35d0-49f8-95a4-498db537e4c6 tempest-CreateVolumesFromImageTest-98408093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9c025e0f-b6b0-4cde-af96-99bf41acb2d6 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:41 devstack sudo[112608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9c025e0f-b6b0-4cde-af96-99bf41acb2d6 Aug 11 04:53:41 devstack sudo[112608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:41 devstack sudo[112608]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0e808eb1-35d0-49f8-95a4-498db537e4c6 tempest-CreateVolumesFromImageTest-98408093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9c025e0f-b6b0-4cde-af96-99bf41acb2d6" returned: 0 in 0.262s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0e808eb1-35d0-49f8-95a4-498db537e4c6 tempest-CreateVolumesFromImageTest-98408093 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:53:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0e808eb1-35d0-49f8-95a4-498db537e4c6 tempest-CreateVolumesFromImageTest-98408093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:53:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1e92f2c0-f8bb-4b55-ba88-e50f49d4dbfa tempest-CreateVolumesFromImageTest-98408093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.102s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:53:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1e92f2c0-f8bb-4b55-ba88-e50f49d4dbfa tempest-CreateVolumesFromImageTest-98408093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:53:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2001516996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=064df28b-d85f-403d-9a7b-c8e0e98c94c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbc724133b194ac8b144423f7621e7ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:53:41Z,use_quota=True,user_id='1f99a1dbc0184ed4a0cc3e5e235cdfaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:53:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-1e92f2c0-f8bb-4b55-ba88-e50f49d4dbfa tempest-CreateVolumesFromImageTest-98408093 None] Creating volume 064df28b-d85f-403d-9a7b-c8e0e98c94c5 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:53:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1e92f2c0-f8bb-4b55-ba88-e50f49d4dbfa tempest-CreateVolumesFromImageTest-98408093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:53:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1e92f2c0-f8bb-4b55-ba88-e50f49d4dbfa tempest-CreateVolumesFromImageTest-98408093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:53:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1e92f2c0-f8bb-4b55-ba88-e50f49d4dbfa tempest-CreateVolumesFromImageTest-98408093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:53:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1e92f2c0-f8bb-4b55-ba88-e50f49d4dbfa tempest-CreateVolumesFromImageTest-98408093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:53:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1e92f2c0-f8bb-4b55-ba88-e50f49d4dbfa tempest-CreateVolumesFromImageTest-98408093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:53:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1e92f2c0-f8bb-4b55-ba88-e50f49d4dbfa tempest-CreateVolumesFromImageTest-98408093 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:53:41 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-1e92f2c0-f8bb-4b55-ba88-e50f49d4dbfa tempest-CreateVolumesFromImageTest-98408093 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:53:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1e92f2c0-f8bb-4b55-ba88-e50f49d4dbfa tempest-CreateVolumesFromImageTest-98408093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-064df28b-d85f-403d-9a7b-c8e0e98c94c5 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0e808eb1-35d0-49f8-95a4-498db537e4c6 tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9e1fc23-4329-4de3-b672-bd979147ee26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c025e0f-b6b0-4cde-af96-99bf41acb2d6', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:41 devstack sudo[112611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-064df28b-d85f-403d-9a7b-c8e0e98c94c5 1073741824 Aug 11 04:53:41 devstack sudo[112611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0e808eb1-35d0-49f8-95a4-498db537e4c6 tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43b5ba90-ae3c-4bb1-8351-46c0e8798524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:42 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-0e808eb1-35d0-49f8-95a4-498db537e4c6 tempest-CreateVolumesFromImageTest-98408093 None] Volume volume-9c025e0f-b6b0-4cde-af96-99bf41acb2d6 (9c025e0f-b6b0-4cde-af96-99bf41acb2d6): created successfully Aug 11 04:53:42 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0e808eb1-35d0-49f8-95a4-498db537e4c6 tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43b5ba90-ae3c-4bb1-8351-46c0e8798524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:42 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0e808eb1-35d0-49f8-95a4-498db537e4c6 tempest-CreateVolumesFromImageTest-98408093 None] Flow 'volume_create_manager' (6c1cdd09-f5ad-4fa3-bed7-9acae1b10022) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:53:42 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-0e808eb1-35d0-49f8-95a4-498db537e4c6 tempest-CreateVolumesFromImageTest-98408093 None] Created volume successfully. Aug 11 04:53:42 devstack sudo[112611]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1e92f2c0-f8bb-4b55-ba88-e50f49d4dbfa tempest-CreateVolumesFromImageTest-98408093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-064df28b-d85f-403d-9a7b-c8e0e98c94c5 1073741824" returned: 0 in 0.458s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1e92f2c0-f8bb-4b55-ba88-e50f49d4dbfa tempest-CreateVolumesFromImageTest-98408093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-064df28b-d85f-403d-9a7b-c8e0e98c94c5 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:42 devstack sudo[112619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-064df28b-d85f-403d-9a7b-c8e0e98c94c5 Aug 11 04:53:42 devstack sudo[112619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:42 devstack sudo[112619]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1e92f2c0-f8bb-4b55-ba88-e50f49d4dbfa tempest-CreateVolumesFromImageTest-98408093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-064df28b-d85f-403d-9a7b-c8e0e98c94c5" returned: 0 in 0.263s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:42 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1e92f2c0-f8bb-4b55-ba88-e50f49d4dbfa tempest-CreateVolumesFromImageTest-98408093 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:53:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1e92f2c0-f8bb-4b55-ba88-e50f49d4dbfa tempest-CreateVolumesFromImageTest-98408093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:53:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7d2b32d7-5e1c-4e64-8340-4db17b66dcf0 tempest-CreateVolumesFromImageTest-98408093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.510s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:53:42 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7d2b32d7-5e1c-4e64-8340-4db17b66dcf0 tempest-CreateVolumesFromImageTest-98408093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1190243007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=075b903d-20b0-437b-b871-185eb45e21ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbc724133b194ac8b144423f7621e7ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:53:41Z,use_quota=True,user_id='1f99a1dbc0184ed4a0cc3e5e235cdfaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:53:42 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-7d2b32d7-5e1c-4e64-8340-4db17b66dcf0 tempest-CreateVolumesFromImageTest-98408093 None] Creating volume 075b903d-20b0-437b-b871-185eb45e21ec {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:53:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7d2b32d7-5e1c-4e64-8340-4db17b66dcf0 tempest-CreateVolumesFromImageTest-98408093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:53:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7d2b32d7-5e1c-4e64-8340-4db17b66dcf0 tempest-CreateVolumesFromImageTest-98408093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:53:42 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7d2b32d7-5e1c-4e64-8340-4db17b66dcf0 tempest-CreateVolumesFromImageTest-98408093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:53:42 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7d2b32d7-5e1c-4e64-8340-4db17b66dcf0 tempest-CreateVolumesFromImageTest-98408093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:53:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7d2b32d7-5e1c-4e64-8340-4db17b66dcf0 tempest-CreateVolumesFromImageTest-98408093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:53:42 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7d2b32d7-5e1c-4e64-8340-4db17b66dcf0 tempest-CreateVolumesFromImageTest-98408093 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:53:42 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-7d2b32d7-5e1c-4e64-8340-4db17b66dcf0 tempest-CreateVolumesFromImageTest-98408093 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:53:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7d2b32d7-5e1c-4e64-8340-4db17b66dcf0 tempest-CreateVolumesFromImageTest-98408093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-075b903d-20b0-437b-b871-185eb45e21ec 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:42 devstack sudo[112622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-075b903d-20b0-437b-b871-185eb45e21ec 1073741824 Aug 11 04:53:42 devstack sudo[112622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:42 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1e92f2c0-f8bb-4b55-ba88-e50f49d4dbfa tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dac6fe7-5857-4e3e-8595-d26b2c87b19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-064df28b-d85f-403d-9a7b-c8e0e98c94c5', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:42 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1e92f2c0-f8bb-4b55-ba88-e50f49d4dbfa tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9f8b0be-55c5-42af-8ca9-dc9e376d183b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:42 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-1e92f2c0-f8bb-4b55-ba88-e50f49d4dbfa tempest-CreateVolumesFromImageTest-98408093 None] Volume volume-064df28b-d85f-403d-9a7b-c8e0e98c94c5 (064df28b-d85f-403d-9a7b-c8e0e98c94c5): created successfully Aug 11 04:53:42 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1e92f2c0-f8bb-4b55-ba88-e50f49d4dbfa tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9f8b0be-55c5-42af-8ca9-dc9e376d183b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:42 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1e92f2c0-f8bb-4b55-ba88-e50f49d4dbfa tempest-CreateVolumesFromImageTest-98408093 None] Flow 'volume_create_manager' (08d7a958-4d23-4b33-8190-49ecb5059417) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:53:42 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-1e92f2c0-f8bb-4b55-ba88-e50f49d4dbfa tempest-CreateVolumesFromImageTest-98408093 None] Created volume successfully. Aug 11 04:53:43 devstack sudo[112622]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7d2b32d7-5e1c-4e64-8340-4db17b66dcf0 tempest-CreateVolumesFromImageTest-98408093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-075b903d-20b0-437b-b871-185eb45e21ec 1073741824" returned: 0 in 0.451s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7d2b32d7-5e1c-4e64-8340-4db17b66dcf0 tempest-CreateVolumesFromImageTest-98408093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-075b903d-20b0-437b-b871-185eb45e21ec {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:43 devstack sudo[112628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-075b903d-20b0-437b-b871-185eb45e21ec Aug 11 04:53:43 devstack sudo[112628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:43 devstack sudo[112628]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7d2b32d7-5e1c-4e64-8340-4db17b66dcf0 tempest-CreateVolumesFromImageTest-98408093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-075b903d-20b0-437b-b871-185eb45e21ec" returned: 0 in 0.247s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:43 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7d2b32d7-5e1c-4e64-8340-4db17b66dcf0 tempest-CreateVolumesFromImageTest-98408093 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:53:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7d2b32d7-5e1c-4e64-8340-4db17b66dcf0 tempest-CreateVolumesFromImageTest-98408093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:53:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-13126e88-4c0a-4895-ab45-799ccca53097 tempest-CreateVolumesFromImageTest-98408093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.856s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:53:43 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-13126e88-4c0a-4895-ab45-799ccca53097 tempest-CreateVolumesFromImageTest-98408093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1453608708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1fea4b6-1909-4ab7-a117-ffe084df5b42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbc724133b194ac8b144423f7621e7ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:53:41Z,use_quota=True,user_id='1f99a1dbc0184ed4a0cc3e5e235cdfaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:53:43 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-13126e88-4c0a-4895-ab45-799ccca53097 tempest-CreateVolumesFromImageTest-98408093 None] Creating volume e1fea4b6-1909-4ab7-a117-ffe084df5b42 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:53:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-13126e88-4c0a-4895-ab45-799ccca53097 tempest-CreateVolumesFromImageTest-98408093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:53:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-13126e88-4c0a-4895-ab45-799ccca53097 tempest-CreateVolumesFromImageTest-98408093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:53:43 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-13126e88-4c0a-4895-ab45-799ccca53097 tempest-CreateVolumesFromImageTest-98408093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:53:43 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-13126e88-4c0a-4895-ab45-799ccca53097 tempest-CreateVolumesFromImageTest-98408093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:53:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-13126e88-4c0a-4895-ab45-799ccca53097 tempest-CreateVolumesFromImageTest-98408093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:53:43 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-13126e88-4c0a-4895-ab45-799ccca53097 tempest-CreateVolumesFromImageTest-98408093 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:53:43 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-13126e88-4c0a-4895-ab45-799ccca53097 tempest-CreateVolumesFromImageTest-98408093 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:53:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-13126e88-4c0a-4895-ab45-799ccca53097 tempest-CreateVolumesFromImageTest-98408093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e1fea4b6-1909-4ab7-a117-ffe084df5b42 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7d2b32d7-5e1c-4e64-8340-4db17b66dcf0 tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75df909f-92fd-40b9-9c4d-87440d85df1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-075b903d-20b0-437b-b871-185eb45e21ec', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7d2b32d7-5e1c-4e64-8340-4db17b66dcf0 tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (547135b6-c2c2-49c9-8129-7d813b61d9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:43 devstack sudo[112632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e1fea4b6-1909-4ab7-a117-ffe084df5b42 1073741824 Aug 11 04:53:43 devstack sudo[112632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:43 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-7d2b32d7-5e1c-4e64-8340-4db17b66dcf0 tempest-CreateVolumesFromImageTest-98408093 None] Volume volume-075b903d-20b0-437b-b871-185eb45e21ec (075b903d-20b0-437b-b871-185eb45e21ec): created successfully Aug 11 04:53:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7d2b32d7-5e1c-4e64-8340-4db17b66dcf0 tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (547135b6-c2c2-49c9-8129-7d813b61d9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7d2b32d7-5e1c-4e64-8340-4db17b66dcf0 tempest-CreateVolumesFromImageTest-98408093 None] Flow 'volume_create_manager' (c9a76e16-7d2e-40bd-8a3c-a2f699c79060) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:53:43 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-7d2b32d7-5e1c-4e64-8340-4db17b66dcf0 tempest-CreateVolumesFromImageTest-98408093 None] Created volume successfully. Aug 11 04:53:43 devstack sudo[112632]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-13126e88-4c0a-4895-ab45-799ccca53097 tempest-CreateVolumesFromImageTest-98408093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e1fea4b6-1909-4ab7-a117-ffe084df5b42 1073741824" returned: 0 in 0.482s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-13126e88-4c0a-4895-ab45-799ccca53097 tempest-CreateVolumesFromImageTest-98408093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e1fea4b6-1909-4ab7-a117-ffe084df5b42 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:44 devstack sudo[112638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e1fea4b6-1909-4ab7-a117-ffe084df5b42 Aug 11 04:53:44 devstack sudo[112638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:44 devstack sudo[112638]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-13126e88-4c0a-4895-ab45-799ccca53097 tempest-CreateVolumesFromImageTest-98408093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e1fea4b6-1909-4ab7-a117-ffe084df5b42" returned: 0 in 0.284s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:44 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-13126e88-4c0a-4895-ab45-799ccca53097 tempest-CreateVolumesFromImageTest-98408093 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:53:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-13126e88-4c0a-4895-ab45-799ccca53097 tempest-CreateVolumesFromImageTest-98408093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:53:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-13126e88-4c0a-4895-ab45-799ccca53097 tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e4dfac8-eb12-4f6f-81b0-38b1a87d1056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1fea4b6-1909-4ab7-a117-ffe084df5b42', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-13126e88-4c0a-4895-ab45-799ccca53097 tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61d5bd3f-756f-40a5-828f-d900306be908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:44 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-13126e88-4c0a-4895-ab45-799ccca53097 tempest-CreateVolumesFromImageTest-98408093 None] Volume volume-e1fea4b6-1909-4ab7-a117-ffe084df5b42 (e1fea4b6-1909-4ab7-a117-ffe084df5b42): created successfully Aug 11 04:53:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-13126e88-4c0a-4895-ab45-799ccca53097 tempest-CreateVolumesFromImageTest-98408093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61d5bd3f-756f-40a5-828f-d900306be908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-13126e88-4c0a-4895-ab45-799ccca53097 tempest-CreateVolumesFromImageTest-98408093 None] Flow 'volume_create_manager' (5737e465-63ae-40b1-8c8c-75ebab7e9ae5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:53:44 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-13126e88-4c0a-4895-ab45-799ccca53097 tempest-CreateVolumesFromImageTest-98408093 None] Created volume successfully. Aug 11 04:53:44 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-88f1a601-08a1-4155-8429-92b080f68812 tempest-CreateVolumesFromImageTest-98408093 None] Acquiring lock "cinder-e1fea4b6-1909-4ab7-a117-ffe084df5b42-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:53:44 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-88f1a601-08a1-4155-8429-92b080f68812 tempest-CreateVolumesFromImageTest-98408093 None] Lock "cinder-e1fea4b6-1909-4ab7-a117-ffe084df5b42-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:53:44 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-88f1a601-08a1-4155-8429-92b080f68812 tempest-CreateVolumesFromImageTest-98408093 None] Acquiring lock "cinder-quobyte-e1fea4b6-1909-4ab7-a117-ffe084df5b42" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:53:44 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-88f1a601-08a1-4155-8429-92b080f68812 tempest-CreateVolumesFromImageTest-98408093 None] Lock "cinder-quobyte-e1fea4b6-1909-4ab7-a117-ffe084df5b42" acquired by "delete_volume" :: waited 0.017s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:53:45 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2a481c-5bd6-44b1-a694-548424153f8f]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:53:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-88f1a601-08a1-4155-8429-92b080f68812 tempest-CreateVolumesFromImageTest-98408093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e1fea4b6-1909-4ab7-a117-ffe084df5b42 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:45 devstack sudo[112641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e1fea4b6-1909-4ab7-a117-ffe084df5b42 Aug 11 04:53:45 devstack sudo[112641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:45 devstack sudo[112641]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-88f1a601-08a1-4155-8429-92b080f68812 tempest-CreateVolumesFromImageTest-98408093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e1fea4b6-1909-4ab7-a117-ffe084df5b42" returned: 0 in 0.371s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-88f1a601-08a1-4155-8429-92b080f68812 tempest-CreateVolumesFromImageTest-98408093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e1fea4b6-1909-4ab7-a117-ffe084df5b42 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:45 devstack sudo[112646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e1fea4b6-1909-4ab7-a117-ffe084df5b42 Aug 11 04:53:45 devstack sudo[112646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:45 devstack sudo[112646]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-88f1a601-08a1-4155-8429-92b080f68812 tempest-CreateVolumesFromImageTest-98408093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e1fea4b6-1909-4ab7-a117-ffe084df5b42" returned: 0 in 0.260s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:45 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-88f1a601-08a1-4155-8429-92b080f68812 tempest-CreateVolumesFromImageTest-98408093 None] Lock "cinder-quobyte-e1fea4b6-1909-4ab7-a117-ffe084df5b42" released by "delete_volume" :: held 0.670s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:53:45 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-88f1a601-08a1-4155-8429-92b080f68812 tempest-CreateVolumesFromImageTest-98408093 None] Created reservations ['5811544c-2aa5-4cdb-83b3-7496f4ecfafa', '09733345-ca4e-4094-8fbc-842137815fd9', '578a4ee9-df4e-4b9e-b49b-3055f27f1aec', 'ba933dcd-8b66-40cb-9b4e-8057fdc52c83'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:53:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-88f1a601-08a1-4155-8429-92b080f68812 tempest-CreateVolumesFromImageTest-98408093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:53:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-88f1a601-08a1-4155-8429-92b080f68812 tempest-CreateVolumesFromImageTest-98408093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:53:45 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-88f1a601-08a1-4155-8429-92b080f68812 tempest-CreateVolumesFromImageTest-98408093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:53:45 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-88f1a601-08a1-4155-8429-92b080f68812 tempest-CreateVolumesFromImageTest-98408093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:53:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-88f1a601-08a1-4155-8429-92b080f68812 tempest-CreateVolumesFromImageTest-98408093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:53:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-88f1a601-08a1-4155-8429-92b080f68812 tempest-CreateVolumesFromImageTest-98408093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:45 devstack sudo[112649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:53:45 devstack sudo[112649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:46 devstack sudo[112649]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-88f1a601-08a1-4155-8429-92b080f68812 tempest-CreateVolumesFromImageTest-98408093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.256s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:46 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-88f1a601-08a1-4155-8429-92b080f68812 tempest-CreateVolumesFromImageTest-98408093 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:53:46 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-88f1a601-08a1-4155-8429-92b080f68812 tempest-CreateVolumesFromImageTest-98408093 None] Deleted volume successfully. Aug 11 04:53:46 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-88f1a601-08a1-4155-8429-92b080f68812 tempest-CreateVolumesFromImageTest-98408093 None] Lock "cinder-e1fea4b6-1909-4ab7-a117-ffe084df5b42-delete_volume" released by "delete_volume" :: held 1.162s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:53:46 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fd9c7478-60e5-4f56-8ac6-be601ae66a86 tempest-CreateVolumesFromImageTest-98408093 None] Acquiring lock "cinder-075b903d-20b0-437b-b871-185eb45e21ec-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:53:46 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fd9c7478-60e5-4f56-8ac6-be601ae66a86 tempest-CreateVolumesFromImageTest-98408093 None] Lock "cinder-075b903d-20b0-437b-b871-185eb45e21ec-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:53:46 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fd9c7478-60e5-4f56-8ac6-be601ae66a86 tempest-CreateVolumesFromImageTest-98408093 None] Acquiring lock "cinder-quobyte-075b903d-20b0-437b-b871-185eb45e21ec" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:53:46 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fd9c7478-60e5-4f56-8ac6-be601ae66a86 tempest-CreateVolumesFromImageTest-98408093 None] Lock "cinder-quobyte-075b903d-20b0-437b-b871-185eb45e21ec" acquired by "delete_volume" :: waited 0.017s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:53:46 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15e4649-40f8-4100-8781-014384554c33]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:53:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fd9c7478-60e5-4f56-8ac6-be601ae66a86 tempest-CreateVolumesFromImageTest-98408093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-075b903d-20b0-437b-b871-185eb45e21ec {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:46 devstack sudo[112652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-075b903d-20b0-437b-b871-185eb45e21ec Aug 11 04:53:46 devstack sudo[112652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:46 devstack sudo[112652]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fd9c7478-60e5-4f56-8ac6-be601ae66a86 tempest-CreateVolumesFromImageTest-98408093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-075b903d-20b0-437b-b871-185eb45e21ec" returned: 0 in 0.385s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fd9c7478-60e5-4f56-8ac6-be601ae66a86 tempest-CreateVolumesFromImageTest-98408093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-075b903d-20b0-437b-b871-185eb45e21ec {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:46 devstack sudo[112657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-075b903d-20b0-437b-b871-185eb45e21ec Aug 11 04:53:46 devstack sudo[112657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:46 devstack sudo[112657]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fd9c7478-60e5-4f56-8ac6-be601ae66a86 tempest-CreateVolumesFromImageTest-98408093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-075b903d-20b0-437b-b871-185eb45e21ec" returned: 0 in 0.268s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:46 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fd9c7478-60e5-4f56-8ac6-be601ae66a86 tempest-CreateVolumesFromImageTest-98408093 None] Lock "cinder-quobyte-075b903d-20b0-437b-b871-185eb45e21ec" released by "delete_volume" :: held 0.695s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:53:46 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-fd9c7478-60e5-4f56-8ac6-be601ae66a86 tempest-CreateVolumesFromImageTest-98408093 None] Created reservations ['53d228b6-5135-4b9a-9d31-003499fd1f9b', 'b573c4cf-6e82-41be-8357-01cd674bda16', 'c6f1fbe3-98b9-4de2-b792-84be3be8b007', '1811739b-aa7b-4a09-9c59-b5944b810d7e'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:53:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fd9c7478-60e5-4f56-8ac6-be601ae66a86 tempest-CreateVolumesFromImageTest-98408093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:53:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fd9c7478-60e5-4f56-8ac6-be601ae66a86 tempest-CreateVolumesFromImageTest-98408093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:53:46 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-fd9c7478-60e5-4f56-8ac6-be601ae66a86 tempest-CreateVolumesFromImageTest-98408093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:53:47 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-fd9c7478-60e5-4f56-8ac6-be601ae66a86 tempest-CreateVolumesFromImageTest-98408093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:53:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fd9c7478-60e5-4f56-8ac6-be601ae66a86 tempest-CreateVolumesFromImageTest-98408093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:53:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fd9c7478-60e5-4f56-8ac6-be601ae66a86 tempest-CreateVolumesFromImageTest-98408093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:47 devstack sudo[112660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:53:47 devstack sudo[112660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:47 devstack sudo[112660]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fd9c7478-60e5-4f56-8ac6-be601ae66a86 tempest-CreateVolumesFromImageTest-98408093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.270s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:47 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-fd9c7478-60e5-4f56-8ac6-be601ae66a86 tempest-CreateVolumesFromImageTest-98408093 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:53:47 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-fd9c7478-60e5-4f56-8ac6-be601ae66a86 tempest-CreateVolumesFromImageTest-98408093 None] Deleted volume successfully. Aug 11 04:53:47 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-642094ba-f056-40bb-84c5-32640d9368e7 tempest-CreateVolumesFromImageTest-98408093 None] Acquiring lock "cinder-064df28b-d85f-403d-9a7b-c8e0e98c94c5-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:53:47 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fd9c7478-60e5-4f56-8ac6-be601ae66a86 tempest-CreateVolumesFromImageTest-98408093 None] Lock "cinder-075b903d-20b0-437b-b871-185eb45e21ec-delete_volume" released by "delete_volume" :: held 1.197s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:53:47 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-642094ba-f056-40bb-84c5-32640d9368e7 tempest-CreateVolumesFromImageTest-98408093 None] Lock "cinder-064df28b-d85f-403d-9a7b-c8e0e98c94c5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:53:47 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-642094ba-f056-40bb-84c5-32640d9368e7 tempest-CreateVolumesFromImageTest-98408093 None] Acquiring lock "cinder-quobyte-064df28b-d85f-403d-9a7b-c8e0e98c94c5" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:53:47 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-642094ba-f056-40bb-84c5-32640d9368e7 tempest-CreateVolumesFromImageTest-98408093 None] Lock "cinder-quobyte-064df28b-d85f-403d-9a7b-c8e0e98c94c5" acquired by "delete_volume" :: waited 0.017s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:53:47 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aed6f09-6525-451b-b2a8-ce8112bea82c]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:53:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-642094ba-f056-40bb-84c5-32640d9368e7 tempest-CreateVolumesFromImageTest-98408093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-064df28b-d85f-403d-9a7b-c8e0e98c94c5 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:47 devstack sudo[112663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-064df28b-d85f-403d-9a7b-c8e0e98c94c5 Aug 11 04:53:47 devstack sudo[112663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:47 devstack sudo[112663]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-642094ba-f056-40bb-84c5-32640d9368e7 tempest-CreateVolumesFromImageTest-98408093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-064df28b-d85f-403d-9a7b-c8e0e98c94c5" returned: 0 in 0.385s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-642094ba-f056-40bb-84c5-32640d9368e7 tempest-CreateVolumesFromImageTest-98408093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-064df28b-d85f-403d-9a7b-c8e0e98c94c5 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:47 devstack sudo[112669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-064df28b-d85f-403d-9a7b-c8e0e98c94c5 Aug 11 04:53:47 devstack sudo[112669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:48 devstack sudo[112669]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-642094ba-f056-40bb-84c5-32640d9368e7 tempest-CreateVolumesFromImageTest-98408093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-064df28b-d85f-403d-9a7b-c8e0e98c94c5" returned: 0 in 0.250s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:48 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-642094ba-f056-40bb-84c5-32640d9368e7 tempest-CreateVolumesFromImageTest-98408093 None] Lock "cinder-quobyte-064df28b-d85f-403d-9a7b-c8e0e98c94c5" released by "delete_volume" :: held 0.685s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:53:48 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-642094ba-f056-40bb-84c5-32640d9368e7 tempest-CreateVolumesFromImageTest-98408093 None] Created reservations ['ba7856c1-0097-4965-8f22-436dda4b9515', 'df987a7d-4b2b-40b0-9f17-f4029b4a101a', '5b16311d-e8bc-4ba3-b6fc-3e8bc9220650', '6fbf0c1f-c94e-4d84-82ee-d6fc692a75b5'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:53:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-642094ba-f056-40bb-84c5-32640d9368e7 tempest-CreateVolumesFromImageTest-98408093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:53:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-642094ba-f056-40bb-84c5-32640d9368e7 tempest-CreateVolumesFromImageTest-98408093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:53:48 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-642094ba-f056-40bb-84c5-32640d9368e7 tempest-CreateVolumesFromImageTest-98408093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:53:48 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-642094ba-f056-40bb-84c5-32640d9368e7 tempest-CreateVolumesFromImageTest-98408093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:53:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-642094ba-f056-40bb-84c5-32640d9368e7 tempest-CreateVolumesFromImageTest-98408093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:53:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-642094ba-f056-40bb-84c5-32640d9368e7 tempest-CreateVolumesFromImageTest-98408093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:48 devstack sudo[112672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:53:48 devstack sudo[112672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:48 devstack sudo[112672]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-642094ba-f056-40bb-84c5-32640d9368e7 tempest-CreateVolumesFromImageTest-98408093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.267s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:48 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-642094ba-f056-40bb-84c5-32640d9368e7 tempest-CreateVolumesFromImageTest-98408093 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:53:48 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-642094ba-f056-40bb-84c5-32640d9368e7 tempest-CreateVolumesFromImageTest-98408093 None] Deleted volume successfully. Aug 11 04:53:48 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-02c86482-8063-4f51-8471-9aaf921790ec tempest-CreateVolumesFromImageTest-98408093 None] Acquiring lock "cinder-9c025e0f-b6b0-4cde-af96-99bf41acb2d6-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:53:48 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-642094ba-f056-40bb-84c5-32640d9368e7 tempest-CreateVolumesFromImageTest-98408093 None] Lock "cinder-064df28b-d85f-403d-9a7b-c8e0e98c94c5-delete_volume" released by "delete_volume" :: held 1.180s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:53:48 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-02c86482-8063-4f51-8471-9aaf921790ec tempest-CreateVolumesFromImageTest-98408093 None] Lock "cinder-9c025e0f-b6b0-4cde-af96-99bf41acb2d6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:53:48 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-02c86482-8063-4f51-8471-9aaf921790ec tempest-CreateVolumesFromImageTest-98408093 None] Acquiring lock "cinder-quobyte-9c025e0f-b6b0-4cde-af96-99bf41acb2d6" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:53:48 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-02c86482-8063-4f51-8471-9aaf921790ec tempest-CreateVolumesFromImageTest-98408093 None] Lock "cinder-quobyte-9c025e0f-b6b0-4cde-af96-99bf41acb2d6" acquired by "delete_volume" :: waited 0.018s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:53:48 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d4ce80-917b-49a8-8904-c7e2f3f3b64b]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:53:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-02c86482-8063-4f51-8471-9aaf921790ec tempest-CreateVolumesFromImageTest-98408093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9c025e0f-b6b0-4cde-af96-99bf41acb2d6 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:48 devstack sudo[112675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9c025e0f-b6b0-4cde-af96-99bf41acb2d6 Aug 11 04:53:48 devstack sudo[112675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:49 devstack sudo[112675]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-02c86482-8063-4f51-8471-9aaf921790ec tempest-CreateVolumesFromImageTest-98408093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9c025e0f-b6b0-4cde-af96-99bf41acb2d6" returned: 0 in 0.381s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-02c86482-8063-4f51-8471-9aaf921790ec tempest-CreateVolumesFromImageTest-98408093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9c025e0f-b6b0-4cde-af96-99bf41acb2d6 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:49 devstack sudo[112680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9c025e0f-b6b0-4cde-af96-99bf41acb2d6 Aug 11 04:53:49 devstack sudo[112680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:49 devstack sudo[112680]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-02c86482-8063-4f51-8471-9aaf921790ec tempest-CreateVolumesFromImageTest-98408093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9c025e0f-b6b0-4cde-af96-99bf41acb2d6" returned: 0 in 0.274s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:49 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-02c86482-8063-4f51-8471-9aaf921790ec tempest-CreateVolumesFromImageTest-98408093 None] Lock "cinder-quobyte-9c025e0f-b6b0-4cde-af96-99bf41acb2d6" released by "delete_volume" :: held 0.705s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:53:49 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-02c86482-8063-4f51-8471-9aaf921790ec tempest-CreateVolumesFromImageTest-98408093 None] Created reservations ['1566c053-c5fd-4f3a-bd0d-d0fdd3d252ba', 'df71e43e-a105-413e-82a2-6e44f7db76ad', 'b34ee36a-2862-4e2a-b59c-7e6723c3b588', '37eb15d2-55e3-47e3-9928-024710d4f966'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:53:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-02c86482-8063-4f51-8471-9aaf921790ec tempest-CreateVolumesFromImageTest-98408093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:53:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-02c86482-8063-4f51-8471-9aaf921790ec tempest-CreateVolumesFromImageTest-98408093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:53:49 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-02c86482-8063-4f51-8471-9aaf921790ec tempest-CreateVolumesFromImageTest-98408093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:53:49 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-02c86482-8063-4f51-8471-9aaf921790ec tempest-CreateVolumesFromImageTest-98408093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:53:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-02c86482-8063-4f51-8471-9aaf921790ec tempest-CreateVolumesFromImageTest-98408093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:53:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-02c86482-8063-4f51-8471-9aaf921790ec tempest-CreateVolumesFromImageTest-98408093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:49 devstack sudo[112683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:53:49 devstack sudo[112683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:49 devstack sudo[112683]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-02c86482-8063-4f51-8471-9aaf921790ec tempest-CreateVolumesFromImageTest-98408093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.261s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:49 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-02c86482-8063-4f51-8471-9aaf921790ec tempest-CreateVolumesFromImageTest-98408093 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:53:49 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-02c86482-8063-4f51-8471-9aaf921790ec tempest-CreateVolumesFromImageTest-98408093 None] Deleted volume successfully. Aug 11 04:53:49 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-02c86482-8063-4f51-8471-9aaf921790ec tempest-CreateVolumesFromImageTest-98408093 None] Lock "cinder-9c025e0f-b6b0-4cde-af96-99bf41acb2d6-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:53:49 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a0b5b8e9-efcf-41c5-b9b5-a4a96b0c87f7 tempest-CreateVolumesFromImageTest-98408093 None] Acquiring lock "cinder-60844c25-e42b-421c-b0ee-ebbc778f7a2a-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:53:49 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a0b5b8e9-efcf-41c5-b9b5-a4a96b0c87f7 tempest-CreateVolumesFromImageTest-98408093 None] Lock "cinder-60844c25-e42b-421c-b0ee-ebbc778f7a2a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:53:49 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a0b5b8e9-efcf-41c5-b9b5-a4a96b0c87f7 tempest-CreateVolumesFromImageTest-98408093 None] Acquiring lock "cinder-quobyte-60844c25-e42b-421c-b0ee-ebbc778f7a2a" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:53:49 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a0b5b8e9-efcf-41c5-b9b5-a4a96b0c87f7 tempest-CreateVolumesFromImageTest-98408093 None] Lock "cinder-quobyte-60844c25-e42b-421c-b0ee-ebbc778f7a2a" acquired by "delete_volume" :: waited 0.020s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:53:49 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf99083-e1ba-4d6f-b97b-0af2f6db0f28]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:53:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a0b5b8e9-efcf-41c5-b9b5-a4a96b0c87f7 tempest-CreateVolumesFromImageTest-98408093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-60844c25-e42b-421c-b0ee-ebbc778f7a2a {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:49 devstack sudo[112686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-60844c25-e42b-421c-b0ee-ebbc778f7a2a Aug 11 04:53:49 devstack sudo[112686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:50 devstack sudo[112686]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a0b5b8e9-efcf-41c5-b9b5-a4a96b0c87f7 tempest-CreateVolumesFromImageTest-98408093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-60844c25-e42b-421c-b0ee-ebbc778f7a2a" returned: 0 in 0.384s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a0b5b8e9-efcf-41c5-b9b5-a4a96b0c87f7 tempest-CreateVolumesFromImageTest-98408093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-60844c25-e42b-421c-b0ee-ebbc778f7a2a {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:50 devstack sudo[112691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-60844c25-e42b-421c-b0ee-ebbc778f7a2a Aug 11 04:53:50 devstack sudo[112691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:50 devstack sudo[112691]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a0b5b8e9-efcf-41c5-b9b5-a4a96b0c87f7 tempest-CreateVolumesFromImageTest-98408093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-60844c25-e42b-421c-b0ee-ebbc778f7a2a" returned: 0 in 0.248s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:50 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a0b5b8e9-efcf-41c5-b9b5-a4a96b0c87f7 tempest-CreateVolumesFromImageTest-98408093 None] Lock "cinder-quobyte-60844c25-e42b-421c-b0ee-ebbc778f7a2a" released by "delete_volume" :: held 0.676s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:53:50 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-a0b5b8e9-efcf-41c5-b9b5-a4a96b0c87f7 tempest-CreateVolumesFromImageTest-98408093 None] Created reservations ['82650fa2-ea8d-4494-a180-29c8d17a8ad1', 'ccda0f71-0474-41bd-a9e9-52c90c34eb10', 'e9dee9c5-48ff-4e83-ad4c-b297d2072158', 'ff8221f2-9205-4444-ba46-a66a22b3013d'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:53:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a0b5b8e9-efcf-41c5-b9b5-a4a96b0c87f7 tempest-CreateVolumesFromImageTest-98408093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:53:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a0b5b8e9-efcf-41c5-b9b5-a4a96b0c87f7 tempest-CreateVolumesFromImageTest-98408093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:53:50 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a0b5b8e9-efcf-41c5-b9b5-a4a96b0c87f7 tempest-CreateVolumesFromImageTest-98408093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:53:50 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a0b5b8e9-efcf-41c5-b9b5-a4a96b0c87f7 tempest-CreateVolumesFromImageTest-98408093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:53:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a0b5b8e9-efcf-41c5-b9b5-a4a96b0c87f7 tempest-CreateVolumesFromImageTest-98408093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:53:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a0b5b8e9-efcf-41c5-b9b5-a4a96b0c87f7 tempest-CreateVolumesFromImageTest-98408093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:50 devstack sudo[112694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:53:50 devstack sudo[112694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:50 devstack sudo[112694]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a0b5b8e9-efcf-41c5-b9b5-a4a96b0c87f7 tempest-CreateVolumesFromImageTest-98408093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.275s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:50 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-a0b5b8e9-efcf-41c5-b9b5-a4a96b0c87f7 tempest-CreateVolumesFromImageTest-98408093 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:53:50 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-a0b5b8e9-efcf-41c5-b9b5-a4a96b0c87f7 tempest-CreateVolumesFromImageTest-98408093 None] Deleted volume successfully. Aug 11 04:53:50 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-596eb31e-7a03-4735-ad3b-17817ca68362 tempest-VolumesNegativeTest-1626520100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:53:50 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-596eb31e-7a03-4735-ad3b-17817ca68362 tempest-VolumesNegativeTest-1626520100 None] Flow 'volume_create_manager' (f17a2e7b-910a-4d7c-980e-f0d1140e3eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:53:50 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-596eb31e-7a03-4735-ad3b-17817ca68362 tempest-VolumesNegativeTest-1626520100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc5ab942-d6bb-49d3-8164-8c138935a72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:50 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a0b5b8e9-efcf-41c5-b9b5-a4a96b0c87f7 tempest-CreateVolumesFromImageTest-98408093 None] Lock "cinder-60844c25-e42b-421c-b0ee-ebbc778f7a2a-delete_volume" released by "delete_volume" :: held 1.213s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:53:50 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-596eb31e-7a03-4735-ad3b-17817ca68362 tempest-VolumesNegativeTest-1626520100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc5ab942-d6bb-49d3-8164-8c138935a72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1346995272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ba9c20a-de3f-4b4f-9d9e-95ca2dabf335,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1335393aae2d45f1b1a9e6e65faf56fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:53:51Z,use_quota=True,user_id='859f7c9afec34149a703a5cc1c94f8f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:50 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-596eb31e-7a03-4735-ad3b-17817ca68362 tempest-VolumesNegativeTest-1626520100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6729e57c-edb8-4ba5-915d-7af763bf2851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:50 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-596eb31e-7a03-4735-ad3b-17817ca68362 tempest-VolumesNegativeTest-1626520100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6729e57c-edb8-4ba5-915d-7af763bf2851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:50 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-596eb31e-7a03-4735-ad3b-17817ca68362 tempest-VolumesNegativeTest-1626520100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae3c027d-9943-4742-8e05-66008519a459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:50 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-596eb31e-7a03-4735-ad3b-17817ca68362 tempest-VolumesNegativeTest-1626520100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae3c027d-9943-4742-8e05-66008519a459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ba9c20a-de3f-4b4f-9d9e-95ca2dabf335', 'volume_name': 'volume-1ba9c20a-de3f-4b4f-9d9e-95ca2dabf335', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:50 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-596eb31e-7a03-4735-ad3b-17817ca68362 tempest-VolumesNegativeTest-1626520100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07a19427-99a7-4f8b-95a5-50482e437819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:50 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-596eb31e-7a03-4735-ad3b-17817ca68362 tempest-VolumesNegativeTest-1626520100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07a19427-99a7-4f8b-95a5-50482e437819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-596eb31e-7a03-4735-ad3b-17817ca68362 tempest-VolumesNegativeTest-1626520100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f8b1595-bac4-46fc-9602-6f6a8038715b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:51 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-596eb31e-7a03-4735-ad3b-17817ca68362 tempest-VolumesNegativeTest-1626520100 None] Volume 1ba9c20a-de3f-4b4f-9d9e-95ca2dabf335: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ba9c20a-de3f-4b4f-9d9e-95ca2dabf335', 'volume_size': 1} Aug 11 04:53:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-596eb31e-7a03-4735-ad3b-17817ca68362 tempest-VolumesNegativeTest-1626520100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:53:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-596eb31e-7a03-4735-ad3b-17817ca68362 tempest-VolumesNegativeTest-1626520100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:53:51 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-596eb31e-7a03-4735-ad3b-17817ca68362 tempest-VolumesNegativeTest-1626520100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1346995272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ba9c20a-de3f-4b4f-9d9e-95ca2dabf335,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1335393aae2d45f1b1a9e6e65faf56fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:53:51Z,use_quota=True,user_id='859f7c9afec34149a703a5cc1c94f8f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:53:51 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-596eb31e-7a03-4735-ad3b-17817ca68362 tempest-VolumesNegativeTest-1626520100 None] Creating volume 1ba9c20a-de3f-4b4f-9d9e-95ca2dabf335 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:53:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-596eb31e-7a03-4735-ad3b-17817ca68362 tempest-VolumesNegativeTest-1626520100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:53:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-596eb31e-7a03-4735-ad3b-17817ca68362 tempest-VolumesNegativeTest-1626520100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:53:51 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-596eb31e-7a03-4735-ad3b-17817ca68362 tempest-VolumesNegativeTest-1626520100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:53:51 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-596eb31e-7a03-4735-ad3b-17817ca68362 tempest-VolumesNegativeTest-1626520100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:53:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-596eb31e-7a03-4735-ad3b-17817ca68362 tempest-VolumesNegativeTest-1626520100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:53:51 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-596eb31e-7a03-4735-ad3b-17817ca68362 tempest-VolumesNegativeTest-1626520100 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:53:51 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-596eb31e-7a03-4735-ad3b-17817ca68362 tempest-VolumesNegativeTest-1626520100 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:53:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-596eb31e-7a03-4735-ad3b-17817ca68362 tempest-VolumesNegativeTest-1626520100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1ba9c20a-de3f-4b4f-9d9e-95ca2dabf335 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:51 devstack sudo[112697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1ba9c20a-de3f-4b4f-9d9e-95ca2dabf335 1073741824 Aug 11 04:53:51 devstack sudo[112697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:51 devstack sudo[112697]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-596eb31e-7a03-4735-ad3b-17817ca68362 tempest-VolumesNegativeTest-1626520100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1ba9c20a-de3f-4b4f-9d9e-95ca2dabf335 1073741824" returned: 0 in 0.429s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-596eb31e-7a03-4735-ad3b-17817ca68362 tempest-VolumesNegativeTest-1626520100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1ba9c20a-de3f-4b4f-9d9e-95ca2dabf335 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:51 devstack sudo[112703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1ba9c20a-de3f-4b4f-9d9e-95ca2dabf335 Aug 11 04:53:51 devstack sudo[112703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:51 devstack sudo[112703]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-596eb31e-7a03-4735-ad3b-17817ca68362 tempest-VolumesNegativeTest-1626520100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1ba9c20a-de3f-4b4f-9d9e-95ca2dabf335" returned: 0 in 0.283s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:51 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-596eb31e-7a03-4735-ad3b-17817ca68362 tempest-VolumesNegativeTest-1626520100 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:53:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-596eb31e-7a03-4735-ad3b-17817ca68362 tempest-VolumesNegativeTest-1626520100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:53:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-596eb31e-7a03-4735-ad3b-17817ca68362 tempest-VolumesNegativeTest-1626520100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f8b1595-bac4-46fc-9602-6f6a8038715b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ba9c20a-de3f-4b4f-9d9e-95ca2dabf335', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-596eb31e-7a03-4735-ad3b-17817ca68362 tempest-VolumesNegativeTest-1626520100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1010ac44-6c17-4079-9737-25d3a9b01f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:51 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-596eb31e-7a03-4735-ad3b-17817ca68362 tempest-VolumesNegativeTest-1626520100 None] Volume volume-1ba9c20a-de3f-4b4f-9d9e-95ca2dabf335 (1ba9c20a-de3f-4b4f-9d9e-95ca2dabf335): created successfully Aug 11 04:53:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-596eb31e-7a03-4735-ad3b-17817ca68362 tempest-VolumesNegativeTest-1626520100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1010ac44-6c17-4079-9737-25d3a9b01f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-596eb31e-7a03-4735-ad3b-17817ca68362 tempest-VolumesNegativeTest-1626520100 None] Flow 'volume_create_manager' (f17a2e7b-910a-4d7c-980e-f0d1140e3eef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:53:51 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-596eb31e-7a03-4735-ad3b-17817ca68362 tempest-VolumesNegativeTest-1626520100 None] Created volume successfully. Aug 11 04:53:56 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:53:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] Flow 'volume_create_manager' (fccd4901-8987-4abb-a716-f862f8864bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:53:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d7ef357-2f7a-4e7a-9c6f-f3028ad48542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d7ef357-2f7a-4e7a-9c6f-f3028ad48542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94fe8b8f-90a2-484f-9538-ebab25a068ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a75ee9f59e146e6950468ba496f6e6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:53:56Z,use_quota=True,user_id='b0fe38855f8e4edd9d206158556dc892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0692986-67bb-4c45-a360-100b890a7d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0692986-67bb-4c45-a360-100b890a7d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd842fe7-33c4-4e91-9eb6-5e8a31222b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:56 devstack cinder-volume[94472]: DEBUG cinder.image.glance [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] Creating Keystone auth plugin from conf {{(pid=94472) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 11 04:53:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd842fe7-33c4-4e91-9eb6-5e8a31222b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '94fe8b8f-90a2-484f-9538-ebab25a068ef', 'volume_name': 'volume-94fe8b8f-90a2-484f-9538-ebab25a068ef', 'volume_size': 1, 'image_id': 'ff9d5434-0713-41b0-b455-e184ce26d105', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ff9d5434-0713-41b0-b455-e184ce26d105', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9581369a44fd9a2d72c8e8075b7ab923', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5a75ee9f59e146e6950468ba496f6e6c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c9fcd3d5ea3c9e39ab3285c90d5156fc6c1c6fce1c30f2af96b7120aefc4ff9b83c4c540bb70ce1a99c715081404fd477e7d0d56b9ee079c5262206a83ea5da6', 'id': 'ff9d5434-0713-41b0-b455-e184ce26d105', 'created_at': datetime.datetime(2026, 8, 11, 2, 53, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 2, 53, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ff9d5434-0713-41b0-b455-e184ce26d105/file', 'properties': {}}, 'image_service': }' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ba8b471-b4a1-4dfe-afb6-9358b9b1c408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ba8b471-b4a1-4dfe-afb6-9358b9b1c408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:53:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11536233-0335-4411-b6fa-3d9b08d70d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:53:56 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] Volume 94fe8b8f-90a2-484f-9538-ebab25a068ef: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-94fe8b8f-90a2-484f-9538-ebab25a068ef', 'volume_size': 1, 'image_id': 'ff9d5434-0713-41b0-b455-e184ce26d105', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ff9d5434-0713-41b0-b455-e184ce26d105', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9581369a44fd9a2d72c8e8075b7ab923', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5a75ee9f59e146e6950468ba496f6e6c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c9fcd3d5ea3c9e39ab3285c90d5156fc6c1c6fce1c30f2af96b7120aefc4ff9b83c4c540bb70ce1a99c715081404fd477e7d0d56b9ee079c5262206a83ea5da6', 'id': 'ff9d5434-0713-41b0-b455-e184ce26d105', 'created_at': datetime.datetime(2026, 8, 11, 2, 53, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 2, 53, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ff9d5434-0713-41b0-b455-e184ce26d105/file', 'properties': {}}, 'image_service': } Aug 11 04:53:56 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] Trying to clone 94fe8b8f-90a2-484f-9538-ebab25a068ef from image ff9d5434-0713-41b0-b455-e184ce26d105 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ff9d5434-0713-41b0-b455-e184ce26d105', 'metadata': {}}]). {{(pid=94472) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 11 04:53:56 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ff9d5434-0713-41b0-b455-e184ce26d105_xp9ct9opdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 11 04:53:56 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] Image download 0.00 MB at 0.00 MB/s Aug 11 04:53:56 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e4f3b3-c685-4a24-b408-2340873472b8]: (4, 'raw') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:53:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff9d5434-0713-41b0-b455-e184ce26d105_xp9ct9opdevstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:57 devstack sudo[112727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff9d5434-0713-41b0-b455-e184ce26d105_xp9ct9opdevstack@QuobyteHD Aug 11 04:53:57 devstack sudo[112727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:57 devstack sudo[112727]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff9d5434-0713-41b0-b455-e184ce26d105_xp9ct9opdevstack@QuobyteHD" returned: 0 in 0.374s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff9d5434-0713-41b0-b455-e184ce26d105_xp9ct9opdevstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:57 devstack sudo[112731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff9d5434-0713-41b0-b455-e184ce26d105_xp9ct9opdevstack@QuobyteHD Aug 11 04:53:57 devstack sudo[112731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:57 devstack sudo[112731]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff9d5434-0713-41b0-b455-e184ce26d105_xp9ct9opdevstack@QuobyteHD" returned: 1 in 0.360s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff9d5434-0713-41b0-b455-e184ce26d105_xp9ct9opdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 11 04:53:57 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] Temporary image ff9d5434-0713-41b0-b455-e184ce26d105 is fetched for user b0fe38855f8e4edd9d206158556dc892. {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 11 04:53:57 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5d77c6-752c-4e7e-83f6-90038820855d]: (4, 'raw') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:53:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff9d5434-0713-41b0-b455-e184ce26d105_xp9ct9opdevstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:57 devstack sudo[112737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff9d5434-0713-41b0-b455-e184ce26d105_xp9ct9opdevstack@QuobyteHD Aug 11 04:53:57 devstack sudo[112737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:58 devstack sudo[112737]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff9d5434-0713-41b0-b455-e184ce26d105_xp9ct9opdevstack@QuobyteHD" returned: 0 in 0.332s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff9d5434-0713-41b0-b455-e184ce26d105_xp9ct9opdevstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:58 devstack sudo[112741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff9d5434-0713-41b0-b455-e184ce26d105_xp9ct9opdevstack@QuobyteHD Aug 11 04:53:58 devstack sudo[112741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:58 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 04:53:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:53:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:53:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:53:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:53:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:53:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:58 devstack sudo[112776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:53:58 devstack sudo[112776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:58 devstack sudo[112741]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff9d5434-0713-41b0-b455-e184ce26d105_xp9ct9opdevstack@QuobyteHD" returned: 1 in 0.755s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff9d5434-0713-41b0-b455-e184ce26d105_xp9ct9opdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 11 04:53:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:53:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:53:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94fe8b8f-90a2-484f-9538-ebab25a068ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a75ee9f59e146e6950468ba496f6e6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:53:56Z,use_quota=True,user_id='b0fe38855f8e4edd9d206158556dc892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:53:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] Creating volume 94fe8b8f-90a2-484f-9538-ebab25a068ef {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:53:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:53:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:53:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:53:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:53:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:53:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:53:58 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:53:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-94fe8b8f-90a2-484f-9538-ebab25a068ef 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:58 devstack sudo[112792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-94fe8b8f-90a2-484f-9538-ebab25a068ef 1073741824 Aug 11 04:53:58 devstack sudo[112792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:59 devstack sudo[112776]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.515s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:59 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:53:59 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running periodic task VolumeManager._thread_info {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 04:53:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] thread count: 28 {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 11 04:53:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] thread info: [<_MainThread(MainThread, started 133315846115456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 11 04:53:59 devstack sudo[112792]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-94fe8b8f-90a2-484f-9538-ebab25a068ef 1073741824" returned: 0 in 0.608s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-94fe8b8f-90a2-484f-9538-ebab25a068ef {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:59 devstack sudo[112822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-94fe8b8f-90a2-484f-9538-ebab25a068ef Aug 11 04:53:59 devstack sudo[112822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:53:59 devstack sudo[112822]: pam_unix(sudo:session): session closed for user root Aug 11 04:53:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-94fe8b8f-90a2-484f-9538-ebab25a068ef" returned: 0 in 0.270s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:53:59 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:53:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:53:59 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] Attempting download of ff9d5434-0713-41b0-b455-e184ce26d105 ((None, [{'url': 'file:///opt/stack/data/glance/images/ff9d5434-0713-41b0-b455-e184ce26d105', 'metadata': {}}])) to volume 94fe8b8f-90a2-484f-9538-ebab25a068ef. {{(pid=94472) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 11 04:53:59 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[032630f9-8cb3-46d4-aea1-dea69205c78d]: (4, 'raw') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:53:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ff9d5434-0713-41b0-b455-e184ce26d105_33ufc2q6 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:53:59 devstack sudo[112841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ff9d5434-0713-41b0-b455-e184ce26d105_33ufc2q6 Aug 11 04:53:59 devstack sudo[112841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:54:00 devstack sudo[112841]: pam_unix(sudo:session): session closed for user root Aug 11 04:54:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ff9d5434-0713-41b0-b455-e184ce26d105_33ufc2q6" returned: 0 in 0.373s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:54:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ff9d5434-0713-41b0-b455-e184ce26d105_33ufc2q6 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:54:00 devstack sudo[112851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ff9d5434-0713-41b0-b455-e184ce26d105_33ufc2q6 Aug 11 04:54:00 devstack sudo[112851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:54:00 devstack sudo[112851]: pam_unix(sudo:session): session closed for user root Aug 11 04:54:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ff9d5434-0713-41b0-b455-e184ce26d105_33ufc2q6" returned: 1 in 0.332s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:54:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ff9d5434-0713-41b0-b455-e184ce26d105_33ufc2q6' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 11 04:54:00 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5f243c-9223-4150-828f-f4bba8ee750f]: (4, 'raw') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:54:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff9d5434-0713-41b0-b455-e184ce26d105_xp9ct9opdevstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:54:00 devstack sudo[112855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff9d5434-0713-41b0-b455-e184ce26d105_xp9ct9opdevstack@QuobyteHD Aug 11 04:54:00 devstack sudo[112855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:54:00 devstack sudo[112855]: pam_unix(sudo:session): session closed for user root Aug 11 04:54:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff9d5434-0713-41b0-b455-e184ce26d105_xp9ct9opdevstack@QuobyteHD" returned: 0 in 0.384s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:54:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff9d5434-0713-41b0-b455-e184ce26d105_xp9ct9opdevstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:54:01 devstack sudo[112861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff9d5434-0713-41b0-b455-e184ce26d105_xp9ct9opdevstack@QuobyteHD Aug 11 04:54:01 devstack sudo[112861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:54:01 devstack sudo[112861]: pam_unix(sudo:session): session closed for user root Aug 11 04:54:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff9d5434-0713-41b0-b455-e184ce26d105_xp9ct9opdevstack@QuobyteHD" returned: 1 in 0.355s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:54:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff9d5434-0713-41b0-b455-e184ce26d105_xp9ct9opdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 11 04:54:01 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] ff9d5434-0713-41b0-b455-e184ce26d105 was raw, converting to qcow2 {{(pid=94472) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 11 04:54:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ff9d5434-0713-41b0-b455-e184ce26d105_xp9ct9opdevstack@QuobyteHD /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-94fe8b8f-90a2-484f-9538-ebab25a068ef {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:54:01 devstack sudo[112866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ff9d5434-0713-41b0-b455-e184ce26d105_xp9ct9opdevstack@QuobyteHD /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-94fe8b8f-90a2-484f-9538-ebab25a068ef Aug 11 04:54:01 devstack sudo[112866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:54:01 devstack sudo[112866]: pam_unix(sudo:session): session closed for user root Aug 11 04:54:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ff9d5434-0713-41b0-b455-e184ce26d105_xp9ct9opdevstack@QuobyteHD /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-94fe8b8f-90a2-484f-9538-ebab25a068ef" returned: 0 in 0.626s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:54:01 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ff9d5434-0713-41b0-b455-e184ce26d105_xp9ct9opdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-94fe8b8f-90a2-484f-9538-ebab25a068ef {{(pid=94472) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 11 04:54:01 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] Converted 0.00 MB image at 0.00 MB/s Aug 11 04:54:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-94fe8b8f-90a2-484f-9538-ebab25a068ef 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:54:02 devstack sudo[112872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-94fe8b8f-90a2-484f-9538-ebab25a068ef 1G Aug 11 04:54:02 devstack sudo[112872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:54:02 devstack sudo[112872]: pam_unix(sudo:session): session closed for user root Aug 11 04:54:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-94fe8b8f-90a2-484f-9538-ebab25a068ef 1G" returned: 0 in 0.335s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:54:02 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] Downloaded image ff9d5434-0713-41b0-b455-e184ce26d105 ((None, [{'url': 'file:///opt/stack/data/glance/images/ff9d5434-0713-41b0-b455-e184ce26d105', 'metadata': {}}])) to volume 94fe8b8f-90a2-484f-9538-ebab25a068ef successfully. {{(pid=94472) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 11 04:54:02 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] Temporary image ff9d5434-0713-41b0-b455-e184ce26d105 for user b0fe38855f8e4edd9d206158556dc892 is deleted. {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 11 04:54:02 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] Marking volume 94fe8b8f-90a2-484f-9538-ebab25a068ef as bootable. {{(pid=94472) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 11 04:54:02 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] Copying metadata from image ff9d5434-0713-41b0-b455-e184ce26d105 to 94fe8b8f-90a2-484f-9538-ebab25a068ef. {{(pid=94472) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 11 04:54:02 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] Creating volume glance metadata for volume 94fe8b8f-90a2-484f-9538-ebab25a068ef backed by image ff9d5434-0713-41b0-b455-e184ce26d105 with: {'image_id': 'ff9d5434-0713-41b0-b455-e184ce26d105', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '9581369a44fd9a2d72c8e8075b7ab923', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94472) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 11 04:54:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11536233-0335-4411-b6fa-3d9b08d70d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94fe8b8f-90a2-484f-9538-ebab25a068ef', 'volume_size': 1, 'image_id': 'ff9d5434-0713-41b0-b455-e184ce26d105', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ff9d5434-0713-41b0-b455-e184ce26d105', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9581369a44fd9a2d72c8e8075b7ab923', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5a75ee9f59e146e6950468ba496f6e6c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c9fcd3d5ea3c9e39ab3285c90d5156fc6c1c6fce1c30f2af96b7120aefc4ff9b83c4c540bb70ce1a99c715081404fd477e7d0d56b9ee079c5262206a83ea5da6', 'id': 'ff9d5434-0713-41b0-b455-e184ce26d105', 'created_at': datetime.datetime(2026, 8, 11, 2, 53, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 2, 53, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ff9d5434-0713-41b0-b455-e184ce26d105/file', 'properties': {}}, 'image_service': }' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:54:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c52af2ff-4c02-4dd1-840c-2d659137fe86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:54:02 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] Volume volume-94fe8b8f-90a2-484f-9538-ebab25a068ef (94fe8b8f-90a2-484f-9538-ebab25a068ef): created successfully Aug 11 04:54:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c52af2ff-4c02-4dd1-840c-2d659137fe86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:54:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] Flow 'volume_create_manager' (fccd4901-8987-4abb-a716-f862f8864bb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:54:02 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-ca8b2963-7e86-407a-811e-fa7a6ec42154 tempest-VolumeImageDependencyTests-2034436255 None] Created volume successfully. Aug 11 04:54:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-589967e1-87bc-4031-9dc5-4ac82bd91e32 tempest-VolumeImageDependencyTests-2034436255 None] Acquiring lock "cinder-94fe8b8f-90a2-484f-9538-ebab25a068ef-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:54:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-589967e1-87bc-4031-9dc5-4ac82bd91e32 tempest-VolumeImageDependencyTests-2034436255 None] Lock "cinder-94fe8b8f-90a2-484f-9538-ebab25a068ef-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:54:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-589967e1-87bc-4031-9dc5-4ac82bd91e32 tempest-VolumeImageDependencyTests-2034436255 None] Acquiring lock "cinder-quobyte-94fe8b8f-90a2-484f-9538-ebab25a068ef" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:54:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-589967e1-87bc-4031-9dc5-4ac82bd91e32 tempest-VolumeImageDependencyTests-2034436255 None] Lock "cinder-quobyte-94fe8b8f-90a2-484f-9538-ebab25a068ef" acquired by "delete_volume" :: waited 0.016s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:54:02 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1bfa85-6f77-4e7e-bdd2-53ee77278b8f]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:54:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-589967e1-87bc-4031-9dc5-4ac82bd91e32 tempest-VolumeImageDependencyTests-2034436255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-94fe8b8f-90a2-484f-9538-ebab25a068ef {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:54:03 devstack sudo[112902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-94fe8b8f-90a2-484f-9538-ebab25a068ef Aug 11 04:54:03 devstack sudo[112902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:54:03 devstack sudo[112902]: pam_unix(sudo:session): session closed for user root Aug 11 04:54:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-589967e1-87bc-4031-9dc5-4ac82bd91e32 tempest-VolumeImageDependencyTests-2034436255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-94fe8b8f-90a2-484f-9538-ebab25a068ef" returned: 0 in 0.453s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:54:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-589967e1-87bc-4031-9dc5-4ac82bd91e32 tempest-VolumeImageDependencyTests-2034436255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-94fe8b8f-90a2-484f-9538-ebab25a068ef {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:54:03 devstack sudo[112910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-94fe8b8f-90a2-484f-9538-ebab25a068ef Aug 11 04:54:03 devstack sudo[112910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:54:03 devstack sudo[112910]: pam_unix(sudo:session): session closed for user root Aug 11 04:54:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-589967e1-87bc-4031-9dc5-4ac82bd91e32 tempest-VolumeImageDependencyTests-2034436255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-94fe8b8f-90a2-484f-9538-ebab25a068ef" returned: 0 in 0.268s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:54:03 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-589967e1-87bc-4031-9dc5-4ac82bd91e32 tempest-VolumeImageDependencyTests-2034436255 None] Lock "cinder-quobyte-94fe8b8f-90a2-484f-9538-ebab25a068ef" released by "delete_volume" :: held 0.769s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:54:03 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-589967e1-87bc-4031-9dc5-4ac82bd91e32 tempest-VolumeImageDependencyTests-2034436255 None] Created reservations ['16f044a0-c984-4ab5-8a87-a6ce2795b9cc', '481dd7c5-391c-4e8b-9796-25012dc60488', '93ef5175-5ad7-44a6-9ac0-3e0c27e47a9a', '0b87c6e1-5620-4f48-b4dd-3b3a40ceb545'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:54:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-589967e1-87bc-4031-9dc5-4ac82bd91e32 tempest-VolumeImageDependencyTests-2034436255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:54:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-589967e1-87bc-4031-9dc5-4ac82bd91e32 tempest-VolumeImageDependencyTests-2034436255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:54:03 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-589967e1-87bc-4031-9dc5-4ac82bd91e32 tempest-VolumeImageDependencyTests-2034436255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:54:03 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-589967e1-87bc-4031-9dc5-4ac82bd91e32 tempest-VolumeImageDependencyTests-2034436255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:54:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-589967e1-87bc-4031-9dc5-4ac82bd91e32 tempest-VolumeImageDependencyTests-2034436255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:54:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-589967e1-87bc-4031-9dc5-4ac82bd91e32 tempest-VolumeImageDependencyTests-2034436255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:54:03 devstack sudo[112913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:54:03 devstack sudo[112913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:54:04 devstack sudo[112913]: pam_unix(sudo:session): session closed for user root Aug 11 04:54:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-589967e1-87bc-4031-9dc5-4ac82bd91e32 tempest-VolumeImageDependencyTests-2034436255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.251s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:54:04 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-589967e1-87bc-4031-9dc5-4ac82bd91e32 tempest-VolumeImageDependencyTests-2034436255 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:54:04 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-589967e1-87bc-4031-9dc5-4ac82bd91e32 tempest-VolumeImageDependencyTests-2034436255 None] Deleted volume successfully. Aug 11 04:54:04 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-589967e1-87bc-4031-9dc5-4ac82bd91e32 tempest-VolumeImageDependencyTests-2034436255 None] Lock "cinder-94fe8b8f-90a2-484f-9538-ebab25a068ef-delete_volume" released by "delete_volume" :: held 1.247s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:54:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a3abd355-29f0-4894-8f0b-905c35734716 tempest-VolumesNegativeTest-1626520100 None] Acquiring lock "cinder-1ba9c20a-de3f-4b4f-9d9e-95ca2dabf335-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:54:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a3abd355-29f0-4894-8f0b-905c35734716 tempest-VolumesNegativeTest-1626520100 None] Lock "cinder-1ba9c20a-de3f-4b4f-9d9e-95ca2dabf335-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:54:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a3abd355-29f0-4894-8f0b-905c35734716 tempest-VolumesNegativeTest-1626520100 None] Acquiring lock "cinder-quobyte-1ba9c20a-de3f-4b4f-9d9e-95ca2dabf335" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:54:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a3abd355-29f0-4894-8f0b-905c35734716 tempest-VolumesNegativeTest-1626520100 None] Lock "cinder-quobyte-1ba9c20a-de3f-4b4f-9d9e-95ca2dabf335" acquired by "delete_volume" :: waited 0.018s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:54:11 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d3da3f-91fa-4e8e-9a15-5fb71f1c9455]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:54:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a3abd355-29f0-4894-8f0b-905c35734716 tempest-VolumesNegativeTest-1626520100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1ba9c20a-de3f-4b4f-9d9e-95ca2dabf335 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:54:11 devstack sudo[112919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1ba9c20a-de3f-4b4f-9d9e-95ca2dabf335 Aug 11 04:54:11 devstack sudo[112919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:54:11 devstack sudo[112919]: pam_unix(sudo:session): session closed for user root Aug 11 04:54:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a3abd355-29f0-4894-8f0b-905c35734716 tempest-VolumesNegativeTest-1626520100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1ba9c20a-de3f-4b4f-9d9e-95ca2dabf335" returned: 0 in 0.378s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:54:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a3abd355-29f0-4894-8f0b-905c35734716 tempest-VolumesNegativeTest-1626520100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1ba9c20a-de3f-4b4f-9d9e-95ca2dabf335 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:54:11 devstack sudo[112925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1ba9c20a-de3f-4b4f-9d9e-95ca2dabf335 Aug 11 04:54:11 devstack sudo[112925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:54:11 devstack sudo[112925]: pam_unix(sudo:session): session closed for user root Aug 11 04:54:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a3abd355-29f0-4894-8f0b-905c35734716 tempest-VolumesNegativeTest-1626520100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-1ba9c20a-de3f-4b4f-9d9e-95ca2dabf335" returned: 0 in 0.254s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:54:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a3abd355-29f0-4894-8f0b-905c35734716 tempest-VolumesNegativeTest-1626520100 None] Lock "cinder-quobyte-1ba9c20a-de3f-4b4f-9d9e-95ca2dabf335" released by "delete_volume" :: held 0.679s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:54:11 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-a3abd355-29f0-4894-8f0b-905c35734716 tempest-VolumesNegativeTest-1626520100 None] Created reservations ['2aa8c98d-1fd8-4815-8049-4a10a334a894', '8da3a207-c869-4f2d-9364-6469d1202700', 'e5687297-e1cd-4d1a-8aef-164fbcdf843b', '35969bba-8e93-4f40-aac4-a45025cda1f0'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:54:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a3abd355-29f0-4894-8f0b-905c35734716 tempest-VolumesNegativeTest-1626520100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:54:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a3abd355-29f0-4894-8f0b-905c35734716 tempest-VolumesNegativeTest-1626520100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:54:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a3abd355-29f0-4894-8f0b-905c35734716 tempest-VolumesNegativeTest-1626520100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:54:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a3abd355-29f0-4894-8f0b-905c35734716 tempest-VolumesNegativeTest-1626520100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:54:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a3abd355-29f0-4894-8f0b-905c35734716 tempest-VolumesNegativeTest-1626520100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:54:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a3abd355-29f0-4894-8f0b-905c35734716 tempest-VolumesNegativeTest-1626520100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:54:11 devstack sudo[112928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:54:11 devstack sudo[112928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:54:12 devstack sudo[112928]: pam_unix(sudo:session): session closed for user root Aug 11 04:54:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a3abd355-29f0-4894-8f0b-905c35734716 tempest-VolumesNegativeTest-1626520100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.269s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:54:12 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-a3abd355-29f0-4894-8f0b-905c35734716 tempest-VolumesNegativeTest-1626520100 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:54:12 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-115fc3c5-7ba3-460c-b103-68f36a54df55 tempest-ProjectReaderTests-1670409969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:54:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-115fc3c5-7ba3-460c-b103-68f36a54df55 tempest-ProjectReaderTests-1670409969 None] Flow 'volume_create_manager' (45f03c87-4010-47b5-a906-af2aeb3949ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:54:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-115fc3c5-7ba3-460c-b103-68f36a54df55 tempest-ProjectReaderTests-1670409969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (395ba206-0fb4-46ca-aec8-7a5cb98c54b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:54:12 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-a3abd355-29f0-4894-8f0b-905c35734716 tempest-VolumesNegativeTest-1626520100 None] Deleted volume successfully. Aug 11 04:54:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-115fc3c5-7ba3-460c-b103-68f36a54df55 tempest-ProjectReaderTests-1670409969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (395ba206-0fb4-46ca-aec8-7a5cb98c54b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1399205732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5ae80a7-2021-46f8-a60d-411f8ba26cd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d56a007e9e4ba89f4b6d5370c7ba2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:54:12Z,use_quota=True,user_id='e955dae4b7764986b0ede624af06668d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:54:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-115fc3c5-7ba3-460c-b103-68f36a54df55 tempest-ProjectReaderTests-1670409969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caa6cc62-6376-4b18-9640-0c0c6c8963e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:54:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-115fc3c5-7ba3-460c-b103-68f36a54df55 tempest-ProjectReaderTests-1670409969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caa6cc62-6376-4b18-9640-0c0c6c8963e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:54:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-115fc3c5-7ba3-460c-b103-68f36a54df55 tempest-ProjectReaderTests-1670409969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae5ffda1-9e00-4277-bc74-e396df5b9ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:54:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-115fc3c5-7ba3-460c-b103-68f36a54df55 tempest-ProjectReaderTests-1670409969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae5ffda1-9e00-4277-bc74-e396df5b9ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5ae80a7-2021-46f8-a60d-411f8ba26cd5', 'volume_name': 'volume-d5ae80a7-2021-46f8-a60d-411f8ba26cd5', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:54:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-115fc3c5-7ba3-460c-b103-68f36a54df55 tempest-ProjectReaderTests-1670409969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fc6540f-625c-487e-b4e9-4984b42e792d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:54:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-115fc3c5-7ba3-460c-b103-68f36a54df55 tempest-ProjectReaderTests-1670409969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fc6540f-625c-487e-b4e9-4984b42e792d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:54:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-115fc3c5-7ba3-460c-b103-68f36a54df55 tempest-ProjectReaderTests-1670409969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (610cc781-2e25-4ead-81bf-b6b9392c4fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:54:12 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-115fc3c5-7ba3-460c-b103-68f36a54df55 tempest-ProjectReaderTests-1670409969 None] Volume d5ae80a7-2021-46f8-a60d-411f8ba26cd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5ae80a7-2021-46f8-a60d-411f8ba26cd5', 'volume_size': 1} Aug 11 04:54:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-115fc3c5-7ba3-460c-b103-68f36a54df55 tempest-ProjectReaderTests-1670409969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:54:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-115fc3c5-7ba3-460c-b103-68f36a54df55 tempest-ProjectReaderTests-1670409969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:54:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-115fc3c5-7ba3-460c-b103-68f36a54df55 tempest-ProjectReaderTests-1670409969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1399205732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5ae80a7-2021-46f8-a60d-411f8ba26cd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d56a007e9e4ba89f4b6d5370c7ba2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:54:12Z,use_quota=True,user_id='e955dae4b7764986b0ede624af06668d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:54:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-115fc3c5-7ba3-460c-b103-68f36a54df55 tempest-ProjectReaderTests-1670409969 None] Creating volume d5ae80a7-2021-46f8-a60d-411f8ba26cd5 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:54:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-115fc3c5-7ba3-460c-b103-68f36a54df55 tempest-ProjectReaderTests-1670409969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:54:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-115fc3c5-7ba3-460c-b103-68f36a54df55 tempest-ProjectReaderTests-1670409969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:54:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-115fc3c5-7ba3-460c-b103-68f36a54df55 tempest-ProjectReaderTests-1670409969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:54:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-115fc3c5-7ba3-460c-b103-68f36a54df55 tempest-ProjectReaderTests-1670409969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:54:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-115fc3c5-7ba3-460c-b103-68f36a54df55 tempest-ProjectReaderTests-1670409969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:54:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-115fc3c5-7ba3-460c-b103-68f36a54df55 tempest-ProjectReaderTests-1670409969 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:54:12 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-115fc3c5-7ba3-460c-b103-68f36a54df55 tempest-ProjectReaderTests-1670409969 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:54:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-115fc3c5-7ba3-460c-b103-68f36a54df55 tempest-ProjectReaderTests-1670409969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d5ae80a7-2021-46f8-a60d-411f8ba26cd5 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:54:12 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a3abd355-29f0-4894-8f0b-905c35734716 tempest-VolumesNegativeTest-1626520100 None] Lock "cinder-1ba9c20a-de3f-4b4f-9d9e-95ca2dabf335-delete_volume" released by "delete_volume" :: held 1.261s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:54:12 devstack sudo[112931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d5ae80a7-2021-46f8-a60d-411f8ba26cd5 1073741824 Aug 11 04:54:12 devstack sudo[112931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:54:12 devstack sudo[112931]: pam_unix(sudo:session): session closed for user root Aug 11 04:54:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-115fc3c5-7ba3-460c-b103-68f36a54df55 tempest-ProjectReaderTests-1670409969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d5ae80a7-2021-46f8-a60d-411f8ba26cd5 1073741824" returned: 0 in 0.489s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:54:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-115fc3c5-7ba3-460c-b103-68f36a54df55 tempest-ProjectReaderTests-1670409969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d5ae80a7-2021-46f8-a60d-411f8ba26cd5 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:54:12 devstack sudo[112937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d5ae80a7-2021-46f8-a60d-411f8ba26cd5 Aug 11 04:54:12 devstack sudo[112937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:54:13 devstack sudo[112937]: pam_unix(sudo:session): session closed for user root Aug 11 04:54:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-115fc3c5-7ba3-460c-b103-68f36a54df55 tempest-ProjectReaderTests-1670409969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d5ae80a7-2021-46f8-a60d-411f8ba26cd5" returned: 0 in 0.251s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:54:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-115fc3c5-7ba3-460c-b103-68f36a54df55 tempest-ProjectReaderTests-1670409969 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:54:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-115fc3c5-7ba3-460c-b103-68f36a54df55 tempest-ProjectReaderTests-1670409969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:54:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-115fc3c5-7ba3-460c-b103-68f36a54df55 tempest-ProjectReaderTests-1670409969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (610cc781-2e25-4ead-81bf-b6b9392c4fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5ae80a7-2021-46f8-a60d-411f8ba26cd5', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:54:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-115fc3c5-7ba3-460c-b103-68f36a54df55 tempest-ProjectReaderTests-1670409969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c46739de-fd81-49ce-a0b9-ccc0c5a73772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:54:13 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-115fc3c5-7ba3-460c-b103-68f36a54df55 tempest-ProjectReaderTests-1670409969 None] Volume volume-d5ae80a7-2021-46f8-a60d-411f8ba26cd5 (d5ae80a7-2021-46f8-a60d-411f8ba26cd5): created successfully Aug 11 04:54:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-115fc3c5-7ba3-460c-b103-68f36a54df55 tempest-ProjectReaderTests-1670409969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c46739de-fd81-49ce-a0b9-ccc0c5a73772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:54:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-115fc3c5-7ba3-460c-b103-68f36a54df55 tempest-ProjectReaderTests-1670409969 None] Flow 'volume_create_manager' (45f03c87-4010-47b5-a906-af2aeb3949ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:54:13 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-115fc3c5-7ba3-460c-b103-68f36a54df55 tempest-ProjectReaderTests-1670409969 None] Created volume successfully. Aug 11 04:54:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bd12aef2-645c-4f1e-88b0-c6c9f5d5fc11 tempest-ProjectReaderTests-1670409969 None] Acquiring lock "cinder-d5ae80a7-2021-46f8-a60d-411f8ba26cd5-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:54:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bd12aef2-645c-4f1e-88b0-c6c9f5d5fc11 tempest-ProjectReaderTests-1670409969 None] Lock "cinder-d5ae80a7-2021-46f8-a60d-411f8ba26cd5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:54:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bd12aef2-645c-4f1e-88b0-c6c9f5d5fc11 tempest-ProjectReaderTests-1670409969 None] Acquiring lock "cinder-quobyte-d5ae80a7-2021-46f8-a60d-411f8ba26cd5" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:54:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bd12aef2-645c-4f1e-88b0-c6c9f5d5fc11 tempest-ProjectReaderTests-1670409969 None] Lock "cinder-quobyte-d5ae80a7-2021-46f8-a60d-411f8ba26cd5" acquired by "delete_volume" :: waited 0.022s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:54:14 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a18b90-dbfe-4fc3-8230-bca78e1730b7]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:54:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bd12aef2-645c-4f1e-88b0-c6c9f5d5fc11 tempest-ProjectReaderTests-1670409969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d5ae80a7-2021-46f8-a60d-411f8ba26cd5 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:54:14 devstack sudo[112941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d5ae80a7-2021-46f8-a60d-411f8ba26cd5 Aug 11 04:54:14 devstack sudo[112941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:54:14 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f3b734b-b52e-45be-b4e9-00aa2209071e tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:54:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3f3b734b-b52e-45be-b4e9-00aa2209071e tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Flow 'volume_create_manager' (71ae5c2d-de39-40c0-9aa4-685334539bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:54:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3f3b734b-b52e-45be-b4e9-00aa2209071e tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c416a7b-5385-47a1-a673-fe04eaa830a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:54:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3f3b734b-b52e-45be-b4e9-00aa2209071e tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c416a7b-5385-47a1-a673-fe04eaa830a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:54:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-659600189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=670a9b44-613d-4228-9020-ff10299bbb84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04db8866f2444e888c99f1cc38f1601b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:54:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:54:15Z,use_quota=True,user_id='68050682b35b467e8a12ee3d95e475ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:54:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3f3b734b-b52e-45be-b4e9-00aa2209071e tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e18616c-77e0-45aa-bc2c-fb5e63fa6640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:54:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3f3b734b-b52e-45be-b4e9-00aa2209071e tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e18616c-77e0-45aa-bc2c-fb5e63fa6640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:54:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3f3b734b-b52e-45be-b4e9-00aa2209071e tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (638e321c-3087-4133-9961-1b31536d513a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:54:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3f3b734b-b52e-45be-b4e9-00aa2209071e tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (638e321c-3087-4133-9961-1b31536d513a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '670a9b44-613d-4228-9020-ff10299bbb84', 'volume_name': 'volume-670a9b44-613d-4228-9020-ff10299bbb84', 'volume_size': 2}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:54:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3f3b734b-b52e-45be-b4e9-00aa2209071e tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ef537a3-e4a3-492d-a75c-fc5e2d17cb70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:54:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3f3b734b-b52e-45be-b4e9-00aa2209071e tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ef537a3-e4a3-492d-a75c-fc5e2d17cb70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:54:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3f3b734b-b52e-45be-b4e9-00aa2209071e tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0406831f-ab10-400f-93d4-c7b4cc5e5889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:54:14 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-3f3b734b-b52e-45be-b4e9-00aa2209071e tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Volume 670a9b44-613d-4228-9020-ff10299bbb84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-670a9b44-613d-4228-9020-ff10299bbb84', 'volume_size': 2} Aug 11 04:54:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3f3b734b-b52e-45be-b4e9-00aa2209071e tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:54:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3f3b734b-b52e-45be-b4e9-00aa2209071e tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:54:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3f3b734b-b52e-45be-b4e9-00aa2209071e tempest-VolumesSnapshotNegativeTestJSON-343342279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:54:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-659600189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=670a9b44-613d-4228-9020-ff10299bbb84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04db8866f2444e888c99f1cc38f1601b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:54:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:54:15Z,use_quota=True,user_id='68050682b35b467e8a12ee3d95e475ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:54:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-3f3b734b-b52e-45be-b4e9-00aa2209071e tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Creating volume 670a9b44-613d-4228-9020-ff10299bbb84 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:54:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3f3b734b-b52e-45be-b4e9-00aa2209071e tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:54:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3f3b734b-b52e-45be-b4e9-00aa2209071e tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:54:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3f3b734b-b52e-45be-b4e9-00aa2209071e tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:54:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3f3b734b-b52e-45be-b4e9-00aa2209071e tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:54:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3f3b734b-b52e-45be-b4e9-00aa2209071e tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:54:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3f3b734b-b52e-45be-b4e9-00aa2209071e tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:54:14 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-3f3b734b-b52e-45be-b4e9-00aa2209071e tempest-VolumesSnapshotNegativeTestJSON-343342279 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:54:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3f3b734b-b52e-45be-b4e9-00aa2209071e tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-670a9b44-613d-4228-9020-ff10299bbb84 2147483648 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:54:14 devstack sudo[112945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-670a9b44-613d-4228-9020-ff10299bbb84 2147483648 Aug 11 04:54:14 devstack sudo[112945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:54:14 devstack sudo[112941]: pam_unix(sudo:session): session closed for user root Aug 11 04:54:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bd12aef2-645c-4f1e-88b0-c6c9f5d5fc11 tempest-ProjectReaderTests-1670409969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d5ae80a7-2021-46f8-a60d-411f8ba26cd5" returned: 0 in 0.388s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:54:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bd12aef2-645c-4f1e-88b0-c6c9f5d5fc11 tempest-ProjectReaderTests-1670409969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d5ae80a7-2021-46f8-a60d-411f8ba26cd5 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:54:14 devstack sudo[112948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d5ae80a7-2021-46f8-a60d-411f8ba26cd5 Aug 11 04:54:14 devstack sudo[112948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:54:15 devstack sudo[112948]: pam_unix(sudo:session): session closed for user root Aug 11 04:54:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bd12aef2-645c-4f1e-88b0-c6c9f5d5fc11 tempest-ProjectReaderTests-1670409969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d5ae80a7-2021-46f8-a60d-411f8ba26cd5" returned: 0 in 0.266s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:54:15 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bd12aef2-645c-4f1e-88b0-c6c9f5d5fc11 tempest-ProjectReaderTests-1670409969 None] Lock "cinder-quobyte-d5ae80a7-2021-46f8-a60d-411f8ba26cd5" released by "delete_volume" :: held 0.699s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:54:15 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-bd12aef2-645c-4f1e-88b0-c6c9f5d5fc11 tempest-ProjectReaderTests-1670409969 None] Created reservations ['f2a2111d-5ed1-44f8-8e9d-baba0503b387', '990bf54b-eefd-4cd5-9e66-89ca05709426', '38bb0da2-37dc-4bb0-8599-b71ff6dbaa14', 'b811a165-2b19-4739-8bfb-90e3303d4605'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:54:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bd12aef2-645c-4f1e-88b0-c6c9f5d5fc11 tempest-ProjectReaderTests-1670409969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:54:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bd12aef2-645c-4f1e-88b0-c6c9f5d5fc11 tempest-ProjectReaderTests-1670409969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:54:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-bd12aef2-645c-4f1e-88b0-c6c9f5d5fc11 tempest-ProjectReaderTests-1670409969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:54:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-bd12aef2-645c-4f1e-88b0-c6c9f5d5fc11 tempest-ProjectReaderTests-1670409969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:54:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bd12aef2-645c-4f1e-88b0-c6c9f5d5fc11 tempest-ProjectReaderTests-1670409969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:54:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bd12aef2-645c-4f1e-88b0-c6c9f5d5fc11 tempest-ProjectReaderTests-1670409969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:54:15 devstack sudo[112955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:54:15 devstack sudo[112955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:54:15 devstack sudo[112945]: pam_unix(sudo:session): session closed for user root Aug 11 04:54:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3f3b734b-b52e-45be-b4e9-00aa2209071e tempest-VolumesSnapshotNegativeTestJSON-343342279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-670a9b44-613d-4228-9020-ff10299bbb84 2147483648" returned: 0 in 0.503s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:54:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3f3b734b-b52e-45be-b4e9-00aa2209071e tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-670a9b44-613d-4228-9020-ff10299bbb84 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:54:15 devstack sudo[112957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-670a9b44-613d-4228-9020-ff10299bbb84 Aug 11 04:54:15 devstack sudo[112957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:54:15 devstack sudo[112955]: pam_unix(sudo:session): session closed for user root Aug 11 04:54:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bd12aef2-645c-4f1e-88b0-c6c9f5d5fc11 tempest-ProjectReaderTests-1670409969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.261s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:54:15 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-bd12aef2-645c-4f1e-88b0-c6c9f5d5fc11 tempest-ProjectReaderTests-1670409969 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:54:15 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-bd12aef2-645c-4f1e-88b0-c6c9f5d5fc11 tempest-ProjectReaderTests-1670409969 None] Deleted volume successfully. Aug 11 04:54:15 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bd12aef2-645c-4f1e-88b0-c6c9f5d5fc11 tempest-ProjectReaderTests-1670409969 None] Lock "cinder-d5ae80a7-2021-46f8-a60d-411f8ba26cd5-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:54:15 devstack sudo[112957]: pam_unix(sudo:session): session closed for user root Aug 11 04:54:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3f3b734b-b52e-45be-b4e9-00aa2209071e tempest-VolumesSnapshotNegativeTestJSON-343342279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-670a9b44-613d-4228-9020-ff10299bbb84" returned: 0 in 0.278s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:54:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3f3b734b-b52e-45be-b4e9-00aa2209071e tempest-VolumesSnapshotNegativeTestJSON-343342279 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:54:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3f3b734b-b52e-45be-b4e9-00aa2209071e tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:54:15 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3f3b734b-b52e-45be-b4e9-00aa2209071e tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0406831f-ab10-400f-93d4-c7b4cc5e5889) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-670a9b44-613d-4228-9020-ff10299bbb84', 'volume_size': 2}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:54:15 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3f3b734b-b52e-45be-b4e9-00aa2209071e tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c50b0b66-1f39-4eae-889f-1fe8461ca423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:54:15 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-3f3b734b-b52e-45be-b4e9-00aa2209071e tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Volume volume-670a9b44-613d-4228-9020-ff10299bbb84 (670a9b44-613d-4228-9020-ff10299bbb84): created successfully Aug 11 04:54:15 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3f3b734b-b52e-45be-b4e9-00aa2209071e tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c50b0b66-1f39-4eae-889f-1fe8461ca423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:54:15 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3f3b734b-b52e-45be-b4e9-00aa2209071e tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Flow 'volume_create_manager' (71ae5c2d-de39-40c0-9aa4-685334539bac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:54:15 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-3f3b734b-b52e-45be-b4e9-00aa2209071e tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Created volume successfully. Aug 11 04:54:16 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d7cc5ea-b586-4acb-bac3-3d7fb19cb16b tempest-ProjectReaderTests-1670409969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:54:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4d7cc5ea-b586-4acb-bac3-3d7fb19cb16b tempest-ProjectReaderTests-1670409969 None] Flow 'volume_create_manager' (dc7b77f0-a54d-4ca9-9640-eea1ba904313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:54:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4d7cc5ea-b586-4acb-bac3-3d7fb19cb16b tempest-ProjectReaderTests-1670409969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6231e0d6-545b-4e14-aa65-383cffc9ce24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:54:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4d7cc5ea-b586-4acb-bac3-3d7fb19cb16b tempest-ProjectReaderTests-1670409969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6231e0d6-545b-4e14-aa65-383cffc9ce24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1360795909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14ead514-b27a-4837-a166-4950da74af82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d56a007e9e4ba89f4b6d5370c7ba2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:54:16Z,use_quota=True,user_id='e955dae4b7764986b0ede624af06668d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:54:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4d7cc5ea-b586-4acb-bac3-3d7fb19cb16b tempest-ProjectReaderTests-1670409969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98f9943a-4dc6-4412-8ff8-cc3f1d65996c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:54:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4d7cc5ea-b586-4acb-bac3-3d7fb19cb16b tempest-ProjectReaderTests-1670409969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98f9943a-4dc6-4412-8ff8-cc3f1d65996c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:54:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4d7cc5ea-b586-4acb-bac3-3d7fb19cb16b tempest-ProjectReaderTests-1670409969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34a2dfa6-c176-4189-ab84-ac93698a3504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:54:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4d7cc5ea-b586-4acb-bac3-3d7fb19cb16b tempest-ProjectReaderTests-1670409969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34a2dfa6-c176-4189-ab84-ac93698a3504) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14ead514-b27a-4837-a166-4950da74af82', 'volume_name': 'volume-14ead514-b27a-4837-a166-4950da74af82', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:54:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4d7cc5ea-b586-4acb-bac3-3d7fb19cb16b tempest-ProjectReaderTests-1670409969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e9e51a0-6d39-4f2c-ac8e-264076603ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:54:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4d7cc5ea-b586-4acb-bac3-3d7fb19cb16b tempest-ProjectReaderTests-1670409969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e9e51a0-6d39-4f2c-ac8e-264076603ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:54:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4d7cc5ea-b586-4acb-bac3-3d7fb19cb16b tempest-ProjectReaderTests-1670409969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (235660fb-b7e2-49ba-9d45-20e9ef2247da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:54:16 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-4d7cc5ea-b586-4acb-bac3-3d7fb19cb16b tempest-ProjectReaderTests-1670409969 None] Volume 14ead514-b27a-4837-a166-4950da74af82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14ead514-b27a-4837-a166-4950da74af82', 'volume_size': 1} Aug 11 04:54:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4d7cc5ea-b586-4acb-bac3-3d7fb19cb16b tempest-ProjectReaderTests-1670409969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:54:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4d7cc5ea-b586-4acb-bac3-3d7fb19cb16b tempest-ProjectReaderTests-1670409969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:54:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4d7cc5ea-b586-4acb-bac3-3d7fb19cb16b tempest-ProjectReaderTests-1670409969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1360795909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14ead514-b27a-4837-a166-4950da74af82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d56a007e9e4ba89f4b6d5370c7ba2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:54:16Z,use_quota=True,user_id='e955dae4b7764986b0ede624af06668d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:54:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-4d7cc5ea-b586-4acb-bac3-3d7fb19cb16b tempest-ProjectReaderTests-1670409969 None] Creating volume 14ead514-b27a-4837-a166-4950da74af82 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:54:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4d7cc5ea-b586-4acb-bac3-3d7fb19cb16b tempest-ProjectReaderTests-1670409969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:54:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4d7cc5ea-b586-4acb-bac3-3d7fb19cb16b tempest-ProjectReaderTests-1670409969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:54:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4d7cc5ea-b586-4acb-bac3-3d7fb19cb16b tempest-ProjectReaderTests-1670409969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:54:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4d7cc5ea-b586-4acb-bac3-3d7fb19cb16b tempest-ProjectReaderTests-1670409969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:54:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4d7cc5ea-b586-4acb-bac3-3d7fb19cb16b tempest-ProjectReaderTests-1670409969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:54:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4d7cc5ea-b586-4acb-bac3-3d7fb19cb16b tempest-ProjectReaderTests-1670409969 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:54:16 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-4d7cc5ea-b586-4acb-bac3-3d7fb19cb16b tempest-ProjectReaderTests-1670409969 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:54:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4d7cc5ea-b586-4acb-bac3-3d7fb19cb16b tempest-ProjectReaderTests-1670409969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-14ead514-b27a-4837-a166-4950da74af82 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:54:16 devstack sudo[112961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-14ead514-b27a-4837-a166-4950da74af82 1073741824 Aug 11 04:54:16 devstack sudo[112961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:54:16 devstack sudo[112961]: pam_unix(sudo:session): session closed for user root Aug 11 04:54:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4d7cc5ea-b586-4acb-bac3-3d7fb19cb16b tempest-ProjectReaderTests-1670409969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-14ead514-b27a-4837-a166-4950da74af82 1073741824" returned: 0 in 0.412s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:54:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4d7cc5ea-b586-4acb-bac3-3d7fb19cb16b tempest-ProjectReaderTests-1670409969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-14ead514-b27a-4837-a166-4950da74af82 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:54:16 devstack sudo[112967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-14ead514-b27a-4837-a166-4950da74af82 Aug 11 04:54:16 devstack sudo[112967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:54:16 devstack sudo[112967]: pam_unix(sudo:session): session closed for user root Aug 11 04:54:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4d7cc5ea-b586-4acb-bac3-3d7fb19cb16b tempest-ProjectReaderTests-1670409969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-14ead514-b27a-4837-a166-4950da74af82" returned: 0 in 0.240s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:54:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4d7cc5ea-b586-4acb-bac3-3d7fb19cb16b tempest-ProjectReaderTests-1670409969 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:54:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4d7cc5ea-b586-4acb-bac3-3d7fb19cb16b tempest-ProjectReaderTests-1670409969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:54:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4d7cc5ea-b586-4acb-bac3-3d7fb19cb16b tempest-ProjectReaderTests-1670409969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (235660fb-b7e2-49ba-9d45-20e9ef2247da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14ead514-b27a-4837-a166-4950da74af82', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:54:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4d7cc5ea-b586-4acb-bac3-3d7fb19cb16b tempest-ProjectReaderTests-1670409969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88b73f97-bb87-4f8e-b32d-ccfd113c948c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:54:16 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-4d7cc5ea-b586-4acb-bac3-3d7fb19cb16b tempest-ProjectReaderTests-1670409969 None] Volume volume-14ead514-b27a-4837-a166-4950da74af82 (14ead514-b27a-4837-a166-4950da74af82): created successfully Aug 11 04:54:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4d7cc5ea-b586-4acb-bac3-3d7fb19cb16b tempest-ProjectReaderTests-1670409969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88b73f97-bb87-4f8e-b32d-ccfd113c948c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:54:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4d7cc5ea-b586-4acb-bac3-3d7fb19cb16b tempest-ProjectReaderTests-1670409969 None] Flow 'volume_create_manager' (dc7b77f0-a54d-4ca9-9640-eea1ba904313) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:54:16 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-4d7cc5ea-b586-4acb-bac3-3d7fb19cb16b tempest-ProjectReaderTests-1670409969 None] Created volume successfully. Aug 11 04:54:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3a864017-c278-4e84-a96e-e441ff9b517c tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:54:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3a864017-c278-4e84-a96e-e441ff9b517c tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:54:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-3a864017-c278-4e84-a96e-e441ff9b517c tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Creating offline snapshot 40774cfd-3160-4dfa-8d5a-d7d4c7c20fbe of volume 670a9b44-613d-4228-9020-ff10299bbb84 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 04:54:17 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f55cccf-9e1e-4a74-a934-56624745e60d]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:54:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3a864017-c278-4e84-a96e-e441ff9b517c tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-670a9b44-613d-4228-9020-ff10299bbb84 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:54:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9ef52891-8b0e-4d0a-9bde-ce5540e7a5f8 tempest-ProjectReaderTests-1670409969 None] Acquiring lock "cinder-14ead514-b27a-4837-a166-4950da74af82-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:54:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9ef52891-8b0e-4d0a-9bde-ce5540e7a5f8 tempest-ProjectReaderTests-1670409969 None] Lock "cinder-14ead514-b27a-4837-a166-4950da74af82-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:54:17 devstack sudo[112970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-670a9b44-613d-4228-9020-ff10299bbb84 Aug 11 04:54:17 devstack sudo[112970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:54:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9ef52891-8b0e-4d0a-9bde-ce5540e7a5f8 tempest-ProjectReaderTests-1670409969 None] Acquiring lock "cinder-quobyte-14ead514-b27a-4837-a166-4950da74af82" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:54:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9ef52891-8b0e-4d0a-9bde-ce5540e7a5f8 tempest-ProjectReaderTests-1670409969 None] Lock "cinder-quobyte-14ead514-b27a-4837-a166-4950da74af82" acquired by "delete_volume" :: waited 0.018s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:54:17 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[019ed86f-3967-4115-9535-1dcc0f3d62c3]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:54:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9ef52891-8b0e-4d0a-9bde-ce5540e7a5f8 tempest-ProjectReaderTests-1670409969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-14ead514-b27a-4837-a166-4950da74af82 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:54:17 devstack sudo[112972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-14ead514-b27a-4837-a166-4950da74af82 Aug 11 04:54:17 devstack sudo[112972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:54:17 devstack sudo[112970]: pam_unix(sudo:session): session closed for user root Aug 11 04:54:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3a864017-c278-4e84-a96e-e441ff9b517c tempest-VolumesSnapshotNegativeTestJSON-343342279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-670a9b44-613d-4228-9020-ff10299bbb84" returned: 0 in 0.373s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:54:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3a864017-c278-4e84-a96e-e441ff9b517c tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-670a9b44-613d-4228-9020-ff10299bbb84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-670a9b44-613d-4228-9020-ff10299bbb84.40774cfd-3160-4dfa-8d5a-d7d4c7c20fbe 2G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:54:17 devstack sudo[112977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-670a9b44-613d-4228-9020-ff10299bbb84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-670a9b44-613d-4228-9020-ff10299bbb84.40774cfd-3160-4dfa-8d5a-d7d4c7c20fbe 2G Aug 11 04:54:17 devstack sudo[112977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:54:17 devstack sudo[112972]: pam_unix(sudo:session): session closed for user root Aug 11 04:54:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9ef52891-8b0e-4d0a-9bde-ce5540e7a5f8 tempest-ProjectReaderTests-1670409969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-14ead514-b27a-4837-a166-4950da74af82" returned: 0 in 0.396s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:54:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9ef52891-8b0e-4d0a-9bde-ce5540e7a5f8 tempest-ProjectReaderTests-1670409969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-14ead514-b27a-4837-a166-4950da74af82 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:54:17 devstack sudo[112982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-14ead514-b27a-4837-a166-4950da74af82 Aug 11 04:54:17 devstack sudo[112982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:54:17 devstack sudo[112977]: pam_unix(sudo:session): session closed for user root Aug 11 04:54:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3a864017-c278-4e84-a96e-e441ff9b517c tempest-VolumesSnapshotNegativeTestJSON-343342279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-670a9b44-613d-4228-9020-ff10299bbb84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-670a9b44-613d-4228-9020-ff10299bbb84.40774cfd-3160-4dfa-8d5a-d7d4c7c20fbe 2G" returned: 0 in 0.416s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:54:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3a864017-c278-4e84-a96e-e441ff9b517c tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-670a9b44-613d-4228-9020-ff10299bbb84 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-670a9b44-613d-4228-9020-ff10299bbb84.40774cfd-3160-4dfa-8d5a-d7d4c7c20fbe {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:54:17 devstack sudo[112988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-670a9b44-613d-4228-9020-ff10299bbb84 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-670a9b44-613d-4228-9020-ff10299bbb84.40774cfd-3160-4dfa-8d5a-d7d4c7c20fbe Aug 11 04:54:17 devstack sudo[112988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:54:17 devstack sudo[112982]: pam_unix(sudo:session): session closed for user root Aug 11 04:54:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9ef52891-8b0e-4d0a-9bde-ce5540e7a5f8 tempest-ProjectReaderTests-1670409969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-14ead514-b27a-4837-a166-4950da74af82" returned: 0 in 0.248s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:54:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9ef52891-8b0e-4d0a-9bde-ce5540e7a5f8 tempest-ProjectReaderTests-1670409969 None] Lock "cinder-quobyte-14ead514-b27a-4837-a166-4950da74af82" released by "delete_volume" :: held 0.687s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:54:17 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-9ef52891-8b0e-4d0a-9bde-ce5540e7a5f8 tempest-ProjectReaderTests-1670409969 None] Created reservations ['63db2e71-17fd-4286-a65d-08ce9a4bf819', 'e76b852a-b971-4efa-9134-a0de3cfb2415', 'dc691488-d4ce-42de-bd77-65511cee5feb', '40ca8edb-86e0-4af9-a9f1-0124779bd4f5'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:54:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9ef52891-8b0e-4d0a-9bde-ce5540e7a5f8 tempest-ProjectReaderTests-1670409969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:54:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9ef52891-8b0e-4d0a-9bde-ce5540e7a5f8 tempest-ProjectReaderTests-1670409969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:54:18 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9ef52891-8b0e-4d0a-9bde-ce5540e7a5f8 tempest-ProjectReaderTests-1670409969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:54:18 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9ef52891-8b0e-4d0a-9bde-ce5540e7a5f8 tempest-ProjectReaderTests-1670409969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:54:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9ef52891-8b0e-4d0a-9bde-ce5540e7a5f8 tempest-ProjectReaderTests-1670409969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:54:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9ef52891-8b0e-4d0a-9bde-ce5540e7a5f8 tempest-ProjectReaderTests-1670409969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:54:18 devstack sudo[112990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:54:18 devstack sudo[112990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:54:18 devstack sudo[112988]: pam_unix(sudo:session): session closed for user root Aug 11 04:54:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3a864017-c278-4e84-a96e-e441ff9b517c tempest-VolumesSnapshotNegativeTestJSON-343342279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-670a9b44-613d-4228-9020-ff10299bbb84 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-670a9b44-613d-4228-9020-ff10299bbb84.40774cfd-3160-4dfa-8d5a-d7d4c7c20fbe" returned: 0 in 0.306s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:54:18 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-3a864017-c278-4e84-a96e-e441ff9b517c tempest-VolumesSnapshotNegativeTestJSON-343342279 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-670a9b44-613d-4228-9020-ff10299bbb84.40774cfd-3160-4dfa-8d5a-d7d4c7c20fbe is being set with open permissions: ugo+rw Aug 11 04:54:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3a864017-c278-4e84-a96e-e441ff9b517c tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-670a9b44-613d-4228-9020-ff10299bbb84.40774cfd-3160-4dfa-8d5a-d7d4c7c20fbe {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:54:18 devstack sudo[112995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-670a9b44-613d-4228-9020-ff10299bbb84.40774cfd-3160-4dfa-8d5a-d7d4c7c20fbe Aug 11 04:54:18 devstack sudo[112995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:54:18 devstack sudo[112990]: pam_unix(sudo:session): session closed for user root Aug 11 04:54:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9ef52891-8b0e-4d0a-9bde-ce5540e7a5f8 tempest-ProjectReaderTests-1670409969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.270s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:54:18 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-9ef52891-8b0e-4d0a-9bde-ce5540e7a5f8 tempest-ProjectReaderTests-1670409969 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:54:18 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-9ef52891-8b0e-4d0a-9bde-ce5540e7a5f8 tempest-ProjectReaderTests-1670409969 None] Deleted volume successfully. Aug 11 04:54:18 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9ef52891-8b0e-4d0a-9bde-ce5540e7a5f8 tempest-ProjectReaderTests-1670409969 None] Lock "cinder-14ead514-b27a-4837-a166-4950da74af82-delete_volume" released by "delete_volume" :: held 1.185s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:54:18 devstack sudo[112995]: pam_unix(sudo:session): session closed for user root Aug 11 04:54:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3a864017-c278-4e84-a96e-e441ff9b517c tempest-VolumesSnapshotNegativeTestJSON-343342279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-670a9b44-613d-4228-9020-ff10299bbb84.40774cfd-3160-4dfa-8d5a-d7d4c7c20fbe" returned: 0 in 0.283s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:54:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3a864017-c278-4e84-a96e-e441ff9b517c tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-670a9b44-613d-4228-9020-ff10299bbb84.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:54:18 devstack sudo[112999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-670a9b44-613d-4228-9020-ff10299bbb84.info Aug 11 04:54:18 devstack sudo[112999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:54:18 devstack sudo[112999]: pam_unix(sudo:session): session closed for user root Aug 11 04:54:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3a864017-c278-4e84-a96e-e441ff9b517c tempest-VolumesSnapshotNegativeTestJSON-343342279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-670a9b44-613d-4228-9020-ff10299bbb84.info" returned: 0 in 0.272s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:54:18 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-3a864017-c278-4e84-a96e-e441ff9b517c tempest-VolumesSnapshotNegativeTestJSON-343342279 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-670a9b44-613d-4228-9020-ff10299bbb84.info is being set with open permissions: ugo+rw Aug 11 04:54:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3a864017-c278-4e84-a96e-e441ff9b517c tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-670a9b44-613d-4228-9020-ff10299bbb84.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:54:18 devstack sudo[113002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-670a9b44-613d-4228-9020-ff10299bbb84.info Aug 11 04:54:18 devstack sudo[113002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:54:18 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7e42144-145b-4fd8-be4a-e7bec9a5a407 tempest-ProjectReaderTests-1670409969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:54:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b7e42144-145b-4fd8-be4a-e7bec9a5a407 tempest-ProjectReaderTests-1670409969 None] Flow 'volume_create_manager' (dff615d5-b422-4758-90a5-494befa8a8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:54:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b7e42144-145b-4fd8-be4a-e7bec9a5a407 tempest-ProjectReaderTests-1670409969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c13ae428-f527-424d-aaf8-2ad4908ebdd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:54:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b7e42144-145b-4fd8-be4a-e7bec9a5a407 tempest-ProjectReaderTests-1670409969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c13ae428-f527-424d-aaf8-2ad4908ebdd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:54:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-157735340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4ffbb9b-941a-4441-a373-18c3fe314baa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d56a007e9e4ba89f4b6d5370c7ba2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:54:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:54:19Z,use_quota=True,user_id='e955dae4b7764986b0ede624af06668d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:54:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b7e42144-145b-4fd8-be4a-e7bec9a5a407 tempest-ProjectReaderTests-1670409969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0ea2cd5-436e-4f92-bbe9-97c8dc1d1558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:54:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b7e42144-145b-4fd8-be4a-e7bec9a5a407 tempest-ProjectReaderTests-1670409969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0ea2cd5-436e-4f92-bbe9-97c8dc1d1558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:54:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b7e42144-145b-4fd8-be4a-e7bec9a5a407 tempest-ProjectReaderTests-1670409969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11343b48-24ae-4a2d-a8a8-33a6c36773bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:54:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b7e42144-145b-4fd8-be4a-e7bec9a5a407 tempest-ProjectReaderTests-1670409969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11343b48-24ae-4a2d-a8a8-33a6c36773bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4ffbb9b-941a-4441-a373-18c3fe314baa', 'volume_name': 'volume-d4ffbb9b-941a-4441-a373-18c3fe314baa', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:54:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b7e42144-145b-4fd8-be4a-e7bec9a5a407 tempest-ProjectReaderTests-1670409969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (591e7eae-2e8a-4d56-b607-277e4178033b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:54:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b7e42144-145b-4fd8-be4a-e7bec9a5a407 tempest-ProjectReaderTests-1670409969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (591e7eae-2e8a-4d56-b607-277e4178033b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:54:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b7e42144-145b-4fd8-be4a-e7bec9a5a407 tempest-ProjectReaderTests-1670409969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d2a2cfd-40af-4236-a068-4bf07bd87e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:54:18 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-b7e42144-145b-4fd8-be4a-e7bec9a5a407 tempest-ProjectReaderTests-1670409969 None] Volume d4ffbb9b-941a-4441-a373-18c3fe314baa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4ffbb9b-941a-4441-a373-18c3fe314baa', 'volume_size': 1} Aug 11 04:54:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b7e42144-145b-4fd8-be4a-e7bec9a5a407 tempest-ProjectReaderTests-1670409969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:54:19 devstack sudo[113002]: pam_unix(sudo:session): session closed for user root Aug 11 04:54:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3a864017-c278-4e84-a96e-e441ff9b517c tempest-VolumesSnapshotNegativeTestJSON-343342279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-670a9b44-613d-4228-9020-ff10299bbb84.info" returned: 0 in 0.239s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:54:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3a864017-c278-4e84-a96e-e441ff9b517c tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.990s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:54:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b7e42144-145b-4fd8-be4a-e7bec9a5a407 tempest-ProjectReaderTests-1670409969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.143s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:54:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b7e42144-145b-4fd8-be4a-e7bec9a5a407 tempest-ProjectReaderTests-1670409969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:54:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-157735340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4ffbb9b-941a-4441-a373-18c3fe314baa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d56a007e9e4ba89f4b6d5370c7ba2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:54:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:54:19Z,use_quota=True,user_id='e955dae4b7764986b0ede624af06668d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:54:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-b7e42144-145b-4fd8-be4a-e7bec9a5a407 tempest-ProjectReaderTests-1670409969 None] Creating volume d4ffbb9b-941a-4441-a373-18c3fe314baa {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:54:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b7e42144-145b-4fd8-be4a-e7bec9a5a407 tempest-ProjectReaderTests-1670409969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:54:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b7e42144-145b-4fd8-be4a-e7bec9a5a407 tempest-ProjectReaderTests-1670409969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:54:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b7e42144-145b-4fd8-be4a-e7bec9a5a407 tempest-ProjectReaderTests-1670409969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:54:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b7e42144-145b-4fd8-be4a-e7bec9a5a407 tempest-ProjectReaderTests-1670409969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:54:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b7e42144-145b-4fd8-be4a-e7bec9a5a407 tempest-ProjectReaderTests-1670409969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:54:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b7e42144-145b-4fd8-be4a-e7bec9a5a407 tempest-ProjectReaderTests-1670409969 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:54:19 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-b7e42144-145b-4fd8-be4a-e7bec9a5a407 tempest-ProjectReaderTests-1670409969 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:54:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b7e42144-145b-4fd8-be4a-e7bec9a5a407 tempest-ProjectReaderTests-1670409969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d4ffbb9b-941a-4441-a373-18c3fe314baa 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:54:19 devstack sudo[113005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d4ffbb9b-941a-4441-a373-18c3fe314baa 1073741824 Aug 11 04:54:19 devstack sudo[113005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:54:19 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-3a864017-c278-4e84-a96e-e441ff9b517c tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Create snapshot completed successfully Aug 11 04:54:19 devstack sudo[113005]: pam_unix(sudo:session): session closed for user root Aug 11 04:54:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b7e42144-145b-4fd8-be4a-e7bec9a5a407 tempest-ProjectReaderTests-1670409969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d4ffbb9b-941a-4441-a373-18c3fe314baa 1073741824" returned: 0 in 0.415s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:54:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b7e42144-145b-4fd8-be4a-e7bec9a5a407 tempest-ProjectReaderTests-1670409969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d4ffbb9b-941a-4441-a373-18c3fe314baa {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:54:19 devstack sudo[113047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d4ffbb9b-941a-4441-a373-18c3fe314baa Aug 11 04:54:19 devstack sudo[113047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:54:19 devstack sudo[113047]: pam_unix(sudo:session): session closed for user root Aug 11 04:54:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b7e42144-145b-4fd8-be4a-e7bec9a5a407 tempest-ProjectReaderTests-1670409969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d4ffbb9b-941a-4441-a373-18c3fe314baa" returned: 0 in 0.261s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:54:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b7e42144-145b-4fd8-be4a-e7bec9a5a407 tempest-ProjectReaderTests-1670409969 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:54:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b7e42144-145b-4fd8-be4a-e7bec9a5a407 tempest-ProjectReaderTests-1670409969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:54:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b7e42144-145b-4fd8-be4a-e7bec9a5a407 tempest-ProjectReaderTests-1670409969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d2a2cfd-40af-4236-a068-4bf07bd87e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4ffbb9b-941a-4441-a373-18c3fe314baa', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:54:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b7e42144-145b-4fd8-be4a-e7bec9a5a407 tempest-ProjectReaderTests-1670409969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20b30575-db7d-4331-898e-6990bc726e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:54:19 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-b7e42144-145b-4fd8-be4a-e7bec9a5a407 tempest-ProjectReaderTests-1670409969 None] Volume volume-d4ffbb9b-941a-4441-a373-18c3fe314baa (d4ffbb9b-941a-4441-a373-18c3fe314baa): created successfully Aug 11 04:54:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b7e42144-145b-4fd8-be4a-e7bec9a5a407 tempest-ProjectReaderTests-1670409969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20b30575-db7d-4331-898e-6990bc726e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:54:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b7e42144-145b-4fd8-be4a-e7bec9a5a407 tempest-ProjectReaderTests-1670409969 None] Flow 'volume_create_manager' (dff615d5-b422-4758-90a5-494befa8a8f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:54:19 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-b7e42144-145b-4fd8-be4a-e7bec9a5a407 tempest-ProjectReaderTests-1670409969 None] Created volume successfully. Aug 11 04:54:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-582712c3-c7d0-41bb-9e45-ac3dceed14c2 tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Acquiring lock "cinder-40774cfd-3160-4dfa-8d5a-d7d4c7c20fbe-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:54:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-582712c3-c7d0-41bb-9e45-ac3dceed14c2 tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Lock "cinder-40774cfd-3160-4dfa-8d5a-d7d4c7c20fbe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:54:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-582712c3-c7d0-41bb-9e45-ac3dceed14c2 tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Acquiring lock "cinder-quobyte-670a9b44-613d-4228-9020-ff10299bbb84" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:54:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-582712c3-c7d0-41bb-9e45-ac3dceed14c2 tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Lock "cinder-quobyte-670a9b44-613d-4228-9020-ff10299bbb84" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:54:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-582712c3-c7d0-41bb-9e45-ac3dceed14c2 tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Acquiring lock "cinder-quobyte-40774cfd-3160-4dfa-8d5a-d7d4c7c20fbe" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:54:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-582712c3-c7d0-41bb-9e45-ac3dceed14c2 tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Lock "cinder-quobyte-40774cfd-3160-4dfa-8d5a-d7d4c7c20fbe" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:54:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-582712c3-c7d0-41bb-9e45-ac3dceed14c2 tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Deleting offline snapshot 40774cfd-3160-4dfa-8d5a-d7d4c7c20fbe of volume 670a9b44-613d-4228-9020-ff10299bbb84 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 04:54:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-582712c3-c7d0-41bb-9e45-ac3dceed14c2 tempest-VolumesSnapshotNegativeTestJSON-343342279 None] snapshot_file for this snap is: volume-670a9b44-613d-4228-9020-ff10299bbb84.40774cfd-3160-4dfa-8d5a-d7d4c7c20fbe {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 04:54:20 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6dfc2d5-ff09-435e-9684-92195270edc3]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:54:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-582712c3-c7d0-41bb-9e45-ac3dceed14c2 tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-670a9b44-613d-4228-9020-ff10299bbb84.40774cfd-3160-4dfa-8d5a-d7d4c7c20fbe {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:54:20 devstack sudo[113050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-670a9b44-613d-4228-9020-ff10299bbb84.40774cfd-3160-4dfa-8d5a-d7d4c7c20fbe Aug 11 04:54:20 devstack sudo[113050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:54:20 devstack sudo[113050]: pam_unix(sudo:session): session closed for user root Aug 11 04:54:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-582712c3-c7d0-41bb-9e45-ac3dceed14c2 tempest-VolumesSnapshotNegativeTestJSON-343342279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-670a9b44-613d-4228-9020-ff10299bbb84.40774cfd-3160-4dfa-8d5a-d7d4c7c20fbe" returned: 0 in 0.347s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:54:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-582712c3-c7d0-41bb-9e45-ac3dceed14c2 tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-670a9b44-613d-4228-9020-ff10299bbb84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:54:20 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[e323d1e2-9739-43ae-94dd-a4bb06200d0d]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:54:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-582712c3-c7d0-41bb-9e45-ac3dceed14c2 tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-670a9b44-613d-4228-9020-ff10299bbb84 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:54:20 devstack sudo[113055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-670a9b44-613d-4228-9020-ff10299bbb84 Aug 11 04:54:20 devstack sudo[113055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:54:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-eb87bcef-5575-420d-bc1a-fa263dc29d21 tempest-ProjectReaderTests-1670409969 None] Acquiring lock "cinder-d4ffbb9b-941a-4441-a373-18c3fe314baa-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:54:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-eb87bcef-5575-420d-bc1a-fa263dc29d21 tempest-ProjectReaderTests-1670409969 None] Lock "cinder-d4ffbb9b-941a-4441-a373-18c3fe314baa-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:54:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-eb87bcef-5575-420d-bc1a-fa263dc29d21 tempest-ProjectReaderTests-1670409969 None] Acquiring lock "cinder-quobyte-d4ffbb9b-941a-4441-a373-18c3fe314baa" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:54:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-eb87bcef-5575-420d-bc1a-fa263dc29d21 tempest-ProjectReaderTests-1670409969 None] Lock "cinder-quobyte-d4ffbb9b-941a-4441-a373-18c3fe314baa" acquired by "delete_volume" :: waited 0.016s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:54:21 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b509cb-d668-4a7b-8543-82d26c8e6723]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:54:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-eb87bcef-5575-420d-bc1a-fa263dc29d21 tempest-ProjectReaderTests-1670409969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d4ffbb9b-941a-4441-a373-18c3fe314baa {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:54:21 devstack sudo[113055]: pam_unix(sudo:session): session closed for user root Aug 11 04:54:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-582712c3-c7d0-41bb-9e45-ac3dceed14c2 tempest-VolumesSnapshotNegativeTestJSON-343342279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-670a9b44-613d-4228-9020-ff10299bbb84" returned: 0 in 0.377s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:54:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-582712c3-c7d0-41bb-9e45-ac3dceed14c2 tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-670a9b44-613d-4228-9020-ff10299bbb84.40774cfd-3160-4dfa-8d5a-d7d4c7c20fbe {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:54:21 devstack sudo[113061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-670a9b44-613d-4228-9020-ff10299bbb84.40774cfd-3160-4dfa-8d5a-d7d4c7c20fbe Aug 11 04:54:21 devstack sudo[113061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:54:21 devstack sudo[113057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d4ffbb9b-941a-4441-a373-18c3fe314baa Aug 11 04:54:21 devstack sudo[113057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:54:21 devstack sudo[113057]: pam_unix(sudo:session): session closed for user root Aug 11 04:54:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-eb87bcef-5575-420d-bc1a-fa263dc29d21 tempest-ProjectReaderTests-1670409969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d4ffbb9b-941a-4441-a373-18c3fe314baa" returned: 0 in 0.368s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:54:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-eb87bcef-5575-420d-bc1a-fa263dc29d21 tempest-ProjectReaderTests-1670409969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d4ffbb9b-941a-4441-a373-18c3fe314baa {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:54:21 devstack sudo[113070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d4ffbb9b-941a-4441-a373-18c3fe314baa Aug 11 04:54:21 devstack sudo[113070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:54:21 devstack sudo[113061]: pam_unix(sudo:session): session closed for user root Aug 11 04:54:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-582712c3-c7d0-41bb-9e45-ac3dceed14c2 tempest-VolumesSnapshotNegativeTestJSON-343342279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-670a9b44-613d-4228-9020-ff10299bbb84.40774cfd-3160-4dfa-8d5a-d7d4c7c20fbe" returned: 0 in 0.346s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:54:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-582712c3-c7d0-41bb-9e45-ac3dceed14c2 tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-670a9b44-613d-4228-9020-ff10299bbb84.40774cfd-3160-4dfa-8d5a-d7d4c7c20fbe {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:54:21 devstack sudo[113072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-670a9b44-613d-4228-9020-ff10299bbb84.40774cfd-3160-4dfa-8d5a-d7d4c7c20fbe Aug 11 04:54:21 devstack sudo[113072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:54:21 devstack sudo[113070]: pam_unix(sudo:session): session closed for user root Aug 11 04:54:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-eb87bcef-5575-420d-bc1a-fa263dc29d21 tempest-ProjectReaderTests-1670409969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d4ffbb9b-941a-4441-a373-18c3fe314baa" returned: 0 in 0.253s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:54:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-eb87bcef-5575-420d-bc1a-fa263dc29d21 tempest-ProjectReaderTests-1670409969 None] Lock "cinder-quobyte-d4ffbb9b-941a-4441-a373-18c3fe314baa" released by "delete_volume" :: held 0.665s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:54:21 devstack sudo[113072]: pam_unix(sudo:session): session closed for user root Aug 11 04:54:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-582712c3-c7d0-41bb-9e45-ac3dceed14c2 tempest-VolumesSnapshotNegativeTestJSON-343342279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-670a9b44-613d-4228-9020-ff10299bbb84.40774cfd-3160-4dfa-8d5a-d7d4c7c20fbe" returned: 0 in 0.253s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:54:21 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-eb87bcef-5575-420d-bc1a-fa263dc29d21 tempest-ProjectReaderTests-1670409969 None] Created reservations ['6b6b22f2-969d-4896-827e-823e24e723c7', 'f7772d38-df58-4ba8-bad1-d08afcc2e098', 'e1ca63ac-6fd3-4cf5-8734-d9f058cb35fa', '58de2c6c-68ff-4f74-ab9a-50ef40908282'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:54:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-582712c3-c7d0-41bb-9e45-ac3dceed14c2 tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Lock "cinder-quobyte-40774cfd-3160-4dfa-8d5a-d7d4c7c20fbe" released by "_delete_snapshot" :: held 1.427s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:54:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-582712c3-c7d0-41bb-9e45-ac3dceed14c2 tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Lock "cinder-quobyte-670a9b44-613d-4228-9020-ff10299bbb84" released by "delete_snapshot" :: held 1.453s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:54:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-eb87bcef-5575-420d-bc1a-fa263dc29d21 tempest-ProjectReaderTests-1670409969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:54:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-eb87bcef-5575-420d-bc1a-fa263dc29d21 tempest-ProjectReaderTests-1670409969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:54:21 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-eb87bcef-5575-420d-bc1a-fa263dc29d21 tempest-ProjectReaderTests-1670409969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:54:21 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-eb87bcef-5575-420d-bc1a-fa263dc29d21 tempest-ProjectReaderTests-1670409969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:54:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-eb87bcef-5575-420d-bc1a-fa263dc29d21 tempest-ProjectReaderTests-1670409969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:54:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-eb87bcef-5575-420d-bc1a-fa263dc29d21 tempest-ProjectReaderTests-1670409969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:54:21 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-582712c3-c7d0-41bb-9e45-ac3dceed14c2 tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Created reservations ['422a3a87-d8ee-4839-b9e9-9f61927f27fc', '8017a6eb-7988-4d3a-b8ff-2fef1bc89548', '28e952b8-e4a1-451a-a039-5bc55392e635', 'cc819662-1783-4be7-9da9-8118fdb41a36'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:54:21 devstack sudo[113076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:54:21 devstack sudo[113076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:54:21 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-582712c3-c7d0-41bb-9e45-ac3dceed14c2 tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Delete snapshot completed successfully. Aug 11 04:54:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-582712c3-c7d0-41bb-9e45-ac3dceed14c2 tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Lock "cinder-40774cfd-3160-4dfa-8d5a-d7d4c7c20fbe-delete_snapshot" released by "delete_snapshot" :: held 1.624s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:54:22 devstack sudo[113076]: pam_unix(sudo:session): session closed for user root Aug 11 04:54:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-eb87bcef-5575-420d-bc1a-fa263dc29d21 tempest-ProjectReaderTests-1670409969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.252s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:54:22 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-eb87bcef-5575-420d-bc1a-fa263dc29d21 tempest-ProjectReaderTests-1670409969 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:54:22 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-eb87bcef-5575-420d-bc1a-fa263dc29d21 tempest-ProjectReaderTests-1670409969 None] Deleted volume successfully. Aug 11 04:54:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-eb87bcef-5575-420d-bc1a-fa263dc29d21 tempest-ProjectReaderTests-1670409969 None] Lock "cinder-d4ffbb9b-941a-4441-a373-18c3fe314baa-delete_volume" released by "delete_volume" :: held 1.159s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:54:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-3a109a1c-4e3a-4811-bc35-0e0d20f59e83 tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Acquiring lock "cinder-670a9b44-613d-4228-9020-ff10299bbb84-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:54:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-3a109a1c-4e3a-4811-bc35-0e0d20f59e83 tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Lock "cinder-670a9b44-613d-4228-9020-ff10299bbb84-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:54:22 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-9785d62f-08de-4a31-8c97-d00993f0bddc tempest-ProjectReaderTests-1670409969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:54:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9785d62f-08de-4a31-8c97-d00993f0bddc tempest-ProjectReaderTests-1670409969 None] Flow 'volume_create_manager' (61ba59a6-eaae-4fb6-be30-9ea0a3869368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:54:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9785d62f-08de-4a31-8c97-d00993f0bddc tempest-ProjectReaderTests-1670409969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af7f6223-894a-4827-8b8d-02da6d0e3113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:54:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9785d62f-08de-4a31-8c97-d00993f0bddc tempest-ProjectReaderTests-1670409969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af7f6223-894a-4827-8b8d-02da6d0e3113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:54:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1635238696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdd5809c-0613-4255-ab96-16a9d2cd098e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d56a007e9e4ba89f4b6d5370c7ba2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:54:23Z,use_quota=True,user_id='e955dae4b7764986b0ede624af06668d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:54:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9785d62f-08de-4a31-8c97-d00993f0bddc tempest-ProjectReaderTests-1670409969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3689644-3da1-4cde-b961-3ef109243b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:54:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9785d62f-08de-4a31-8c97-d00993f0bddc tempest-ProjectReaderTests-1670409969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3689644-3da1-4cde-b961-3ef109243b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:54:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9785d62f-08de-4a31-8c97-d00993f0bddc tempest-ProjectReaderTests-1670409969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51fb4a52-e5a6-41d0-a2a2-a3672eceeda6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:54:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9785d62f-08de-4a31-8c97-d00993f0bddc tempest-ProjectReaderTests-1670409969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51fb4a52-e5a6-41d0-a2a2-a3672eceeda6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdd5809c-0613-4255-ab96-16a9d2cd098e', 'volume_name': 'volume-bdd5809c-0613-4255-ab96-16a9d2cd098e', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:54:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9785d62f-08de-4a31-8c97-d00993f0bddc tempest-ProjectReaderTests-1670409969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (800b9ca6-593b-4229-8b36-41e8e174549f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:54:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9785d62f-08de-4a31-8c97-d00993f0bddc tempest-ProjectReaderTests-1670409969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (800b9ca6-593b-4229-8b36-41e8e174549f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:54:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9785d62f-08de-4a31-8c97-d00993f0bddc tempest-ProjectReaderTests-1670409969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59be488d-f436-4df2-abb2-f6db4bfacc09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:54:22 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-9785d62f-08de-4a31-8c97-d00993f0bddc tempest-ProjectReaderTests-1670409969 None] Volume bdd5809c-0613-4255-ab96-16a9d2cd098e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdd5809c-0613-4255-ab96-16a9d2cd098e', 'volume_size': 1} Aug 11 04:54:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9785d62f-08de-4a31-8c97-d00993f0bddc tempest-ProjectReaderTests-1670409969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:54:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9785d62f-08de-4a31-8c97-d00993f0bddc tempest-ProjectReaderTests-1670409969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:54:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9785d62f-08de-4a31-8c97-d00993f0bddc tempest-ProjectReaderTests-1670409969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:54:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1635238696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdd5809c-0613-4255-ab96-16a9d2cd098e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d56a007e9e4ba89f4b6d5370c7ba2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:54:23Z,use_quota=True,user_id='e955dae4b7764986b0ede624af06668d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:54:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-9785d62f-08de-4a31-8c97-d00993f0bddc tempest-ProjectReaderTests-1670409969 None] Creating volume bdd5809c-0613-4255-ab96-16a9d2cd098e {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:54:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9785d62f-08de-4a31-8c97-d00993f0bddc tempest-ProjectReaderTests-1670409969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:54:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9785d62f-08de-4a31-8c97-d00993f0bddc tempest-ProjectReaderTests-1670409969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:54:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9785d62f-08de-4a31-8c97-d00993f0bddc tempest-ProjectReaderTests-1670409969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:54:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9785d62f-08de-4a31-8c97-d00993f0bddc tempest-ProjectReaderTests-1670409969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:54:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9785d62f-08de-4a31-8c97-d00993f0bddc tempest-ProjectReaderTests-1670409969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:54:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9785d62f-08de-4a31-8c97-d00993f0bddc tempest-ProjectReaderTests-1670409969 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:54:22 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-9785d62f-08de-4a31-8c97-d00993f0bddc tempest-ProjectReaderTests-1670409969 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:54:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9785d62f-08de-4a31-8c97-d00993f0bddc tempest-ProjectReaderTests-1670409969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-bdd5809c-0613-4255-ab96-16a9d2cd098e 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:54:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-3a109a1c-4e3a-4811-bc35-0e0d20f59e83 tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Acquiring lock "cinder-quobyte-670a9b44-613d-4228-9020-ff10299bbb84" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:54:22 devstack sudo[113079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-bdd5809c-0613-4255-ab96-16a9d2cd098e 1073741824 Aug 11 04:54:22 devstack sudo[113079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:54:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-3a109a1c-4e3a-4811-bc35-0e0d20f59e83 tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Lock "cinder-quobyte-670a9b44-613d-4228-9020-ff10299bbb84" acquired by "delete_volume" :: waited 0.016s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:54:22 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5764db-e7c4-44d8-ac41-d1b501752ea3]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:54:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3a109a1c-4e3a-4811-bc35-0e0d20f59e83 tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-670a9b44-613d-4228-9020-ff10299bbb84 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:54:22 devstack sudo[113081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-670a9b44-613d-4228-9020-ff10299bbb84 Aug 11 04:54:22 devstack sudo[113081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:54:23 devstack sudo[113079]: pam_unix(sudo:session): session closed for user root Aug 11 04:54:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9785d62f-08de-4a31-8c97-d00993f0bddc tempest-ProjectReaderTests-1670409969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-bdd5809c-0613-4255-ab96-16a9d2cd098e 1073741824" returned: 0 in 0.432s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:54:23 devstack sudo[113081]: pam_unix(sudo:session): session closed for user root Aug 11 04:54:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3a109a1c-4e3a-4811-bc35-0e0d20f59e83 tempest-VolumesSnapshotNegativeTestJSON-343342279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-670a9b44-613d-4228-9020-ff10299bbb84" returned: 0 in 0.388s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:54:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3a109a1c-4e3a-4811-bc35-0e0d20f59e83 tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-670a9b44-613d-4228-9020-ff10299bbb84 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:54:23 devstack sudo[113090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-670a9b44-613d-4228-9020-ff10299bbb84 Aug 11 04:54:23 devstack sudo[113090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:54:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9785d62f-08de-4a31-8c97-d00993f0bddc tempest-ProjectReaderTests-1670409969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-bdd5809c-0613-4255-ab96-16a9d2cd098e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:54:23 devstack sudo[113092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-bdd5809c-0613-4255-ab96-16a9d2cd098e Aug 11 04:54:23 devstack sudo[113092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:54:23 devstack sudo[113090]: pam_unix(sudo:session): session closed for user root Aug 11 04:54:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3a109a1c-4e3a-4811-bc35-0e0d20f59e83 tempest-VolumesSnapshotNegativeTestJSON-343342279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-670a9b44-613d-4228-9020-ff10299bbb84" returned: 0 in 0.253s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:54:23 devstack sudo[113092]: pam_unix(sudo:session): session closed for user root Aug 11 04:54:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-3a109a1c-4e3a-4811-bc35-0e0d20f59e83 tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Lock "cinder-quobyte-670a9b44-613d-4228-9020-ff10299bbb84" released by "delete_volume" :: held 0.701s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:54:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9785d62f-08de-4a31-8c97-d00993f0bddc tempest-ProjectReaderTests-1670409969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-bdd5809c-0613-4255-ab96-16a9d2cd098e" returned: 0 in 0.246s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:54:23 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9785d62f-08de-4a31-8c97-d00993f0bddc tempest-ProjectReaderTests-1670409969 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:54:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9785d62f-08de-4a31-8c97-d00993f0bddc tempest-ProjectReaderTests-1670409969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:54:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9785d62f-08de-4a31-8c97-d00993f0bddc tempest-ProjectReaderTests-1670409969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59be488d-f436-4df2-abb2-f6db4bfacc09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdd5809c-0613-4255-ab96-16a9d2cd098e', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:54:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9785d62f-08de-4a31-8c97-d00993f0bddc tempest-ProjectReaderTests-1670409969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecf757a5-9079-4ec8-96bb-55875415380b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:54:23 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-9785d62f-08de-4a31-8c97-d00993f0bddc tempest-ProjectReaderTests-1670409969 None] Volume volume-bdd5809c-0613-4255-ab96-16a9d2cd098e (bdd5809c-0613-4255-ab96-16a9d2cd098e): created successfully Aug 11 04:54:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9785d62f-08de-4a31-8c97-d00993f0bddc tempest-ProjectReaderTests-1670409969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecf757a5-9079-4ec8-96bb-55875415380b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:54:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9785d62f-08de-4a31-8c97-d00993f0bddc tempest-ProjectReaderTests-1670409969 None] Flow 'volume_create_manager' (61ba59a6-eaae-4fb6-be30-9ea0a3869368) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:54:23 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-9785d62f-08de-4a31-8c97-d00993f0bddc tempest-ProjectReaderTests-1670409969 None] Created volume successfully. Aug 11 04:54:23 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-3a109a1c-4e3a-4811-bc35-0e0d20f59e83 tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Created reservations ['12ff06a8-b615-44b9-a7ea-ab1635ce6f89', '86050c16-89e9-456a-b48b-e69ce61da14b', 'd0311bf3-b9df-4f8f-b740-fcc7e8231119', 'de472a26-8392-4a7a-870f-4260e25f320a'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:54:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3a109a1c-4e3a-4811-bc35-0e0d20f59e83 tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:54:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3a109a1c-4e3a-4811-bc35-0e0d20f59e83 tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:54:23 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3a109a1c-4e3a-4811-bc35-0e0d20f59e83 tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:54:23 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3a109a1c-4e3a-4811-bc35-0e0d20f59e83 tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:54:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3a109a1c-4e3a-4811-bc35-0e0d20f59e83 tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:54:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3a109a1c-4e3a-4811-bc35-0e0d20f59e83 tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:54:23 devstack sudo[113097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:54:23 devstack sudo[113097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:54:23 devstack sudo[113097]: pam_unix(sudo:session): session closed for user root Aug 11 04:54:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3a109a1c-4e3a-4811-bc35-0e0d20f59e83 tempest-VolumesSnapshotNegativeTestJSON-343342279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.265s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:54:23 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-3a109a1c-4e3a-4811-bc35-0e0d20f59e83 tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:54:23 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-3a109a1c-4e3a-4811-bc35-0e0d20f59e83 tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Deleted volume successfully. Aug 11 04:54:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-3a109a1c-4e3a-4811-bc35-0e0d20f59e83 tempest-VolumesSnapshotNegativeTestJSON-343342279 None] Lock "cinder-670a9b44-613d-4228-9020-ff10299bbb84-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:54:24 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bc2b1da9-73b6-4467-b498-eb7053af2310 tempest-ProjectReaderTests-1670409969 None] Acquiring lock "cinder-bdd5809c-0613-4255-ab96-16a9d2cd098e-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:54:24 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bc2b1da9-73b6-4467-b498-eb7053af2310 tempest-ProjectReaderTests-1670409969 None] Lock "cinder-bdd5809c-0613-4255-ab96-16a9d2cd098e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:54:24 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bc2b1da9-73b6-4467-b498-eb7053af2310 tempest-ProjectReaderTests-1670409969 None] Acquiring lock "cinder-quobyte-bdd5809c-0613-4255-ab96-16a9d2cd098e" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:54:24 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bc2b1da9-73b6-4467-b498-eb7053af2310 tempest-ProjectReaderTests-1670409969 None] Lock "cinder-quobyte-bdd5809c-0613-4255-ab96-16a9d2cd098e" acquired by "delete_volume" :: waited 0.017s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:54:24 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[13cf0066-fece-4c8c-a8ac-51c1debd127e]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:54:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bc2b1da9-73b6-4467-b498-eb7053af2310 tempest-ProjectReaderTests-1670409969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-bdd5809c-0613-4255-ab96-16a9d2cd098e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:54:24 devstack sudo[113100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-bdd5809c-0613-4255-ab96-16a9d2cd098e Aug 11 04:54:24 devstack sudo[113100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:54:25 devstack sudo[113100]: pam_unix(sudo:session): session closed for user root Aug 11 04:54:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bc2b1da9-73b6-4467-b498-eb7053af2310 tempest-ProjectReaderTests-1670409969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-bdd5809c-0613-4255-ab96-16a9d2cd098e" returned: 0 in 0.392s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:54:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bc2b1da9-73b6-4467-b498-eb7053af2310 tempest-ProjectReaderTests-1670409969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-bdd5809c-0613-4255-ab96-16a9d2cd098e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:54:25 devstack sudo[113112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-bdd5809c-0613-4255-ab96-16a9d2cd098e Aug 11 04:54:25 devstack sudo[113112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:54:25 devstack sudo[113112]: pam_unix(sudo:session): session closed for user root Aug 11 04:54:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bc2b1da9-73b6-4467-b498-eb7053af2310 tempest-ProjectReaderTests-1670409969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-bdd5809c-0613-4255-ab96-16a9d2cd098e" returned: 0 in 0.258s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:54:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bc2b1da9-73b6-4467-b498-eb7053af2310 tempest-ProjectReaderTests-1670409969 None] Lock "cinder-quobyte-bdd5809c-0613-4255-ab96-16a9d2cd098e" released by "delete_volume" :: held 0.694s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:54:25 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-bc2b1da9-73b6-4467-b498-eb7053af2310 tempest-ProjectReaderTests-1670409969 None] Created reservations ['358d80b1-8528-483b-a5c4-e9eef877f23c', '2cb9364e-510c-424a-90f0-88f1438b397f', '799ddda4-2fab-4b6e-bc10-66edb0ec9562', 'b8814110-0b6b-466f-b675-b38a5a73fcd4'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:54:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bc2b1da9-73b6-4467-b498-eb7053af2310 tempest-ProjectReaderTests-1670409969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:54:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bc2b1da9-73b6-4467-b498-eb7053af2310 tempest-ProjectReaderTests-1670409969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:54:25 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-bc2b1da9-73b6-4467-b498-eb7053af2310 tempest-ProjectReaderTests-1670409969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:54:25 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-bc2b1da9-73b6-4467-b498-eb7053af2310 tempest-ProjectReaderTests-1670409969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:54:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bc2b1da9-73b6-4467-b498-eb7053af2310 tempest-ProjectReaderTests-1670409969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:54:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bc2b1da9-73b6-4467-b498-eb7053af2310 tempest-ProjectReaderTests-1670409969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:54:25 devstack sudo[113115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:54:25 devstack sudo[113115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:54:25 devstack sudo[113115]: pam_unix(sudo:session): session closed for user root Aug 11 04:54:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bc2b1da9-73b6-4467-b498-eb7053af2310 tempest-ProjectReaderTests-1670409969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.280s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:54:25 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-bc2b1da9-73b6-4467-b498-eb7053af2310 tempest-ProjectReaderTests-1670409969 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:54:25 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-bc2b1da9-73b6-4467-b498-eb7053af2310 tempest-ProjectReaderTests-1670409969 None] Deleted volume successfully. Aug 11 04:54:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bc2b1da9-73b6-4467-b498-eb7053af2310 tempest-ProjectReaderTests-1670409969 None] Lock "cinder-bdd5809c-0613-4255-ab96-16a9d2cd098e-delete_volume" released by "delete_volume" :: held 1.196s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:54:35 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=104,cinder:UPDATE=123,cinder:DELETE=13,cinder:INSERT=36 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:54:35 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:UPDATE=152,cinder:DELETE=12,cinder:SELECT=85,cinder:INSERT=37 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:54:56 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-a28be86b-a4f5-4e65-a493-6175720e3043 tempest-SnapshotDependencyTests-617682859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:54:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a28be86b-a4f5-4e65-a493-6175720e3043 tempest-SnapshotDependencyTests-617682859 None] Flow 'volume_create_manager' (aa4effd0-2f93-4e40-8bce-69f9a65df7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:54:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a28be86b-a4f5-4e65-a493-6175720e3043 tempest-SnapshotDependencyTests-617682859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d70a630-5733-4d08-8a45-12b92ac06b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:54:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a28be86b-a4f5-4e65-a493-6175720e3043 tempest-SnapshotDependencyTests-617682859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d70a630-5733-4d08-8a45-12b92ac06b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-155618689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87bcf2d4-8f8f-4b81-8130-967056f66a2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c4f03d047364aec8d69a825f3ded8ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:54:56Z,use_quota=True,user_id='fd0bdd70e2b9418c9501734e5048b8fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:54:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a28be86b-a4f5-4e65-a493-6175720e3043 tempest-SnapshotDependencyTests-617682859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e66461fb-21c2-475b-a54e-f60d753f06ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:54:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a28be86b-a4f5-4e65-a493-6175720e3043 tempest-SnapshotDependencyTests-617682859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e66461fb-21c2-475b-a54e-f60d753f06ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:54:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a28be86b-a4f5-4e65-a493-6175720e3043 tempest-SnapshotDependencyTests-617682859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30e1bf73-5752-43fb-87d0-bc40e6a76777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:54:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a28be86b-a4f5-4e65-a493-6175720e3043 tempest-SnapshotDependencyTests-617682859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30e1bf73-5752-43fb-87d0-bc40e6a76777) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87bcf2d4-8f8f-4b81-8130-967056f66a2c', 'volume_name': 'volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:54:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a28be86b-a4f5-4e65-a493-6175720e3043 tempest-SnapshotDependencyTests-617682859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f48887e0-e659-4628-aa32-169ecc196757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:54:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a28be86b-a4f5-4e65-a493-6175720e3043 tempest-SnapshotDependencyTests-617682859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f48887e0-e659-4628-aa32-169ecc196757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:54:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a28be86b-a4f5-4e65-a493-6175720e3043 tempest-SnapshotDependencyTests-617682859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3179cfb1-dc8e-47a3-b589-b233c6580cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:54:56 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-a28be86b-a4f5-4e65-a493-6175720e3043 tempest-SnapshotDependencyTests-617682859 None] Volume 87bcf2d4-8f8f-4b81-8130-967056f66a2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c', 'volume_size': 1} Aug 11 04:54:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a28be86b-a4f5-4e65-a493-6175720e3043 tempest-SnapshotDependencyTests-617682859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:54:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a28be86b-a4f5-4e65-a493-6175720e3043 tempest-SnapshotDependencyTests-617682859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:54:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a28be86b-a4f5-4e65-a493-6175720e3043 tempest-SnapshotDependencyTests-617682859 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-155618689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87bcf2d4-8f8f-4b81-8130-967056f66a2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c4f03d047364aec8d69a825f3ded8ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:54:56Z,use_quota=True,user_id='fd0bdd70e2b9418c9501734e5048b8fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:54:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-a28be86b-a4f5-4e65-a493-6175720e3043 tempest-SnapshotDependencyTests-617682859 None] Creating volume 87bcf2d4-8f8f-4b81-8130-967056f66a2c {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:54:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a28be86b-a4f5-4e65-a493-6175720e3043 tempest-SnapshotDependencyTests-617682859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:54:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a28be86b-a4f5-4e65-a493-6175720e3043 tempest-SnapshotDependencyTests-617682859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:54:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a28be86b-a4f5-4e65-a493-6175720e3043 tempest-SnapshotDependencyTests-617682859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:54:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a28be86b-a4f5-4e65-a493-6175720e3043 tempest-SnapshotDependencyTests-617682859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:54:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a28be86b-a4f5-4e65-a493-6175720e3043 tempest-SnapshotDependencyTests-617682859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:54:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a28be86b-a4f5-4e65-a493-6175720e3043 tempest-SnapshotDependencyTests-617682859 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:54:56 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-a28be86b-a4f5-4e65-a493-6175720e3043 tempest-SnapshotDependencyTests-617682859 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:54:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a28be86b-a4f5-4e65-a493-6175720e3043 tempest-SnapshotDependencyTests-617682859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:54:56 devstack sudo[113196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c 1073741824 Aug 11 04:54:56 devstack sudo[113196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:54:57 devstack sudo[113196]: pam_unix(sudo:session): session closed for user root Aug 11 04:54:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a28be86b-a4f5-4e65-a493-6175720e3043 tempest-SnapshotDependencyTests-617682859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c 1073741824" returned: 0 in 0.733s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:54:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a28be86b-a4f5-4e65-a493-6175720e3043 tempest-SnapshotDependencyTests-617682859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:54:57 devstack sudo[113234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c Aug 11 04:54:57 devstack sudo[113234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:54:57 devstack sudo[113234]: pam_unix(sudo:session): session closed for user root Aug 11 04:54:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a28be86b-a4f5-4e65-a493-6175720e3043 tempest-SnapshotDependencyTests-617682859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c" returned: 0 in 0.255s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:54:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a28be86b-a4f5-4e65-a493-6175720e3043 tempest-SnapshotDependencyTests-617682859 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:54:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a28be86b-a4f5-4e65-a493-6175720e3043 tempest-SnapshotDependencyTests-617682859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:54:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a28be86b-a4f5-4e65-a493-6175720e3043 tempest-SnapshotDependencyTests-617682859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3179cfb1-dc8e-47a3-b589-b233c6580cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:54:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a28be86b-a4f5-4e65-a493-6175720e3043 tempest-SnapshotDependencyTests-617682859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb019eda-33fb-4876-a559-89f2c2fba8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:54:57 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-a28be86b-a4f5-4e65-a493-6175720e3043 tempest-SnapshotDependencyTests-617682859 None] Volume volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c (87bcf2d4-8f8f-4b81-8130-967056f66a2c): created successfully Aug 11 04:54:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a28be86b-a4f5-4e65-a493-6175720e3043 tempest-SnapshotDependencyTests-617682859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb019eda-33fb-4876-a559-89f2c2fba8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:54:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a28be86b-a4f5-4e65-a493-6175720e3043 tempest-SnapshotDependencyTests-617682859 None] Flow 'volume_create_manager' (aa4effd0-2f93-4e40-8bce-69f9a65df7c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:54:57 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-a28be86b-a4f5-4e65-a493-6175720e3043 tempest-SnapshotDependencyTests-617682859 None] Created volume successfully. Aug 11 04:54:58 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 04:54:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:54:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:54:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:54:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:54:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:54:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:54:58 devstack sudo[113253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:54:58 devstack sudo[113253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:54:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-df1bcd10-ccd6-4807-8d6c-a76c0866f508 tempest-SnapshotDependencyTests-617682859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:54:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-df1bcd10-ccd6-4807-8d6c-a76c0866f508 tempest-SnapshotDependencyTests-617682859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:54:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-df1bcd10-ccd6-4807-8d6c-a76c0866f508 tempest-SnapshotDependencyTests-617682859 None] Creating offline snapshot 8a56c4d4-53c3-4369-850d-ac87afdda504 of volume 87bcf2d4-8f8f-4b81-8130-967056f66a2c {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 04:54:58 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d60dcd-6fcd-4b47-8169-9b3658962922]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:54:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-df1bcd10-ccd6-4807-8d6c-a76c0866f508 tempest-SnapshotDependencyTests-617682859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:54:58 devstack sudo[113253]: pam_unix(sudo:session): session closed for user root Aug 11 04:54:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.455s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:54:58 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:54:58 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running periodic task VolumeManager._thread_info {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 04:54:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] thread count: 28 {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 11 04:54:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] thread info: [<_MainThread(MainThread, started 133315846115456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 11 04:54:59 devstack sudo[113258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c Aug 11 04:54:59 devstack sudo[113258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:54:59 devstack sudo[113258]: pam_unix(sudo:session): session closed for user root Aug 11 04:54:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-df1bcd10-ccd6-4807-8d6c-a76c0866f508 tempest-SnapshotDependencyTests-617682859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c" returned: 0 in 0.487s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:54:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-df1bcd10-ccd6-4807-8d6c-a76c0866f508 tempest-SnapshotDependencyTests-617682859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c.8a56c4d4-53c3-4369-850d-ac87afdda504 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:54:59 devstack sudo[113271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c.8a56c4d4-53c3-4369-850d-ac87afdda504 1G Aug 11 04:54:59 devstack sudo[113271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:54:59 devstack sudo[113271]: pam_unix(sudo:session): session closed for user root Aug 11 04:55:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-df1bcd10-ccd6-4807-8d6c-a76c0866f508 tempest-SnapshotDependencyTests-617682859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c.8a56c4d4-53c3-4369-850d-ac87afdda504 1G" returned: 0 in 0.582s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:55:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-df1bcd10-ccd6-4807-8d6c-a76c0866f508 tempest-SnapshotDependencyTests-617682859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c.8a56c4d4-53c3-4369-850d-ac87afdda504 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:55:00 devstack sudo[113277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c.8a56c4d4-53c3-4369-850d-ac87afdda504 Aug 11 04:55:00 devstack sudo[113277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:55:00 devstack sudo[113277]: pam_unix(sudo:session): session closed for user root Aug 11 04:55:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-df1bcd10-ccd6-4807-8d6c-a76c0866f508 tempest-SnapshotDependencyTests-617682859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c.8a56c4d4-53c3-4369-850d-ac87afdda504" returned: 0 in 0.356s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:55:00 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-df1bcd10-ccd6-4807-8d6c-a76c0866f508 tempest-SnapshotDependencyTests-617682859 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c.8a56c4d4-53c3-4369-850d-ac87afdda504 is being set with open permissions: ugo+rw Aug 11 04:55:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-df1bcd10-ccd6-4807-8d6c-a76c0866f508 tempest-SnapshotDependencyTests-617682859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c.8a56c4d4-53c3-4369-850d-ac87afdda504 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:55:00 devstack sudo[113282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c.8a56c4d4-53c3-4369-850d-ac87afdda504 Aug 11 04:55:00 devstack sudo[113282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:55:00 devstack sudo[113282]: pam_unix(sudo:session): session closed for user root Aug 11 04:55:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-df1bcd10-ccd6-4807-8d6c-a76c0866f508 tempest-SnapshotDependencyTests-617682859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c.8a56c4d4-53c3-4369-850d-ac87afdda504" returned: 0 in 0.278s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:55:00 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a800cae-9783-40cb-953f-ea96fc99e0c0 tempest-TestMinimumBasicScenario-418018741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:55:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6a800cae-9783-40cb-953f-ea96fc99e0c0 tempest-TestMinimumBasicScenario-418018741 None] Flow 'volume_create_manager' (d9fc697e-5465-4385-9061-e04f6c74fdfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:55:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6a800cae-9783-40cb-953f-ea96fc99e0c0 tempest-TestMinimumBasicScenario-418018741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f568a7c-3c67-4111-a9d0-c42f2c63de0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:55:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6a800cae-9783-40cb-953f-ea96fc99e0c0 tempest-TestMinimumBasicScenario-418018741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f568a7c-3c67-4111-a9d0-c42f2c63de0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-888562218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38a2b800-d5fd-46e6-9b9b-438ddfd6dc0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20da0abbcc4f4589bc5561329445eac9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:55:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:55:01Z,use_quota=True,user_id='4c5b03b4033f44c9b0ab4a303f1bfa72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:55:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6a800cae-9783-40cb-953f-ea96fc99e0c0 tempest-TestMinimumBasicScenario-418018741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfd7b2bb-b36f-4443-b7dd-41486b0eb2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:55:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6a800cae-9783-40cb-953f-ea96fc99e0c0 tempest-TestMinimumBasicScenario-418018741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfd7b2bb-b36f-4443-b7dd-41486b0eb2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:55:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6a800cae-9783-40cb-953f-ea96fc99e0c0 tempest-TestMinimumBasicScenario-418018741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98aeb8f1-486b-4289-9a6d-dd34647b916e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:55:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6a800cae-9783-40cb-953f-ea96fc99e0c0 tempest-TestMinimumBasicScenario-418018741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98aeb8f1-486b-4289-9a6d-dd34647b916e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38a2b800-d5fd-46e6-9b9b-438ddfd6dc0b', 'volume_name': 'volume-38a2b800-d5fd-46e6-9b9b-438ddfd6dc0b', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:55:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6a800cae-9783-40cb-953f-ea96fc99e0c0 tempest-TestMinimumBasicScenario-418018741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3c015c6-e0eb-43a7-bb53-668c27595510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:55:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6a800cae-9783-40cb-953f-ea96fc99e0c0 tempest-TestMinimumBasicScenario-418018741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3c015c6-e0eb-43a7-bb53-668c27595510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:55:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6a800cae-9783-40cb-953f-ea96fc99e0c0 tempest-TestMinimumBasicScenario-418018741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6730fee-2335-4c28-bdf9-643773a7b4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:55:00 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-6a800cae-9783-40cb-953f-ea96fc99e0c0 tempest-TestMinimumBasicScenario-418018741 None] Volume 38a2b800-d5fd-46e6-9b9b-438ddfd6dc0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38a2b800-d5fd-46e6-9b9b-438ddfd6dc0b', 'volume_size': 1} Aug 11 04:55:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6a800cae-9783-40cb-953f-ea96fc99e0c0 tempest-TestMinimumBasicScenario-418018741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:55:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-df1bcd10-ccd6-4807-8d6c-a76c0866f508 tempest-SnapshotDependencyTests-617682859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:55:00 devstack sudo[113285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c.info Aug 11 04:55:00 devstack sudo[113285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:55:01 devstack sudo[113285]: pam_unix(sudo:session): session closed for user root Aug 11 04:55:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-df1bcd10-ccd6-4807-8d6c-a76c0866f508 tempest-SnapshotDependencyTests-617682859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c.info" returned: 0 in 0.274s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:55:01 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-df1bcd10-ccd6-4807-8d6c-a76c0866f508 tempest-SnapshotDependencyTests-617682859 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c.info is being set with open permissions: ugo+rw Aug 11 04:55:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-df1bcd10-ccd6-4807-8d6c-a76c0866f508 tempest-SnapshotDependencyTests-617682859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:55:01 devstack sudo[113288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c.info Aug 11 04:55:01 devstack sudo[113288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:55:01 devstack sudo[113288]: pam_unix(sudo:session): session closed for user root Aug 11 04:55:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-df1bcd10-ccd6-4807-8d6c-a76c0866f508 tempest-SnapshotDependencyTests-617682859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c.info" returned: 0 in 0.264s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:55:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-df1bcd10-ccd6-4807-8d6c-a76c0866f508 tempest-SnapshotDependencyTests-617682859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.445s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:55:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6a800cae-9783-40cb-953f-ea96fc99e0c0 tempest-TestMinimumBasicScenario-418018741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.567s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:55:01 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6a800cae-9783-40cb-953f-ea96fc99e0c0 tempest-TestMinimumBasicScenario-418018741 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-888562218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38a2b800-d5fd-46e6-9b9b-438ddfd6dc0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20da0abbcc4f4589bc5561329445eac9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:55:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:55:01Z,use_quota=True,user_id='4c5b03b4033f44c9b0ab4a303f1bfa72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:55:01 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-6a800cae-9783-40cb-953f-ea96fc99e0c0 tempest-TestMinimumBasicScenario-418018741 None] Creating volume 38a2b800-d5fd-46e6-9b9b-438ddfd6dc0b {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:55:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6a800cae-9783-40cb-953f-ea96fc99e0c0 tempest-TestMinimumBasicScenario-418018741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:55:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6a800cae-9783-40cb-953f-ea96fc99e0c0 tempest-TestMinimumBasicScenario-418018741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:55:01 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6a800cae-9783-40cb-953f-ea96fc99e0c0 tempest-TestMinimumBasicScenario-418018741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:55:01 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6a800cae-9783-40cb-953f-ea96fc99e0c0 tempest-TestMinimumBasicScenario-418018741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:55:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6a800cae-9783-40cb-953f-ea96fc99e0c0 tempest-TestMinimumBasicScenario-418018741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:55:01 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6a800cae-9783-40cb-953f-ea96fc99e0c0 tempest-TestMinimumBasicScenario-418018741 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:55:01 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-6a800cae-9783-40cb-953f-ea96fc99e0c0 tempest-TestMinimumBasicScenario-418018741 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:55:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6a800cae-9783-40cb-953f-ea96fc99e0c0 tempest-TestMinimumBasicScenario-418018741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-38a2b800-d5fd-46e6-9b9b-438ddfd6dc0b 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:55:01 devstack sudo[113291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-38a2b800-d5fd-46e6-9b9b-438ddfd6dc0b 1073741824 Aug 11 04:55:01 devstack sudo[113291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:55:01 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-df1bcd10-ccd6-4807-8d6c-a76c0866f508 tempest-SnapshotDependencyTests-617682859 None] Create snapshot completed successfully Aug 11 04:55:01 devstack sudo[113291]: pam_unix(sudo:session): session closed for user root Aug 11 04:55:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6a800cae-9783-40cb-953f-ea96fc99e0c0 tempest-TestMinimumBasicScenario-418018741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-38a2b800-d5fd-46e6-9b9b-438ddfd6dc0b 1073741824" returned: 0 in 0.450s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:55:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6a800cae-9783-40cb-953f-ea96fc99e0c0 tempest-TestMinimumBasicScenario-418018741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-38a2b800-d5fd-46e6-9b9b-438ddfd6dc0b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:55:01 devstack sudo[113299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-38a2b800-d5fd-46e6-9b9b-438ddfd6dc0b Aug 11 04:55:01 devstack sudo[113299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:55:02 devstack sudo[113299]: pam_unix(sudo:session): session closed for user root Aug 11 04:55:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6a800cae-9783-40cb-953f-ea96fc99e0c0 tempest-TestMinimumBasicScenario-418018741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-38a2b800-d5fd-46e6-9b9b-438ddfd6dc0b" returned: 0 in 0.263s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:55:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6a800cae-9783-40cb-953f-ea96fc99e0c0 tempest-TestMinimumBasicScenario-418018741 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:55:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6a800cae-9783-40cb-953f-ea96fc99e0c0 tempest-TestMinimumBasicScenario-418018741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:55:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6a800cae-9783-40cb-953f-ea96fc99e0c0 tempest-TestMinimumBasicScenario-418018741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6730fee-2335-4c28-bdf9-643773a7b4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38a2b800-d5fd-46e6-9b9b-438ddfd6dc0b', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:55:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6a800cae-9783-40cb-953f-ea96fc99e0c0 tempest-TestMinimumBasicScenario-418018741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a77d4b9-e203-4ce3-8b70-70b5353ea409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:55:02 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-6a800cae-9783-40cb-953f-ea96fc99e0c0 tempest-TestMinimumBasicScenario-418018741 None] Volume volume-38a2b800-d5fd-46e6-9b9b-438ddfd6dc0b (38a2b800-d5fd-46e6-9b9b-438ddfd6dc0b): created successfully Aug 11 04:55:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6a800cae-9783-40cb-953f-ea96fc99e0c0 tempest-TestMinimumBasicScenario-418018741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a77d4b9-e203-4ce3-8b70-70b5353ea409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:55:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6a800cae-9783-40cb-953f-ea96fc99e0c0 tempest-TestMinimumBasicScenario-418018741 None] Flow 'volume_create_manager' (d9fc697e-5465-4385-9061-e04f6c74fdfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:55:02 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-6a800cae-9783-40cb-953f-ea96fc99e0c0 tempest-TestMinimumBasicScenario-418018741 None] Created volume successfully. Aug 11 04:55:02 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b1fc8c3-dbd7-4c52-9736-20996e8a3882 tempest-SnapshotDependencyTests-617682859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:55:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5b1fc8c3-dbd7-4c52-9736-20996e8a3882 tempest-SnapshotDependencyTests-617682859 None] Flow 'volume_create_manager' (b84b565e-4f71-4de6-ae7e-15bd0bed4504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:55:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5b1fc8c3-dbd7-4c52-9736-20996e8a3882 tempest-SnapshotDependencyTests-617682859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1660a78d-e0fb-4407-8dcc-58700d9c1041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:55:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5b1fc8c3-dbd7-4c52-9736-20996e8a3882 tempest-SnapshotDependencyTests-617682859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1660a78d-e0fb-4407-8dcc-58700d9c1041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:55:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b95c0614-2ce0-4dd7-93ab-15c83d83682d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c4f03d047364aec8d69a825f3ded8ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:55:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8a56c4d4-53c3-4369-850d-ac87afdda504,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:55:02Z,use_quota=True,user_id='fd0bdd70e2b9418c9501734e5048b8fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:55:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5b1fc8c3-dbd7-4c52-9736-20996e8a3882 tempest-SnapshotDependencyTests-617682859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78259aa7-4439-4479-bcf3-09a4b5242182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:55:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5b1fc8c3-dbd7-4c52-9736-20996e8a3882 tempest-SnapshotDependencyTests-617682859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78259aa7-4439-4479-bcf3-09a4b5242182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:55:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5b1fc8c3-dbd7-4c52-9736-20996e8a3882 tempest-SnapshotDependencyTests-617682859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d7b0a3c-67df-4beb-811e-e4d9f3fbae54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:55:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5b1fc8c3-dbd7-4c52-9736-20996e8a3882 tempest-SnapshotDependencyTests-617682859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d7b0a3c-67df-4beb-811e-e4d9f3fbae54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b95c0614-2ce0-4dd7-93ab-15c83d83682d', 'volume_name': 'volume-b95c0614-2ce0-4dd7-93ab-15c83d83682d', 'volume_size': 1, 'snapshot_id': '8a56c4d4-53c3-4369-850d-ac87afdda504'}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:55:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5b1fc8c3-dbd7-4c52-9736-20996e8a3882 tempest-SnapshotDependencyTests-617682859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e58315a-9fff-4b7b-83c4-3e37e7875798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:55:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5b1fc8c3-dbd7-4c52-9736-20996e8a3882 tempest-SnapshotDependencyTests-617682859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e58315a-9fff-4b7b-83c4-3e37e7875798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:55:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5b1fc8c3-dbd7-4c52-9736-20996e8a3882 tempest-SnapshotDependencyTests-617682859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9681f0c2-59b3-4656-accd-04d78f5d971d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:55:02 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-5b1fc8c3-dbd7-4c52-9736-20996e8a3882 tempest-SnapshotDependencyTests-617682859 None] Volume b95c0614-2ce0-4dd7-93ab-15c83d83682d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b95c0614-2ce0-4dd7-93ab-15c83d83682d', 'volume_size': 1, 'snapshot_id': '8a56c4d4-53c3-4369-850d-ac87afdda504'} Aug 11 04:55:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5b1fc8c3-dbd7-4c52-9736-20996e8a3882 tempest-SnapshotDependencyTests-617682859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:55:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5b1fc8c3-dbd7-4c52-9736-20996e8a3882 tempest-SnapshotDependencyTests-617682859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:55:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5b1fc8c3-dbd7-4c52-9736-20996e8a3882 tempest-SnapshotDependencyTests-617682859 None] Acquiring lock "cinder-quobyte-8a56c4d4-53c3-4369-850d-ac87afdda504-b95c0614-2ce0-4dd7-93ab-15c83d83682d" by "_create_volume_from_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:55:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5b1fc8c3-dbd7-4c52-9736-20996e8a3882 tempest-SnapshotDependencyTests-617682859 None] Lock "cinder-quobyte-8a56c4d4-53c3-4369-850d-ac87afdda504-b95c0614-2ce0-4dd7-93ab-15c83d83682d" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:55:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-5b1fc8c3-dbd7-4c52-9736-20996e8a3882 tempest-SnapshotDependencyTests-617682859 None] Creating volume b95c0614-2ce0-4dd7-93ab-15c83d83682d from snapshot 8a56c4d4-53c3-4369-850d-ac87afdda504 {{(pid=94472) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 11 04:55:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5b1fc8c3-dbd7-4c52-9736-20996e8a3882 tempest-SnapshotDependencyTests-617682859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:55:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5b1fc8c3-dbd7-4c52-9736-20996e8a3882 tempest-SnapshotDependencyTests-617682859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:55:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-5b1fc8c3-dbd7-4c52-9736-20996e8a3882 tempest-SnapshotDependencyTests-617682859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:55:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-5b1fc8c3-dbd7-4c52-9736-20996e8a3882 tempest-SnapshotDependencyTests-617682859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:55:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5b1fc8c3-dbd7-4c52-9736-20996e8a3882 tempest-SnapshotDependencyTests-617682859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:55:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-5b1fc8c3-dbd7-4c52-9736-20996e8a3882 tempest-SnapshotDependencyTests-617682859 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:55:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5b1fc8c3-dbd7-4c52-9736-20996e8a3882 tempest-SnapshotDependencyTests-617682859 None] Acquiring lock "cinder-quobyte-b95c0614-2ce0-4dd7-93ab-15c83d83682d" by "_copy_volume_from_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:55:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5b1fc8c3-dbd7-4c52-9736-20996e8a3882 tempest-SnapshotDependencyTests-617682859 None] Lock "cinder-quobyte-b95c0614-2ce0-4dd7-93ab-15c83d83682d" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:55:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-5b1fc8c3-dbd7-4c52-9736-20996e8a3882 tempest-SnapshotDependencyTests-617682859 None] snapshot: 8a56c4d4-53c3-4369-850d-ac87afdda504, volume: b95c0614-2ce0-4dd7-93ab-15c83d83682d, {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 11 04:55:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5b1fc8c3-dbd7-4c52-9736-20996e8a3882 tempest-SnapshotDependencyTests-617682859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:55:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5b1fc8c3-dbd7-4c52-9736-20996e8a3882 tempest-SnapshotDependencyTests-617682859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:55:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-5b1fc8c3-dbd7-4c52-9736-20996e8a3882 tempest-SnapshotDependencyTests-617682859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:55:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-5b1fc8c3-dbd7-4c52-9736-20996e8a3882 tempest-SnapshotDependencyTests-617682859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:55:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5b1fc8c3-dbd7-4c52-9736-20996e8a3882 tempest-SnapshotDependencyTests-617682859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:55:02 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8e9557-00cd-44d4-b404-f9079115ab1c]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:55:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5b1fc8c3-dbd7-4c52-9736-20996e8a3882 tempest-SnapshotDependencyTests-617682859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c.8a56c4d4-53c3-4369-850d-ac87afdda504 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:55:02 devstack sudo[113302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c.8a56c4d4-53c3-4369-850d-ac87afdda504 Aug 11 04:55:02 devstack sudo[113302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:55:03 devstack sudo[113302]: pam_unix(sudo:session): session closed for user root Aug 11 04:55:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5b1fc8c3-dbd7-4c52-9736-20996e8a3882 tempest-SnapshotDependencyTests-617682859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c.8a56c4d4-53c3-4369-850d-ac87afdda504" returned: 0 in 0.423s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:55:03 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-5b1fc8c3-dbd7-4c52-9736-20996e8a3882 tempest-SnapshotDependencyTests-617682859 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:55:03 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[5017c303-88b2-4813-9190-1e080496b93e]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:55:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5b1fc8c3-dbd7-4c52-9736-20996e8a3882 tempest-SnapshotDependencyTests-617682859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:55:03 devstack sudo[113310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c Aug 11 04:55:03 devstack sudo[113310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:55:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-36470893-dc00-4577-aeef-93454f6d7952 req-08765a78-25d1-4563-8066-0b931ed4144d tempest-TestMinimumBasicScenario-418018741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:55:03 devstack sudo[113310]: pam_unix(sudo:session): session closed for user root Aug 11 04:55:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5b1fc8c3-dbd7-4c52-9736-20996e8a3882 tempest-SnapshotDependencyTests-617682859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c" returned: 0 in 0.442s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:55:03 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-5b1fc8c3-dbd7-4c52-9736-20996e8a3882 tempest-SnapshotDependencyTests-617682859 None] will copy from snapshot at /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 11 04:55:03 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-5b1fc8c3-dbd7-4c52-9736-20996e8a3882 tempest-SnapshotDependencyTests-617682859 None] Creating direct copy from snapshot {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 11 04:55:03 devstack cinder-volume[94472]: DEBUG cinder.utils [None req-5b1fc8c3-dbd7-4c52-9736-20996e8a3882 tempest-SnapshotDependencyTests-617682859 None] Path /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b95c0614-2ce0-4dd7-93ab-15c83d83682d not found in is_blk_device check {{(pid=94472) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 11 04:55:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5b1fc8c3-dbd7-4c52-9736-20996e8a3882 tempest-SnapshotDependencyTests-617682859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b95c0614-2ce0-4dd7-93ab-15c83d83682d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:55:03 devstack sudo[113324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b95c0614-2ce0-4dd7-93ab-15c83d83682d Aug 11 04:55:03 devstack sudo[113324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:55:08 devstack sudo[113324]: pam_unix(sudo:session): session closed for user root Aug 11 04:55:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5b1fc8c3-dbd7-4c52-9736-20996e8a3882 tempest-SnapshotDependencyTests-617682859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b95c0614-2ce0-4dd7-93ab-15c83d83682d" returned: 0 in 5.302s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:55:09 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-5b1fc8c3-dbd7-4c52-9736-20996e8a3882 tempest-SnapshotDependencyTests-617682859 None] Image conversion details: src /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c, size 1024.00 MB, duration 5.30 sec, destination /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b95c0614-2ce0-4dd7-93ab-15c83d83682d {{(pid=94472) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 11 04:55:09 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-5b1fc8c3-dbd7-4c52-9736-20996e8a3882 tempest-SnapshotDependencyTests-617682859 None] Converted 1024.00 MB image at 193.10 MB/s Aug 11 04:55:09 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-5b1fc8c3-dbd7-4c52-9736-20996e8a3882 tempest-SnapshotDependencyTests-617682859 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b95c0614-2ce0-4dd7-93ab-15c83d83682d is being set with open permissions: ugo+rw Aug 11 04:55:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5b1fc8c3-dbd7-4c52-9736-20996e8a3882 tempest-SnapshotDependencyTests-617682859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b95c0614-2ce0-4dd7-93ab-15c83d83682d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:55:09 devstack sudo[113337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b95c0614-2ce0-4dd7-93ab-15c83d83682d Aug 11 04:55:09 devstack sudo[113337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:55:09 devstack sudo[113337]: pam_unix(sudo:session): session closed for user root Aug 11 04:55:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5b1fc8c3-dbd7-4c52-9736-20996e8a3882 tempest-SnapshotDependencyTests-617682859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b95c0614-2ce0-4dd7-93ab-15c83d83682d" returned: 0 in 0.275s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:55:09 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5b1fc8c3-dbd7-4c52-9736-20996e8a3882 tempest-SnapshotDependencyTests-617682859 None] Lock "cinder-quobyte-b95c0614-2ce0-4dd7-93ab-15c83d83682d" released by "_copy_volume_from_snapshot" :: held 6.545s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:55:09 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5b1fc8c3-dbd7-4c52-9736-20996e8a3882 tempest-SnapshotDependencyTests-617682859 None] Lock "cinder-quobyte-8a56c4d4-53c3-4369-850d-ac87afdda504-b95c0614-2ce0-4dd7-93ab-15c83d83682d" released by "_create_volume_from_snapshot" :: held 6.620s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:55:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5b1fc8c3-dbd7-4c52-9736-20996e8a3882 tempest-SnapshotDependencyTests-617682859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.643s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:55:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-36470893-dc00-4577-aeef-93454f6d7952 req-08765a78-25d1-4563-8066-0b931ed4144d tempest-TestMinimumBasicScenario-418018741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.662s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:55:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-36470893-dc00-4577-aeef-93454f6d7952 req-08765a78-25d1-4563-8066-0b931ed4144d tempest-TestMinimumBasicScenario-418018741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:55:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5b1fc8c3-dbd7-4c52-9736-20996e8a3882 tempest-SnapshotDependencyTests-617682859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9681f0c2-59b3-4656-accd-04d78f5d971d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b95c0614-2ce0-4dd7-93ab-15c83d83682d', 'volume_size': 1, 'snapshot_id': '8a56c4d4-53c3-4369-850d-ac87afdda504'}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:55:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5b1fc8c3-dbd7-4c52-9736-20996e8a3882 tempest-SnapshotDependencyTests-617682859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75d6a9c6-59b1-4086-bb84-c2ee1b1e2efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:55:09 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-5b1fc8c3-dbd7-4c52-9736-20996e8a3882 tempest-SnapshotDependencyTests-617682859 None] Volume volume-b95c0614-2ce0-4dd7-93ab-15c83d83682d (b95c0614-2ce0-4dd7-93ab-15c83d83682d): created successfully Aug 11 04:55:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5b1fc8c3-dbd7-4c52-9736-20996e8a3882 tempest-SnapshotDependencyTests-617682859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75d6a9c6-59b1-4086-bb84-c2ee1b1e2efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:55:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5b1fc8c3-dbd7-4c52-9736-20996e8a3882 tempest-SnapshotDependencyTests-617682859 None] Flow 'volume_create_manager' (b84b565e-4f71-4de6-ae7e-15bd0bed4504) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:55:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-36470893-dc00-4577-aeef-93454f6d7952 req-08765a78-25d1-4563-8066-0b931ed4144d tempest-TestMinimumBasicScenario-418018741 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd', 'name': 'volume-38a2b800-d5fd-46e6-9b9b-438ddfd6dc0b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '72e3cc92-b31d-4ccb-99b6-12df235dffe1', 'enforce_multipath': True} {{(pid=94472) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 11 04:55:09 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-5b1fc8c3-dbd7-4c52-9736-20996e8a3882 tempest-SnapshotDependencyTests-617682859 None] Created volume successfully. Aug 11 04:55:09 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-36470893-dc00-4577-aeef-93454f6d7952 req-08765a78-25d1-4563-8066-0b931ed4144d tempest-TestMinimumBasicScenario-418018741 None] attachment_update completed successfully. Aug 11 04:55:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a50c4ff2-36bb-4b49-951e-000a75536f0a tempest-SnapshotDependencyTests-617682859 None] Acquiring lock "cinder-8a56c4d4-53c3-4369-850d-ac87afdda504-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:55:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a50c4ff2-36bb-4b49-951e-000a75536f0a tempest-SnapshotDependencyTests-617682859 None] Lock "cinder-8a56c4d4-53c3-4369-850d-ac87afdda504-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:55:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a50c4ff2-36bb-4b49-951e-000a75536f0a tempest-SnapshotDependencyTests-617682859 None] Acquiring lock "cinder-quobyte-87bcf2d4-8f8f-4b81-8130-967056f66a2c" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:55:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a50c4ff2-36bb-4b49-951e-000a75536f0a tempest-SnapshotDependencyTests-617682859 None] Lock "cinder-quobyte-87bcf2d4-8f8f-4b81-8130-967056f66a2c" acquired by "delete_snapshot" :: waited 0.028s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:55:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a50c4ff2-36bb-4b49-951e-000a75536f0a tempest-SnapshotDependencyTests-617682859 None] Acquiring lock "cinder-quobyte-8a56c4d4-53c3-4369-850d-ac87afdda504" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:55:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a50c4ff2-36bb-4b49-951e-000a75536f0a tempest-SnapshotDependencyTests-617682859 None] Lock "cinder-quobyte-8a56c4d4-53c3-4369-850d-ac87afdda504" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:55:10 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-a50c4ff2-36bb-4b49-951e-000a75536f0a tempest-SnapshotDependencyTests-617682859 None] Deleting offline snapshot 8a56c4d4-53c3-4369-850d-ac87afdda504 of volume 87bcf2d4-8f8f-4b81-8130-967056f66a2c {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 04:55:10 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-a50c4ff2-36bb-4b49-951e-000a75536f0a tempest-SnapshotDependencyTests-617682859 None] snapshot_file for this snap is: volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c.8a56c4d4-53c3-4369-850d-ac87afdda504 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 04:55:10 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[8edd1a1b-dda5-41cc-91d2-a38f33a9f916]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:55:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a50c4ff2-36bb-4b49-951e-000a75536f0a tempest-SnapshotDependencyTests-617682859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c.8a56c4d4-53c3-4369-850d-ac87afdda504 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:55:10 devstack sudo[114142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c.8a56c4d4-53c3-4369-850d-ac87afdda504 Aug 11 04:55:10 devstack sudo[114142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:55:11 devstack sudo[114142]: pam_unix(sudo:session): session closed for user root Aug 11 04:55:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a50c4ff2-36bb-4b49-951e-000a75536f0a tempest-SnapshotDependencyTests-617682859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c.8a56c4d4-53c3-4369-850d-ac87afdda504" returned: 0 in 0.369s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:55:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-a50c4ff2-36bb-4b49-951e-000a75536f0a tempest-SnapshotDependencyTests-617682859 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:55:11 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[45837aae-a31b-45cc-a081-157234d00a98]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:55:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a50c4ff2-36bb-4b49-951e-000a75536f0a tempest-SnapshotDependencyTests-617682859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:55:11 devstack sudo[114147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c Aug 11 04:55:11 devstack sudo[114147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:55:11 devstack sudo[114147]: pam_unix(sudo:session): session closed for user root Aug 11 04:55:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a50c4ff2-36bb-4b49-951e-000a75536f0a tempest-SnapshotDependencyTests-617682859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c" returned: 0 in 0.609s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:55:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a50c4ff2-36bb-4b49-951e-000a75536f0a tempest-SnapshotDependencyTests-617682859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c.8a56c4d4-53c3-4369-850d-ac87afdda504 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:55:11 devstack sudo[114168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c.8a56c4d4-53c3-4369-850d-ac87afdda504 Aug 11 04:55:11 devstack sudo[114168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:55:12 devstack sudo[114168]: pam_unix(sudo:session): session closed for user root Aug 11 04:55:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a50c4ff2-36bb-4b49-951e-000a75536f0a tempest-SnapshotDependencyTests-617682859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c.8a56c4d4-53c3-4369-850d-ac87afdda504" returned: 0 in 0.427s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:55:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a50c4ff2-36bb-4b49-951e-000a75536f0a tempest-SnapshotDependencyTests-617682859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c.8a56c4d4-53c3-4369-850d-ac87afdda504 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:55:12 devstack sudo[114187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c.8a56c4d4-53c3-4369-850d-ac87afdda504 Aug 11 04:55:12 devstack sudo[114187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:55:12 devstack sudo[114187]: pam_unix(sudo:session): session closed for user root Aug 11 04:55:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a50c4ff2-36bb-4b49-951e-000a75536f0a tempest-SnapshotDependencyTests-617682859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c.8a56c4d4-53c3-4369-850d-ac87afdda504" returned: 0 in 0.294s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:55:12 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a50c4ff2-36bb-4b49-951e-000a75536f0a tempest-SnapshotDependencyTests-617682859 None] Lock "cinder-quobyte-8a56c4d4-53c3-4369-850d-ac87afdda504" released by "_delete_snapshot" :: held 1.830s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:55:12 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a50c4ff2-36bb-4b49-951e-000a75536f0a tempest-SnapshotDependencyTests-617682859 None] Lock "cinder-quobyte-87bcf2d4-8f8f-4b81-8130-967056f66a2c" released by "delete_snapshot" :: held 1.859s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:55:12 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-a50c4ff2-36bb-4b49-951e-000a75536f0a tempest-SnapshotDependencyTests-617682859 None] Created reservations ['9bd922cb-fa9b-4c43-bb50-7648e5467dd9', 'cda31a72-41b6-4ecb-9e88-5b1c42ba460a', '87eb31a1-a9b1-4925-a260-ac39ac420862', '094e1fe3-d9a9-4a32-8af7-4444c6766181'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:55:12 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-a50c4ff2-36bb-4b49-951e-000a75536f0a tempest-SnapshotDependencyTests-617682859 None] Delete snapshot completed successfully. Aug 11 04:55:12 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a50c4ff2-36bb-4b49-951e-000a75536f0a tempest-SnapshotDependencyTests-617682859 None] Lock "cinder-8a56c4d4-53c3-4369-850d-ac87afdda504-delete_snapshot" released by "delete_snapshot" :: held 2.017s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:55:12 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-29831c34-a768-4289-af14-efe7a7d2dac8 tempest-SnapshotDependencyTests-617682859 None] Acquiring lock "cinder-87bcf2d4-8f8f-4b81-8130-967056f66a2c-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:55:12 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-29831c34-a768-4289-af14-efe7a7d2dac8 tempest-SnapshotDependencyTests-617682859 None] Lock "cinder-87bcf2d4-8f8f-4b81-8130-967056f66a2c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:55:12 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-29831c34-a768-4289-af14-efe7a7d2dac8 tempest-SnapshotDependencyTests-617682859 None] Acquiring lock "cinder-quobyte-87bcf2d4-8f8f-4b81-8130-967056f66a2c" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:55:12 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-29831c34-a768-4289-af14-efe7a7d2dac8 tempest-SnapshotDependencyTests-617682859 None] Lock "cinder-quobyte-87bcf2d4-8f8f-4b81-8130-967056f66a2c" acquired by "delete_volume" :: waited 0.016s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:55:12 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f05c776-4529-4b7b-9efa-56053b4d4bad]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:55:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-29831c34-a768-4289-af14-efe7a7d2dac8 tempest-SnapshotDependencyTests-617682859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:55:13 devstack sudo[114190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c Aug 11 04:55:13 devstack sudo[114190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:55:13 devstack sudo[114190]: pam_unix(sudo:session): session closed for user root Aug 11 04:55:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-29831c34-a768-4289-af14-efe7a7d2dac8 tempest-SnapshotDependencyTests-617682859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c" returned: 0 in 0.396s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:55:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-29831c34-a768-4289-af14-efe7a7d2dac8 tempest-SnapshotDependencyTests-617682859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:55:13 devstack sudo[114195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c Aug 11 04:55:13 devstack sudo[114195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:55:13 devstack sudo[114195]: pam_unix(sudo:session): session closed for user root Aug 11 04:55:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-29831c34-a768-4289-af14-efe7a7d2dac8 tempest-SnapshotDependencyTests-617682859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-87bcf2d4-8f8f-4b81-8130-967056f66a2c" returned: 0 in 0.254s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:55:13 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-29831c34-a768-4289-af14-efe7a7d2dac8 tempest-SnapshotDependencyTests-617682859 None] Lock "cinder-quobyte-87bcf2d4-8f8f-4b81-8130-967056f66a2c" released by "delete_volume" :: held 0.717s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:55:13 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-29831c34-a768-4289-af14-efe7a7d2dac8 tempest-SnapshotDependencyTests-617682859 None] Created reservations ['d45c0f2e-c15c-4e36-917d-481545aec5df', 'c13b0948-4524-49d7-8c26-13038fdc8746', '8057d789-44d2-4a91-a807-8124921b3722', 'b9801d16-739f-4bdc-b86a-8ebbf8ead743'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:55:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-29831c34-a768-4289-af14-efe7a7d2dac8 tempest-SnapshotDependencyTests-617682859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:55:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-29831c34-a768-4289-af14-efe7a7d2dac8 tempest-SnapshotDependencyTests-617682859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:55:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-29831c34-a768-4289-af14-efe7a7d2dac8 tempest-SnapshotDependencyTests-617682859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:55:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-29831c34-a768-4289-af14-efe7a7d2dac8 tempest-SnapshotDependencyTests-617682859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:55:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-29831c34-a768-4289-af14-efe7a7d2dac8 tempest-SnapshotDependencyTests-617682859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:55:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-29831c34-a768-4289-af14-efe7a7d2dac8 tempest-SnapshotDependencyTests-617682859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:55:13 devstack sudo[114199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:55:13 devstack sudo[114199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:55:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-3089cb5d-b406-4d1d-816c-a52136dbe17c tempest-SnapshotDependencyTests-617682859 None] Acquiring lock "cinder-b95c0614-2ce0-4dd7-93ab-15c83d83682d-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:55:14 devstack sudo[114199]: pam_unix(sudo:session): session closed for user root Aug 11 04:55:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-29831c34-a768-4289-af14-efe7a7d2dac8 tempest-SnapshotDependencyTests-617682859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.277s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:55:14 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-29831c34-a768-4289-af14-efe7a7d2dac8 tempest-SnapshotDependencyTests-617682859 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:55:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-3089cb5d-b406-4d1d-816c-a52136dbe17c tempest-SnapshotDependencyTests-617682859 None] Lock "cinder-b95c0614-2ce0-4dd7-93ab-15c83d83682d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:55:14 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-29831c34-a768-4289-af14-efe7a7d2dac8 tempest-SnapshotDependencyTests-617682859 None] Deleted volume successfully. Aug 11 04:55:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-29831c34-a768-4289-af14-efe7a7d2dac8 tempest-SnapshotDependencyTests-617682859 None] Lock "cinder-87bcf2d4-8f8f-4b81-8130-967056f66a2c-delete_volume" released by "delete_volume" :: held 1.279s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:55:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-3089cb5d-b406-4d1d-816c-a52136dbe17c tempest-SnapshotDependencyTests-617682859 None] Acquiring lock "cinder-quobyte-b95c0614-2ce0-4dd7-93ab-15c83d83682d" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:55:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-3089cb5d-b406-4d1d-816c-a52136dbe17c tempest-SnapshotDependencyTests-617682859 None] Lock "cinder-quobyte-b95c0614-2ce0-4dd7-93ab-15c83d83682d" acquired by "delete_volume" :: waited 0.020s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:55:14 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[399dac9e-d60a-4154-82e2-d376b54c3cf7]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:55:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3089cb5d-b406-4d1d-816c-a52136dbe17c tempest-SnapshotDependencyTests-617682859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b95c0614-2ce0-4dd7-93ab-15c83d83682d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:55:14 devstack sudo[114202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b95c0614-2ce0-4dd7-93ab-15c83d83682d Aug 11 04:55:14 devstack sudo[114202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:55:14 devstack sudo[114202]: pam_unix(sudo:session): session closed for user root Aug 11 04:55:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3089cb5d-b406-4d1d-816c-a52136dbe17c tempest-SnapshotDependencyTests-617682859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b95c0614-2ce0-4dd7-93ab-15c83d83682d" returned: 0 in 0.387s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:55:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3089cb5d-b406-4d1d-816c-a52136dbe17c tempest-SnapshotDependencyTests-617682859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b95c0614-2ce0-4dd7-93ab-15c83d83682d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:55:14 devstack sudo[114208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b95c0614-2ce0-4dd7-93ab-15c83d83682d Aug 11 04:55:14 devstack sudo[114208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:55:14 devstack sudo[114208]: pam_unix(sudo:session): session closed for user root Aug 11 04:55:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3089cb5d-b406-4d1d-816c-a52136dbe17c tempest-SnapshotDependencyTests-617682859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b95c0614-2ce0-4dd7-93ab-15c83d83682d" returned: 0 in 0.254s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:55:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-3089cb5d-b406-4d1d-816c-a52136dbe17c tempest-SnapshotDependencyTests-617682859 None] Lock "cinder-quobyte-b95c0614-2ce0-4dd7-93ab-15c83d83682d" released by "delete_volume" :: held 0.687s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:55:14 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-3089cb5d-b406-4d1d-816c-a52136dbe17c tempest-SnapshotDependencyTests-617682859 None] Created reservations ['c1049f46-369a-477d-8ec6-693f753c6492', '0feb28dc-526a-4138-a313-4bbc4db87c39', '1bcbad59-0082-4d08-8c63-13648c62e761', 'adc70b0b-3028-48b9-b1cf-018c594a1a09'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:55:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3089cb5d-b406-4d1d-816c-a52136dbe17c tempest-SnapshotDependencyTests-617682859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:55:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3089cb5d-b406-4d1d-816c-a52136dbe17c tempest-SnapshotDependencyTests-617682859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:55:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3089cb5d-b406-4d1d-816c-a52136dbe17c tempest-SnapshotDependencyTests-617682859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:55:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3089cb5d-b406-4d1d-816c-a52136dbe17c tempest-SnapshotDependencyTests-617682859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:55:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3089cb5d-b406-4d1d-816c-a52136dbe17c tempest-SnapshotDependencyTests-617682859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:55:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3089cb5d-b406-4d1d-816c-a52136dbe17c tempest-SnapshotDependencyTests-617682859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:55:14 devstack sudo[114212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:55:14 devstack sudo[114212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:55:15 devstack sudo[114212]: pam_unix(sudo:session): session closed for user root Aug 11 04:55:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3089cb5d-b406-4d1d-816c-a52136dbe17c tempest-SnapshotDependencyTests-617682859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.337s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:55:15 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-3089cb5d-b406-4d1d-816c-a52136dbe17c tempest-SnapshotDependencyTests-617682859 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:55:15 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-3089cb5d-b406-4d1d-816c-a52136dbe17c tempest-SnapshotDependencyTests-617682859 None] Deleted volume successfully. Aug 11 04:55:15 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-3089cb5d-b406-4d1d-816c-a52136dbe17c tempest-SnapshotDependencyTests-617682859 None] Lock "cinder-b95c0614-2ce0-4dd7-93ab-15c83d83682d-delete_volume" released by "delete_volume" :: held 1.331s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:55:24 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:UPDATE=35,cinder:SELECT=30,cinder:DELETE=2,cinder:INSERT=8 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:55:25 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=37,cinder:UPDATE=33,cinder:INSERT=8,cinder:DELETE=4 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:55:50 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-d5fe16c6-3c76-42bb-b50d-15aadad43b9d req-1a5cdfd6-5e07-4b99-9a86-b3549875757f tempest-TestMinimumBasicScenario-418018741 None] Terminate volume connection completed successfully. Aug 11 04:55:50 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-d5fe16c6-3c76-42bb-b50d-15aadad43b9d req-1a5cdfd6-5e07-4b99-9a86-b3549875757f tempest-TestMinimumBasicScenario-418018741 None] Deleting attachment 72e3cc92-b31d-4ccb-99b6-12df235dffe1. {{(pid=94472) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 11 04:55:50 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fe0b7dad-13b8-4f31-9a16-1981e0535657 tempest-TestMinimumBasicScenario-418018741 None] Acquiring lock "cinder-38a2b800-d5fd-46e6-9b9b-438ddfd6dc0b-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:55:50 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fe0b7dad-13b8-4f31-9a16-1981e0535657 tempest-TestMinimumBasicScenario-418018741 None] Lock "cinder-38a2b800-d5fd-46e6-9b9b-438ddfd6dc0b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:55:50 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fe0b7dad-13b8-4f31-9a16-1981e0535657 tempest-TestMinimumBasicScenario-418018741 None] Acquiring lock "cinder-quobyte-38a2b800-d5fd-46e6-9b9b-438ddfd6dc0b" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:55:50 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fe0b7dad-13b8-4f31-9a16-1981e0535657 tempest-TestMinimumBasicScenario-418018741 None] Lock "cinder-quobyte-38a2b800-d5fd-46e6-9b9b-438ddfd6dc0b" acquired by "delete_volume" :: waited 0.015s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:55:50 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[f895b558-750d-47e3-9ffb-144070246a71]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:55:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fe0b7dad-13b8-4f31-9a16-1981e0535657 tempest-TestMinimumBasicScenario-418018741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-38a2b800-d5fd-46e6-9b9b-438ddfd6dc0b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:55:51 devstack sudo[114357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-38a2b800-d5fd-46e6-9b9b-438ddfd6dc0b Aug 11 04:55:51 devstack sudo[114357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:55:51 devstack sudo[114357]: pam_unix(sudo:session): session closed for user root Aug 11 04:55:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fe0b7dad-13b8-4f31-9a16-1981e0535657 tempest-TestMinimumBasicScenario-418018741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-38a2b800-d5fd-46e6-9b9b-438ddfd6dc0b" returned: 0 in 0.373s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:55:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fe0b7dad-13b8-4f31-9a16-1981e0535657 tempest-TestMinimumBasicScenario-418018741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-38a2b800-d5fd-46e6-9b9b-438ddfd6dc0b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:55:51 devstack sudo[114362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-38a2b800-d5fd-46e6-9b9b-438ddfd6dc0b Aug 11 04:55:51 devstack sudo[114362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:55:51 devstack sudo[114362]: pam_unix(sudo:session): session closed for user root Aug 11 04:55:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fe0b7dad-13b8-4f31-9a16-1981e0535657 tempest-TestMinimumBasicScenario-418018741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-38a2b800-d5fd-46e6-9b9b-438ddfd6dc0b" returned: 0 in 0.268s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:55:51 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fe0b7dad-13b8-4f31-9a16-1981e0535657 tempest-TestMinimumBasicScenario-418018741 None] Lock "cinder-quobyte-38a2b800-d5fd-46e6-9b9b-438ddfd6dc0b" released by "delete_volume" :: held 0.680s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:55:51 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-fe0b7dad-13b8-4f31-9a16-1981e0535657 tempest-TestMinimumBasicScenario-418018741 None] Created reservations ['a3803f0f-9013-40db-a88d-97bfe704dc1e', '5d7d8eb3-57e4-40b7-bb6a-393ba4fd2dfc', 'ec72cd0e-883f-4cc3-8090-f020eafca14b', '228c5a96-61d3-42b6-969e-521519bdb06e'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:55:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fe0b7dad-13b8-4f31-9a16-1981e0535657 tempest-TestMinimumBasicScenario-418018741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:55:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fe0b7dad-13b8-4f31-9a16-1981e0535657 tempest-TestMinimumBasicScenario-418018741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:55:51 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-fe0b7dad-13b8-4f31-9a16-1981e0535657 tempest-TestMinimumBasicScenario-418018741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:55:51 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-fe0b7dad-13b8-4f31-9a16-1981e0535657 tempest-TestMinimumBasicScenario-418018741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:55:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fe0b7dad-13b8-4f31-9a16-1981e0535657 tempest-TestMinimumBasicScenario-418018741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:55:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fe0b7dad-13b8-4f31-9a16-1981e0535657 tempest-TestMinimumBasicScenario-418018741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:55:51 devstack sudo[114365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:55:51 devstack sudo[114365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:55:51 devstack sudo[114365]: pam_unix(sudo:session): session closed for user root Aug 11 04:55:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fe0b7dad-13b8-4f31-9a16-1981e0535657 tempest-TestMinimumBasicScenario-418018741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.269s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:55:51 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-fe0b7dad-13b8-4f31-9a16-1981e0535657 tempest-TestMinimumBasicScenario-418018741 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:55:51 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-fe0b7dad-13b8-4f31-9a16-1981e0535657 tempest-TestMinimumBasicScenario-418018741 None] Deleted volume successfully. Aug 11 04:55:51 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fe0b7dad-13b8-4f31-9a16-1981e0535657 tempest-TestMinimumBasicScenario-418018741 None] Lock "cinder-38a2b800-d5fd-46e6-9b9b-438ddfd6dc0b-delete_volume" released by "delete_volume" :: held 1.151s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:55:58 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 04:55:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:55:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:55:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:55:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:55:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:55:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:55:58 devstack sudo[114395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:55:58 devstack sudo[114395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:55:58 devstack sudo[114395]: pam_unix(sudo:session): session closed for user root Aug 11 04:55:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.287s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:55:58 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:55:58 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running periodic task VolumeManager._thread_info {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 04:55:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] thread count: 28 {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 11 04:55:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] thread info: [<_MainThread(MainThread, started 133315846115456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 11 04:56:01 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=5,cinder:INSERT=3,cinder:UPDATE=9 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:56:01 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=7,cinder:UPDATE=7,cinder:INSERT=1,cinder:DELETE=1 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:56:05 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-620aa764-895c-4202-843d-80275617d9a9 tempest-CreateVolumesFromSnapshotTest-462764376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:56:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-620aa764-895c-4202-843d-80275617d9a9 tempest-CreateVolumesFromSnapshotTest-462764376 None] Flow 'volume_create_manager' (100a0127-ab5a-43e5-a4f3-f9a15e361c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:56:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-620aa764-895c-4202-843d-80275617d9a9 tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4746acfa-a5c3-4a4e-8a88-aa1a8ca398ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-620aa764-895c-4202-843d-80275617d9a9 tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4746acfa-a5c3-4a4e-8a88-aa1a8ca398ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:56:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-427206906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0a88ac4-db7b-470a-90e6-a3e706fa9740,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc9720ab28d3486ab07f8c7f74da9b95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:56:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:56:06Z,use_quota=True,user_id='903a6f1fd60e40d38c558a5ecb070879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-620aa764-895c-4202-843d-80275617d9a9 tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22eb020b-0e03-45e0-802e-400a3d57b13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-620aa764-895c-4202-843d-80275617d9a9 tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22eb020b-0e03-45e0-802e-400a3d57b13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-620aa764-895c-4202-843d-80275617d9a9 tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68433ce3-eef4-4b70-91d0-9c180c287b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-620aa764-895c-4202-843d-80275617d9a9 tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68433ce3-eef4-4b70-91d0-9c180c287b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0a88ac4-db7b-470a-90e6-a3e706fa9740', 'volume_name': 'volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-620aa764-895c-4202-843d-80275617d9a9 tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ccebbc9-15bb-490b-a4ac-9621883ecbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-620aa764-895c-4202-843d-80275617d9a9 tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ccebbc9-15bb-490b-a4ac-9621883ecbd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-620aa764-895c-4202-843d-80275617d9a9 tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccfadbc7-bd98-4075-bdbf-568499666976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:05 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-620aa764-895c-4202-843d-80275617d9a9 tempest-CreateVolumesFromSnapshotTest-462764376 None] Volume a0a88ac4-db7b-470a-90e6-a3e706fa9740: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740', 'volume_size': 1} Aug 11 04:56:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-620aa764-895c-4202-843d-80275617d9a9 tempest-CreateVolumesFromSnapshotTest-462764376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:56:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-620aa764-895c-4202-843d-80275617d9a9 tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:56:05 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-620aa764-895c-4202-843d-80275617d9a9 tempest-CreateVolumesFromSnapshotTest-462764376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:56:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-427206906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0a88ac4-db7b-470a-90e6-a3e706fa9740,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc9720ab28d3486ab07f8c7f74da9b95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:56:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:56:06Z,use_quota=True,user_id='903a6f1fd60e40d38c558a5ecb070879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:56:05 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-620aa764-895c-4202-843d-80275617d9a9 tempest-CreateVolumesFromSnapshotTest-462764376 None] Creating volume a0a88ac4-db7b-470a-90e6-a3e706fa9740 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:56:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-620aa764-895c-4202-843d-80275617d9a9 tempest-CreateVolumesFromSnapshotTest-462764376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:56:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-620aa764-895c-4202-843d-80275617d9a9 tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:56:05 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-620aa764-895c-4202-843d-80275617d9a9 tempest-CreateVolumesFromSnapshotTest-462764376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:56:05 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-620aa764-895c-4202-843d-80275617d9a9 tempest-CreateVolumesFromSnapshotTest-462764376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:56:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-620aa764-895c-4202-843d-80275617d9a9 tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:56:05 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-620aa764-895c-4202-843d-80275617d9a9 tempest-CreateVolumesFromSnapshotTest-462764376 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:56:05 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-620aa764-895c-4202-843d-80275617d9a9 tempest-CreateVolumesFromSnapshotTest-462764376 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:56:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-620aa764-895c-4202-843d-80275617d9a9 tempest-CreateVolumesFromSnapshotTest-462764376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:05 devstack sudo[114407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740 1073741824 Aug 11 04:56:05 devstack sudo[114407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:06 devstack sudo[114407]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-620aa764-895c-4202-843d-80275617d9a9 tempest-CreateVolumesFromSnapshotTest-462764376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740 1073741824" returned: 0 in 0.411s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-620aa764-895c-4202-843d-80275617d9a9 tempest-CreateVolumesFromSnapshotTest-462764376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:06 devstack sudo[114413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740 Aug 11 04:56:06 devstack sudo[114413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:06 devstack sudo[114413]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-620aa764-895c-4202-843d-80275617d9a9 tempest-CreateVolumesFromSnapshotTest-462764376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740" returned: 0 in 0.254s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:06 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-620aa764-895c-4202-843d-80275617d9a9 tempest-CreateVolumesFromSnapshotTest-462764376 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:56:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-620aa764-895c-4202-843d-80275617d9a9 tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:56:06 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-620aa764-895c-4202-843d-80275617d9a9 tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccfadbc7-bd98-4075-bdbf-568499666976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:06 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-620aa764-895c-4202-843d-80275617d9a9 tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbf4a7c4-f583-4b14-aeed-18b8ddcf9dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:06 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-620aa764-895c-4202-843d-80275617d9a9 tempest-CreateVolumesFromSnapshotTest-462764376 None] Volume volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740 (a0a88ac4-db7b-470a-90e6-a3e706fa9740): created successfully Aug 11 04:56:06 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-620aa764-895c-4202-843d-80275617d9a9 tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbf4a7c4-f583-4b14-aeed-18b8ddcf9dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:06 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-620aa764-895c-4202-843d-80275617d9a9 tempest-CreateVolumesFromSnapshotTest-462764376 None] Flow 'volume_create_manager' (100a0127-ab5a-43e5-a4f3-f9a15e361c28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:56:06 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-620aa764-895c-4202-843d-80275617d9a9 tempest-CreateVolumesFromSnapshotTest-462764376 None] Created volume successfully. Aug 11 04:56:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-46096c74-1d36-4292-a794-9a1170c7db32 tempest-CreateVolumesFromSnapshotTest-462764376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:56:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-46096c74-1d36-4292-a794-9a1170c7db32 tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:56:07 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-46096c74-1d36-4292-a794-9a1170c7db32 tempest-CreateVolumesFromSnapshotTest-462764376 None] Creating offline snapshot 8a7291d0-c35b-49c8-a90c-2dabb1bc6f28 of volume a0a88ac4-db7b-470a-90e6-a3e706fa9740 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 04:56:07 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4b7941-5e4e-466f-ac78-3f16ce3119a3]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:56:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-46096c74-1d36-4292-a794-9a1170c7db32 tempest-CreateVolumesFromSnapshotTest-462764376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:07 devstack sudo[114416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740 Aug 11 04:56:07 devstack sudo[114416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:07 devstack sudo[114416]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-46096c74-1d36-4292-a794-9a1170c7db32 tempest-CreateVolumesFromSnapshotTest-462764376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740" returned: 0 in 0.395s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-46096c74-1d36-4292-a794-9a1170c7db32 tempest-CreateVolumesFromSnapshotTest-462764376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740.8a7291d0-c35b-49c8-a90c-2dabb1bc6f28 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:07 devstack sudo[114421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740.8a7291d0-c35b-49c8-a90c-2dabb1bc6f28 1G Aug 11 04:56:07 devstack sudo[114421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:07 devstack sudo[114421]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-46096c74-1d36-4292-a794-9a1170c7db32 tempest-CreateVolumesFromSnapshotTest-462764376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740.8a7291d0-c35b-49c8-a90c-2dabb1bc6f28 1G" returned: 0 in 0.387s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-46096c74-1d36-4292-a794-9a1170c7db32 tempest-CreateVolumesFromSnapshotTest-462764376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740.8a7291d0-c35b-49c8-a90c-2dabb1bc6f28 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:07 devstack sudo[114427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740.8a7291d0-c35b-49c8-a90c-2dabb1bc6f28 Aug 11 04:56:07 devstack sudo[114427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:08 devstack sudo[114427]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-46096c74-1d36-4292-a794-9a1170c7db32 tempest-CreateVolumesFromSnapshotTest-462764376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740.8a7291d0-c35b-49c8-a90c-2dabb1bc6f28" returned: 0 in 0.296s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:08 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-46096c74-1d36-4292-a794-9a1170c7db32 tempest-CreateVolumesFromSnapshotTest-462764376 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740.8a7291d0-c35b-49c8-a90c-2dabb1bc6f28 is being set with open permissions: ugo+rw Aug 11 04:56:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-46096c74-1d36-4292-a794-9a1170c7db32 tempest-CreateVolumesFromSnapshotTest-462764376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740.8a7291d0-c35b-49c8-a90c-2dabb1bc6f28 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:08 devstack sudo[114432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740.8a7291d0-c35b-49c8-a90c-2dabb1bc6f28 Aug 11 04:56:08 devstack sudo[114432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:08 devstack sudo[114432]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-46096c74-1d36-4292-a794-9a1170c7db32 tempest-CreateVolumesFromSnapshotTest-462764376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740.8a7291d0-c35b-49c8-a90c-2dabb1bc6f28" returned: 0 in 0.240s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-46096c74-1d36-4292-a794-9a1170c7db32 tempest-CreateVolumesFromSnapshotTest-462764376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:08 devstack sudo[114435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740.info Aug 11 04:56:08 devstack sudo[114435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:08 devstack sudo[114435]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-46096c74-1d36-4292-a794-9a1170c7db32 tempest-CreateVolumesFromSnapshotTest-462764376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740.info" returned: 0 in 0.250s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:08 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-46096c74-1d36-4292-a794-9a1170c7db32 tempest-CreateVolumesFromSnapshotTest-462764376 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740.info is being set with open permissions: ugo+rw Aug 11 04:56:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-46096c74-1d36-4292-a794-9a1170c7db32 tempest-CreateVolumesFromSnapshotTest-462764376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:08 devstack sudo[114438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740.info Aug 11 04:56:08 devstack sudo[114438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:08 devstack sudo[114438]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-46096c74-1d36-4292-a794-9a1170c7db32 tempest-CreateVolumesFromSnapshotTest-462764376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740.info" returned: 0 in 0.252s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-46096c74-1d36-4292-a794-9a1170c7db32 tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.908s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:56:09 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-46096c74-1d36-4292-a794-9a1170c7db32 tempest-CreateVolumesFromSnapshotTest-462764376 None] Create snapshot completed successfully Aug 11 04:56:09 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1331016-0a66-4971-88f9-9687155180dd tempest-CreateVolumesFromSnapshotTest-462764376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:56:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f1331016-0a66-4971-88f9-9687155180dd tempest-CreateVolumesFromSnapshotTest-462764376 None] Flow 'volume_create_manager' (9efd9aea-cc90-48f7-9628-204e9715f3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:56:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f1331016-0a66-4971-88f9-9687155180dd tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de84a3e4-eea6-4799-87f9-03d9b0e24a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f1331016-0a66-4971-88f9-9687155180dd tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de84a3e4-eea6-4799-87f9-03d9b0e24a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:56:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-701039226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4d3dc1d-9b8b-4e3d-8a4f-66000d0ba479,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc9720ab28d3486ab07f8c7f74da9b95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:56:10Z,use_quota=True,user_id='903a6f1fd60e40d38c558a5ecb070879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f1331016-0a66-4971-88f9-9687155180dd tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcc0e56a-8a7f-44b1-9d34-27f16ca63468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f1331016-0a66-4971-88f9-9687155180dd tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcc0e56a-8a7f-44b1-9d34-27f16ca63468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f1331016-0a66-4971-88f9-9687155180dd tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e2087a5-1eb6-4c63-a661-543b065680d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f1331016-0a66-4971-88f9-9687155180dd tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e2087a5-1eb6-4c63-a661-543b065680d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4d3dc1d-9b8b-4e3d-8a4f-66000d0ba479', 'volume_name': 'volume-d4d3dc1d-9b8b-4e3d-8a4f-66000d0ba479', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f1331016-0a66-4971-88f9-9687155180dd tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32a9312b-8b42-41d1-a04c-96467cac9fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f1331016-0a66-4971-88f9-9687155180dd tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32a9312b-8b42-41d1-a04c-96467cac9fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f1331016-0a66-4971-88f9-9687155180dd tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a0206eb-7612-4302-903f-3940a45cc407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:09 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-f1331016-0a66-4971-88f9-9687155180dd tempest-CreateVolumesFromSnapshotTest-462764376 None] Volume d4d3dc1d-9b8b-4e3d-8a4f-66000d0ba479: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4d3dc1d-9b8b-4e3d-8a4f-66000d0ba479', 'volume_size': 1} Aug 11 04:56:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f1331016-0a66-4971-88f9-9687155180dd tempest-CreateVolumesFromSnapshotTest-462764376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:56:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f1331016-0a66-4971-88f9-9687155180dd tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:56:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f1331016-0a66-4971-88f9-9687155180dd tempest-CreateVolumesFromSnapshotTest-462764376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:56:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-701039226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4d3dc1d-9b8b-4e3d-8a4f-66000d0ba479,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc9720ab28d3486ab07f8c7f74da9b95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:56:10Z,use_quota=True,user_id='903a6f1fd60e40d38c558a5ecb070879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:56:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-f1331016-0a66-4971-88f9-9687155180dd tempest-CreateVolumesFromSnapshotTest-462764376 None] Creating volume d4d3dc1d-9b8b-4e3d-8a4f-66000d0ba479 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:56:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f1331016-0a66-4971-88f9-9687155180dd tempest-CreateVolumesFromSnapshotTest-462764376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:56:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f1331016-0a66-4971-88f9-9687155180dd tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:56:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f1331016-0a66-4971-88f9-9687155180dd tempest-CreateVolumesFromSnapshotTest-462764376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:56:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f1331016-0a66-4971-88f9-9687155180dd tempest-CreateVolumesFromSnapshotTest-462764376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:56:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f1331016-0a66-4971-88f9-9687155180dd tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:56:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f1331016-0a66-4971-88f9-9687155180dd tempest-CreateVolumesFromSnapshotTest-462764376 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:56:09 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-f1331016-0a66-4971-88f9-9687155180dd tempest-CreateVolumesFromSnapshotTest-462764376 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:56:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f1331016-0a66-4971-88f9-9687155180dd tempest-CreateVolumesFromSnapshotTest-462764376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d4d3dc1d-9b8b-4e3d-8a4f-66000d0ba479 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:09 devstack sudo[114441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d4d3dc1d-9b8b-4e3d-8a4f-66000d0ba479 1073741824 Aug 11 04:56:09 devstack sudo[114441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:10 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6d2262b-8ab7-4465-bc72-5a4455b8cc0e tempest-CreateVolumesFromSnapshotTest-462764376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:56:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c6d2262b-8ab7-4465-bc72-5a4455b8cc0e tempest-CreateVolumesFromSnapshotTest-462764376 None] Flow 'volume_create_manager' (168cba52-32ac-486f-8bd9-a5f53bc2b159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:56:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c6d2262b-8ab7-4465-bc72-5a4455b8cc0e tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8c1499f-5bc8-4d56-9387-6a7c92371c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c6d2262b-8ab7-4465-bc72-5a4455b8cc0e tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8c1499f-5bc8-4d56-9387-6a7c92371c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-883810827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f50deb0c-b165-48ec-aec0-bd4ca29d819e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc9720ab28d3486ab07f8c7f74da9b95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:56:10Z,use_quota=True,user_id='903a6f1fd60e40d38c558a5ecb070879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c6d2262b-8ab7-4465-bc72-5a4455b8cc0e tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4764fb9-1d68-4133-841b-475afee53a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c6d2262b-8ab7-4465-bc72-5a4455b8cc0e tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4764fb9-1d68-4133-841b-475afee53a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c6d2262b-8ab7-4465-bc72-5a4455b8cc0e tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d74cefc-b407-49cf-8bae-7a4917423576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c6d2262b-8ab7-4465-bc72-5a4455b8cc0e tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d74cefc-b407-49cf-8bae-7a4917423576) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f50deb0c-b165-48ec-aec0-bd4ca29d819e', 'volume_name': 'volume-f50deb0c-b165-48ec-aec0-bd4ca29d819e', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c6d2262b-8ab7-4465-bc72-5a4455b8cc0e tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (303f48f4-f636-45b8-b98f-cda34b975a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c6d2262b-8ab7-4465-bc72-5a4455b8cc0e tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (303f48f4-f636-45b8-b98f-cda34b975a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c6d2262b-8ab7-4465-bc72-5a4455b8cc0e tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fff88fb2-67bc-4f41-a581-ab4fad74278f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:10 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-c6d2262b-8ab7-4465-bc72-5a4455b8cc0e tempest-CreateVolumesFromSnapshotTest-462764376 None] Volume f50deb0c-b165-48ec-aec0-bd4ca29d819e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f50deb0c-b165-48ec-aec0-bd4ca29d819e', 'volume_size': 1} Aug 11 04:56:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c6d2262b-8ab7-4465-bc72-5a4455b8cc0e tempest-CreateVolumesFromSnapshotTest-462764376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:56:10 devstack sudo[114441]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f1331016-0a66-4971-88f9-9687155180dd tempest-CreateVolumesFromSnapshotTest-462764376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d4d3dc1d-9b8b-4e3d-8a4f-66000d0ba479 1073741824" returned: 0 in 0.495s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f1331016-0a66-4971-88f9-9687155180dd tempest-CreateVolumesFromSnapshotTest-462764376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d4d3dc1d-9b8b-4e3d-8a4f-66000d0ba479 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:10 devstack sudo[114447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d4d3dc1d-9b8b-4e3d-8a4f-66000d0ba479 Aug 11 04:56:10 devstack sudo[114447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:10 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cd42909-2ece-445f-b138-226b5b2480bf tempest-CreateVolumesFromSnapshotTest-462764376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:56:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3cd42909-2ece-445f-b138-226b5b2480bf tempest-CreateVolumesFromSnapshotTest-462764376 None] Flow 'volume_create_manager' (a611ca2c-1afe-4fea-9676-feba2a3fa65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:56:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3cd42909-2ece-445f-b138-226b5b2480bf tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccbcc883-9646-4bf6-9ff4-ebf917c34459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3cd42909-2ece-445f-b138-226b5b2480bf tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccbcc883-9646-4bf6-9ff4-ebf917c34459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-524137015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=272fb7e6-694f-4624-8bf7-ed2024ab4e7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc9720ab28d3486ab07f8c7f74da9b95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:56:10Z,use_quota=True,user_id='903a6f1fd60e40d38c558a5ecb070879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3cd42909-2ece-445f-b138-226b5b2480bf tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91f319ab-faa2-4474-b4ab-5a9321f93e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3cd42909-2ece-445f-b138-226b5b2480bf tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91f319ab-faa2-4474-b4ab-5a9321f93e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3cd42909-2ece-445f-b138-226b5b2480bf tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73895965-fcd6-49b9-9dd3-b393f3d4caa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3cd42909-2ece-445f-b138-226b5b2480bf tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73895965-fcd6-49b9-9dd3-b393f3d4caa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '272fb7e6-694f-4624-8bf7-ed2024ab4e7a', 'volume_name': 'volume-272fb7e6-694f-4624-8bf7-ed2024ab4e7a', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3cd42909-2ece-445f-b138-226b5b2480bf tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (230c8121-5c8c-4ca3-a320-a58d685da473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3cd42909-2ece-445f-b138-226b5b2480bf tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (230c8121-5c8c-4ca3-a320-a58d685da473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3cd42909-2ece-445f-b138-226b5b2480bf tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (867711ae-df31-4443-9f1c-0198382bc30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:10 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-3cd42909-2ece-445f-b138-226b5b2480bf tempest-CreateVolumesFromSnapshotTest-462764376 None] Volume 272fb7e6-694f-4624-8bf7-ed2024ab4e7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-272fb7e6-694f-4624-8bf7-ed2024ab4e7a', 'volume_size': 1} Aug 11 04:56:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3cd42909-2ece-445f-b138-226b5b2480bf tempest-CreateVolumesFromSnapshotTest-462764376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:56:10 devstack sudo[114447]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f1331016-0a66-4971-88f9-9687155180dd tempest-CreateVolumesFromSnapshotTest-462764376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d4d3dc1d-9b8b-4e3d-8a4f-66000d0ba479" returned: 0 in 0.276s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:10 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f1331016-0a66-4971-88f9-9687155180dd tempest-CreateVolumesFromSnapshotTest-462764376 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:56:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f1331016-0a66-4971-88f9-9687155180dd tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:56:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c6d2262b-8ab7-4465-bc72-5a4455b8cc0e tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.424s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:56:10 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c6d2262b-8ab7-4465-bc72-5a4455b8cc0e tempest-CreateVolumesFromSnapshotTest-462764376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-883810827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f50deb0c-b165-48ec-aec0-bd4ca29d819e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc9720ab28d3486ab07f8c7f74da9b95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:56:10Z,use_quota=True,user_id='903a6f1fd60e40d38c558a5ecb070879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:56:10 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-c6d2262b-8ab7-4465-bc72-5a4455b8cc0e tempest-CreateVolumesFromSnapshotTest-462764376 None] Creating volume f50deb0c-b165-48ec-aec0-bd4ca29d819e {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:56:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c6d2262b-8ab7-4465-bc72-5a4455b8cc0e tempest-CreateVolumesFromSnapshotTest-462764376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:56:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c6d2262b-8ab7-4465-bc72-5a4455b8cc0e tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:56:10 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c6d2262b-8ab7-4465-bc72-5a4455b8cc0e tempest-CreateVolumesFromSnapshotTest-462764376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:56:10 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c6d2262b-8ab7-4465-bc72-5a4455b8cc0e tempest-CreateVolumesFromSnapshotTest-462764376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:56:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c6d2262b-8ab7-4465-bc72-5a4455b8cc0e tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:56:10 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c6d2262b-8ab7-4465-bc72-5a4455b8cc0e tempest-CreateVolumesFromSnapshotTest-462764376 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:56:10 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-c6d2262b-8ab7-4465-bc72-5a4455b8cc0e tempest-CreateVolumesFromSnapshotTest-462764376 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:56:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c6d2262b-8ab7-4465-bc72-5a4455b8cc0e tempest-CreateVolumesFromSnapshotTest-462764376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f50deb0c-b165-48ec-aec0-bd4ca29d819e 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f1331016-0a66-4971-88f9-9687155180dd tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a0206eb-7612-4302-903f-3940a45cc407) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4d3dc1d-9b8b-4e3d-8a4f-66000d0ba479', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f1331016-0a66-4971-88f9-9687155180dd tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d4023f5-3c78-4003-aa4c-78123d7db6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:10 devstack sudo[114450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f50deb0c-b165-48ec-aec0-bd4ca29d819e 1073741824 Aug 11 04:56:10 devstack sudo[114450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:10 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-f1331016-0a66-4971-88f9-9687155180dd tempest-CreateVolumesFromSnapshotTest-462764376 None] Volume volume-d4d3dc1d-9b8b-4e3d-8a4f-66000d0ba479 (d4d3dc1d-9b8b-4e3d-8a4f-66000d0ba479): created successfully Aug 11 04:56:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f1331016-0a66-4971-88f9-9687155180dd tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d4023f5-3c78-4003-aa4c-78123d7db6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f1331016-0a66-4971-88f9-9687155180dd tempest-CreateVolumesFromSnapshotTest-462764376 None] Flow 'volume_create_manager' (9efd9aea-cc90-48f7-9628-204e9715f3c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:56:10 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-f1331016-0a66-4971-88f9-9687155180dd tempest-CreateVolumesFromSnapshotTest-462764376 None] Created volume successfully. Aug 11 04:56:10 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-e46d9f70-d738-4fd3-a8ce-018172f8b7fb tempest-CreateVolumesFromSnapshotTest-462764376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:56:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e46d9f70-d738-4fd3-a8ce-018172f8b7fb tempest-CreateVolumesFromSnapshotTest-462764376 None] Flow 'volume_create_manager' (297278ef-0f38-48e3-ae2c-428d92b4ce5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:56:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e46d9f70-d738-4fd3-a8ce-018172f8b7fb tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57dc163f-e9e7-4a41-b1eb-95090f8fc148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e46d9f70-d738-4fd3-a8ce-018172f8b7fb tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57dc163f-e9e7-4a41-b1eb-95090f8fc148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-607174051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3e73bc3-8b46-4314-9c38-d4c25f910dbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc9720ab28d3486ab07f8c7f74da9b95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:56:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:56:11Z,use_quota=True,user_id='903a6f1fd60e40d38c558a5ecb070879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e46d9f70-d738-4fd3-a8ce-018172f8b7fb tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42bf5062-f03c-4535-8ffe-a12c7c160743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e46d9f70-d738-4fd3-a8ce-018172f8b7fb tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42bf5062-f03c-4535-8ffe-a12c7c160743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e46d9f70-d738-4fd3-a8ce-018172f8b7fb tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a0ab840-7251-4636-a887-94536a2d70b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e46d9f70-d738-4fd3-a8ce-018172f8b7fb tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a0ab840-7251-4636-a887-94536a2d70b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3e73bc3-8b46-4314-9c38-d4c25f910dbe', 'volume_name': 'volume-d3e73bc3-8b46-4314-9c38-d4c25f910dbe', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e46d9f70-d738-4fd3-a8ce-018172f8b7fb tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41fd51b1-34e7-43a2-b333-5eaa41db4983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e46d9f70-d738-4fd3-a8ce-018172f8b7fb tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41fd51b1-34e7-43a2-b333-5eaa41db4983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e46d9f70-d738-4fd3-a8ce-018172f8b7fb tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0032209f-2216-4854-93ed-c6f25a84e345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:10 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-e46d9f70-d738-4fd3-a8ce-018172f8b7fb tempest-CreateVolumesFromSnapshotTest-462764376 None] Volume d3e73bc3-8b46-4314-9c38-d4c25f910dbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3e73bc3-8b46-4314-9c38-d4c25f910dbe', 'volume_size': 1} Aug 11 04:56:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e46d9f70-d738-4fd3-a8ce-018172f8b7fb tempest-CreateVolumesFromSnapshotTest-462764376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:56:11 devstack sudo[114450]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c6d2262b-8ab7-4465-bc72-5a4455b8cc0e tempest-CreateVolumesFromSnapshotTest-462764376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f50deb0c-b165-48ec-aec0-bd4ca29d819e 1073741824" returned: 0 in 0.499s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c6d2262b-8ab7-4465-bc72-5a4455b8cc0e tempest-CreateVolumesFromSnapshotTest-462764376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f50deb0c-b165-48ec-aec0-bd4ca29d819e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:11 devstack sudo[114457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f50deb0c-b165-48ec-aec0-bd4ca29d819e Aug 11 04:56:11 devstack sudo[114457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:11 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-25449a8f-7d09-499e-a17f-ce1cf507c54a tempest-CreateVolumesFromSnapshotTest-462764376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:56:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-25449a8f-7d09-499e-a17f-ce1cf507c54a tempest-CreateVolumesFromSnapshotTest-462764376 None] Flow 'volume_create_manager' (b65c1fb3-3abf-4090-a925-eb5ddc398f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:56:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-25449a8f-7d09-499e-a17f-ce1cf507c54a tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9d1a8f8-06cc-4a96-a694-4747fb5ff36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-25449a8f-7d09-499e-a17f-ce1cf507c54a tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9d1a8f8-06cc-4a96-a694-4747fb5ff36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:56:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-940186398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3021b01-8a71-4500-bc63-a6b24813c36f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc9720ab28d3486ab07f8c7f74da9b95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:56:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:56:11Z,use_quota=True,user_id='903a6f1fd60e40d38c558a5ecb070879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-25449a8f-7d09-499e-a17f-ce1cf507c54a tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1d93791-a10c-4d3a-80dd-4c90214bb6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-25449a8f-7d09-499e-a17f-ce1cf507c54a tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1d93791-a10c-4d3a-80dd-4c90214bb6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-25449a8f-7d09-499e-a17f-ce1cf507c54a tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad9960d2-540b-4a04-8c39-7b15f7b90775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-25449a8f-7d09-499e-a17f-ce1cf507c54a tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad9960d2-540b-4a04-8c39-7b15f7b90775) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3021b01-8a71-4500-bc63-a6b24813c36f', 'volume_name': 'volume-b3021b01-8a71-4500-bc63-a6b24813c36f', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-25449a8f-7d09-499e-a17f-ce1cf507c54a tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8761ac70-ab9f-4f77-b6f9-8dc0c5c981db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-25449a8f-7d09-499e-a17f-ce1cf507c54a tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8761ac70-ab9f-4f77-b6f9-8dc0c5c981db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-25449a8f-7d09-499e-a17f-ce1cf507c54a tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4342ce35-5fe4-4b75-b52b-2be912788836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:11 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-25449a8f-7d09-499e-a17f-ce1cf507c54a tempest-CreateVolumesFromSnapshotTest-462764376 None] Volume b3021b01-8a71-4500-bc63-a6b24813c36f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3021b01-8a71-4500-bc63-a6b24813c36f', 'volume_size': 1} Aug 11 04:56:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-25449a8f-7d09-499e-a17f-ce1cf507c54a tempest-CreateVolumesFromSnapshotTest-462764376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:56:11 devstack sudo[114457]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c6d2262b-8ab7-4465-bc72-5a4455b8cc0e tempest-CreateVolumesFromSnapshotTest-462764376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f50deb0c-b165-48ec-aec0-bd4ca29d819e" returned: 0 in 0.239s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c6d2262b-8ab7-4465-bc72-5a4455b8cc0e tempest-CreateVolumesFromSnapshotTest-462764376 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:56:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c6d2262b-8ab7-4465-bc72-5a4455b8cc0e tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:56:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3cd42909-2ece-445f-b138-226b5b2480bf tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.845s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:56:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3cd42909-2ece-445f-b138-226b5b2480bf tempest-CreateVolumesFromSnapshotTest-462764376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-524137015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=272fb7e6-694f-4624-8bf7-ed2024ab4e7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc9720ab28d3486ab07f8c7f74da9b95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:56:10Z,use_quota=True,user_id='903a6f1fd60e40d38c558a5ecb070879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:56:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-3cd42909-2ece-445f-b138-226b5b2480bf tempest-CreateVolumesFromSnapshotTest-462764376 None] Creating volume 272fb7e6-694f-4624-8bf7-ed2024ab4e7a {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:56:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3cd42909-2ece-445f-b138-226b5b2480bf tempest-CreateVolumesFromSnapshotTest-462764376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:56:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3cd42909-2ece-445f-b138-226b5b2480bf tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:56:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3cd42909-2ece-445f-b138-226b5b2480bf tempest-CreateVolumesFromSnapshotTest-462764376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:56:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3cd42909-2ece-445f-b138-226b5b2480bf tempest-CreateVolumesFromSnapshotTest-462764376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:56:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3cd42909-2ece-445f-b138-226b5b2480bf tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:56:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3cd42909-2ece-445f-b138-226b5b2480bf tempest-CreateVolumesFromSnapshotTest-462764376 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:56:11 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-3cd42909-2ece-445f-b138-226b5b2480bf tempest-CreateVolumesFromSnapshotTest-462764376 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:56:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3cd42909-2ece-445f-b138-226b5b2480bf tempest-CreateVolumesFromSnapshotTest-462764376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-272fb7e6-694f-4624-8bf7-ed2024ab4e7a 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c6d2262b-8ab7-4465-bc72-5a4455b8cc0e tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fff88fb2-67bc-4f41-a581-ab4fad74278f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f50deb0c-b165-48ec-aec0-bd4ca29d819e', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:11 devstack sudo[114460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-272fb7e6-694f-4624-8bf7-ed2024ab4e7a 1073741824 Aug 11 04:56:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c6d2262b-8ab7-4465-bc72-5a4455b8cc0e tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0ca1f98-815a-4ee7-af45-de5ee6146711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:11 devstack sudo[114460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:11 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-c6d2262b-8ab7-4465-bc72-5a4455b8cc0e tempest-CreateVolumesFromSnapshotTest-462764376 None] Volume volume-f50deb0c-b165-48ec-aec0-bd4ca29d819e (f50deb0c-b165-48ec-aec0-bd4ca29d819e): created successfully Aug 11 04:56:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c6d2262b-8ab7-4465-bc72-5a4455b8cc0e tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0ca1f98-815a-4ee7-af45-de5ee6146711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c6d2262b-8ab7-4465-bc72-5a4455b8cc0e tempest-CreateVolumesFromSnapshotTest-462764376 None] Flow 'volume_create_manager' (168cba52-32ac-486f-8bd9-a5f53bc2b159) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:56:11 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-c6d2262b-8ab7-4465-bc72-5a4455b8cc0e tempest-CreateVolumesFromSnapshotTest-462764376 None] Created volume successfully. Aug 11 04:56:11 devstack sudo[114460]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3cd42909-2ece-445f-b138-226b5b2480bf tempest-CreateVolumesFromSnapshotTest-462764376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-272fb7e6-694f-4624-8bf7-ed2024ab4e7a 1073741824" returned: 0 in 0.410s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3cd42909-2ece-445f-b138-226b5b2480bf tempest-CreateVolumesFromSnapshotTest-462764376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-272fb7e6-694f-4624-8bf7-ed2024ab4e7a {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:11 devstack sudo[114465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-272fb7e6-694f-4624-8bf7-ed2024ab4e7a Aug 11 04:56:11 devstack sudo[114465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:12 devstack sudo[114465]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3cd42909-2ece-445f-b138-226b5b2480bf tempest-CreateVolumesFromSnapshotTest-462764376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-272fb7e6-694f-4624-8bf7-ed2024ab4e7a" returned: 0 in 0.238s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3cd42909-2ece-445f-b138-226b5b2480bf tempest-CreateVolumesFromSnapshotTest-462764376 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:56:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3cd42909-2ece-445f-b138-226b5b2480bf tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:56:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e46d9f70-d738-4fd3-a8ce-018172f8b7fb tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.100s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:56:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e46d9f70-d738-4fd3-a8ce-018172f8b7fb tempest-CreateVolumesFromSnapshotTest-462764376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-607174051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3e73bc3-8b46-4314-9c38-d4c25f910dbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc9720ab28d3486ab07f8c7f74da9b95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:56:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:56:11Z,use_quota=True,user_id='903a6f1fd60e40d38c558a5ecb070879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:56:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-e46d9f70-d738-4fd3-a8ce-018172f8b7fb tempest-CreateVolumesFromSnapshotTest-462764376 None] Creating volume d3e73bc3-8b46-4314-9c38-d4c25f910dbe {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:56:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e46d9f70-d738-4fd3-a8ce-018172f8b7fb tempest-CreateVolumesFromSnapshotTest-462764376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:56:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e46d9f70-d738-4fd3-a8ce-018172f8b7fb tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:56:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e46d9f70-d738-4fd3-a8ce-018172f8b7fb tempest-CreateVolumesFromSnapshotTest-462764376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:56:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e46d9f70-d738-4fd3-a8ce-018172f8b7fb tempest-CreateVolumesFromSnapshotTest-462764376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:56:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e46d9f70-d738-4fd3-a8ce-018172f8b7fb tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:56:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e46d9f70-d738-4fd3-a8ce-018172f8b7fb tempest-CreateVolumesFromSnapshotTest-462764376 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:56:12 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-e46d9f70-d738-4fd3-a8ce-018172f8b7fb tempest-CreateVolumesFromSnapshotTest-462764376 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:56:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e46d9f70-d738-4fd3-a8ce-018172f8b7fb tempest-CreateVolumesFromSnapshotTest-462764376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d3e73bc3-8b46-4314-9c38-d4c25f910dbe 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3cd42909-2ece-445f-b138-226b5b2480bf tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (867711ae-df31-4443-9f1c-0198382bc30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-272fb7e6-694f-4624-8bf7-ed2024ab4e7a', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:12 devstack sudo[114468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d3e73bc3-8b46-4314-9c38-d4c25f910dbe 1073741824 Aug 11 04:56:12 devstack sudo[114468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3cd42909-2ece-445f-b138-226b5b2480bf tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (369bf273-56f1-4552-862d-3bbb18a2d829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:12 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-3cd42909-2ece-445f-b138-226b5b2480bf tempest-CreateVolumesFromSnapshotTest-462764376 None] Volume volume-272fb7e6-694f-4624-8bf7-ed2024ab4e7a (272fb7e6-694f-4624-8bf7-ed2024ab4e7a): created successfully Aug 11 04:56:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3cd42909-2ece-445f-b138-226b5b2480bf tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (369bf273-56f1-4552-862d-3bbb18a2d829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3cd42909-2ece-445f-b138-226b5b2480bf tempest-CreateVolumesFromSnapshotTest-462764376 None] Flow 'volume_create_manager' (a611ca2c-1afe-4fea-9676-feba2a3fa65d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:56:12 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-3cd42909-2ece-445f-b138-226b5b2480bf tempest-CreateVolumesFromSnapshotTest-462764376 None] Created volume successfully. Aug 11 04:56:12 devstack sudo[114468]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e46d9f70-d738-4fd3-a8ce-018172f8b7fb tempest-CreateVolumesFromSnapshotTest-462764376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d3e73bc3-8b46-4314-9c38-d4c25f910dbe 1073741824" returned: 0 in 0.414s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e46d9f70-d738-4fd3-a8ce-018172f8b7fb tempest-CreateVolumesFromSnapshotTest-462764376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d3e73bc3-8b46-4314-9c38-d4c25f910dbe {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:12 devstack sudo[114473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d3e73bc3-8b46-4314-9c38-d4c25f910dbe Aug 11 04:56:12 devstack sudo[114473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:12 devstack sudo[114473]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e46d9f70-d738-4fd3-a8ce-018172f8b7fb tempest-CreateVolumesFromSnapshotTest-462764376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d3e73bc3-8b46-4314-9c38-d4c25f910dbe" returned: 0 in 0.244s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e46d9f70-d738-4fd3-a8ce-018172f8b7fb tempest-CreateVolumesFromSnapshotTest-462764376 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:56:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e46d9f70-d738-4fd3-a8ce-018172f8b7fb tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:56:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-25449a8f-7d09-499e-a17f-ce1cf507c54a tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.472s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:56:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-25449a8f-7d09-499e-a17f-ce1cf507c54a tempest-CreateVolumesFromSnapshotTest-462764376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:56:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-940186398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3021b01-8a71-4500-bc63-a6b24813c36f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc9720ab28d3486ab07f8c7f74da9b95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:56:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:56:11Z,use_quota=True,user_id='903a6f1fd60e40d38c558a5ecb070879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:56:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-25449a8f-7d09-499e-a17f-ce1cf507c54a tempest-CreateVolumesFromSnapshotTest-462764376 None] Creating volume b3021b01-8a71-4500-bc63-a6b24813c36f {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:56:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-25449a8f-7d09-499e-a17f-ce1cf507c54a tempest-CreateVolumesFromSnapshotTest-462764376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:56:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-25449a8f-7d09-499e-a17f-ce1cf507c54a tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:56:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-25449a8f-7d09-499e-a17f-ce1cf507c54a tempest-CreateVolumesFromSnapshotTest-462764376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:56:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-25449a8f-7d09-499e-a17f-ce1cf507c54a tempest-CreateVolumesFromSnapshotTest-462764376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:56:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-25449a8f-7d09-499e-a17f-ce1cf507c54a tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:56:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-25449a8f-7d09-499e-a17f-ce1cf507c54a tempest-CreateVolumesFromSnapshotTest-462764376 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:56:12 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-25449a8f-7d09-499e-a17f-ce1cf507c54a tempest-CreateVolumesFromSnapshotTest-462764376 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:56:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-25449a8f-7d09-499e-a17f-ce1cf507c54a tempest-CreateVolumesFromSnapshotTest-462764376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b3021b01-8a71-4500-bc63-a6b24813c36f 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:12 devstack sudo[114476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b3021b01-8a71-4500-bc63-a6b24813c36f 1073741824 Aug 11 04:56:12 devstack sudo[114476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e46d9f70-d738-4fd3-a8ce-018172f8b7fb tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0032209f-2216-4854-93ed-c6f25a84e345) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3e73bc3-8b46-4314-9c38-d4c25f910dbe', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e46d9f70-d738-4fd3-a8ce-018172f8b7fb tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b144a26-6a6b-42f1-89bf-af73b1e5cf24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:12 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-e46d9f70-d738-4fd3-a8ce-018172f8b7fb tempest-CreateVolumesFromSnapshotTest-462764376 None] Volume volume-d3e73bc3-8b46-4314-9c38-d4c25f910dbe (d3e73bc3-8b46-4314-9c38-d4c25f910dbe): created successfully Aug 11 04:56:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e46d9f70-d738-4fd3-a8ce-018172f8b7fb tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b144a26-6a6b-42f1-89bf-af73b1e5cf24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e46d9f70-d738-4fd3-a8ce-018172f8b7fb tempest-CreateVolumesFromSnapshotTest-462764376 None] Flow 'volume_create_manager' (297278ef-0f38-48e3-ae2c-428d92b4ce5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:56:12 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-e46d9f70-d738-4fd3-a8ce-018172f8b7fb tempest-CreateVolumesFromSnapshotTest-462764376 None] Created volume successfully. Aug 11 04:56:13 devstack sudo[114476]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-25449a8f-7d09-499e-a17f-ce1cf507c54a tempest-CreateVolumesFromSnapshotTest-462764376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b3021b01-8a71-4500-bc63-a6b24813c36f 1073741824" returned: 0 in 0.408s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-25449a8f-7d09-499e-a17f-ce1cf507c54a tempest-CreateVolumesFromSnapshotTest-462764376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b3021b01-8a71-4500-bc63-a6b24813c36f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:13 devstack sudo[114482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b3021b01-8a71-4500-bc63-a6b24813c36f Aug 11 04:56:13 devstack sudo[114482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:13 devstack sudo[114482]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-25449a8f-7d09-499e-a17f-ce1cf507c54a tempest-CreateVolumesFromSnapshotTest-462764376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b3021b01-8a71-4500-bc63-a6b24813c36f" returned: 0 in 0.245s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-25449a8f-7d09-499e-a17f-ce1cf507c54a tempest-CreateVolumesFromSnapshotTest-462764376 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:56:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-25449a8f-7d09-499e-a17f-ce1cf507c54a tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:56:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-25449a8f-7d09-499e-a17f-ce1cf507c54a tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4342ce35-5fe4-4b75-b52b-2be912788836) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3021b01-8a71-4500-bc63-a6b24813c36f', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-25449a8f-7d09-499e-a17f-ce1cf507c54a tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab2e37e8-166b-4a5b-8935-9cc559016189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:13 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-25449a8f-7d09-499e-a17f-ce1cf507c54a tempest-CreateVolumesFromSnapshotTest-462764376 None] Volume volume-b3021b01-8a71-4500-bc63-a6b24813c36f (b3021b01-8a71-4500-bc63-a6b24813c36f): created successfully Aug 11 04:56:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-25449a8f-7d09-499e-a17f-ce1cf507c54a tempest-CreateVolumesFromSnapshotTest-462764376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab2e37e8-166b-4a5b-8935-9cc559016189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-25449a8f-7d09-499e-a17f-ce1cf507c54a tempest-CreateVolumesFromSnapshotTest-462764376 None] Flow 'volume_create_manager' (b65c1fb3-3abf-4090-a925-eb5ddc398f89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:56:13 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-25449a8f-7d09-499e-a17f-ce1cf507c54a tempest-CreateVolumesFromSnapshotTest-462764376 None] Created volume successfully. Aug 11 04:56:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-3ebc79aa-6d8c-481d-898f-a6173c200988 tempest-CreateVolumesFromSnapshotTest-462764376 None] Acquiring lock "cinder-b3021b01-8a71-4500-bc63-a6b24813c36f-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:56:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-3ebc79aa-6d8c-481d-898f-a6173c200988 tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "cinder-b3021b01-8a71-4500-bc63-a6b24813c36f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:56:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-3ebc79aa-6d8c-481d-898f-a6173c200988 tempest-CreateVolumesFromSnapshotTest-462764376 None] Acquiring lock "cinder-quobyte-b3021b01-8a71-4500-bc63-a6b24813c36f" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:56:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-3ebc79aa-6d8c-481d-898f-a6173c200988 tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "cinder-quobyte-b3021b01-8a71-4500-bc63-a6b24813c36f" acquired by "delete_volume" :: waited 0.014s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:56:14 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc7797f-40cb-4496-bd9e-db63f05e86f4]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:56:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3ebc79aa-6d8c-481d-898f-a6173c200988 tempest-CreateVolumesFromSnapshotTest-462764376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b3021b01-8a71-4500-bc63-a6b24813c36f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:14 devstack sudo[114486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b3021b01-8a71-4500-bc63-a6b24813c36f Aug 11 04:56:14 devstack sudo[114486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:14 devstack sudo[114486]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3ebc79aa-6d8c-481d-898f-a6173c200988 tempest-CreateVolumesFromSnapshotTest-462764376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b3021b01-8a71-4500-bc63-a6b24813c36f" returned: 0 in 0.344s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3ebc79aa-6d8c-481d-898f-a6173c200988 tempest-CreateVolumesFromSnapshotTest-462764376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b3021b01-8a71-4500-bc63-a6b24813c36f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:14 devstack sudo[114491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b3021b01-8a71-4500-bc63-a6b24813c36f Aug 11 04:56:14 devstack sudo[114491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:15 devstack sudo[114491]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3ebc79aa-6d8c-481d-898f-a6173c200988 tempest-CreateVolumesFromSnapshotTest-462764376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b3021b01-8a71-4500-bc63-a6b24813c36f" returned: 0 in 0.236s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:15 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-3ebc79aa-6d8c-481d-898f-a6173c200988 tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "cinder-quobyte-b3021b01-8a71-4500-bc63-a6b24813c36f" released by "delete_volume" :: held 0.619s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:56:15 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-3ebc79aa-6d8c-481d-898f-a6173c200988 tempest-CreateVolumesFromSnapshotTest-462764376 None] Created reservations ['da13862a-8531-4ac0-b452-fd79c1f56e73', 'd5ff0ee3-3a9e-42bd-bb99-8c011e0eeccd', '7c8f1385-fb3d-4862-baa5-7ce7e6a78942', '12ebdae9-a910-4a62-87fe-5ee16c547162'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:56:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3ebc79aa-6d8c-481d-898f-a6173c200988 tempest-CreateVolumesFromSnapshotTest-462764376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:56:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3ebc79aa-6d8c-481d-898f-a6173c200988 tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:56:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3ebc79aa-6d8c-481d-898f-a6173c200988 tempest-CreateVolumesFromSnapshotTest-462764376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:56:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3ebc79aa-6d8c-481d-898f-a6173c200988 tempest-CreateVolumesFromSnapshotTest-462764376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:56:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3ebc79aa-6d8c-481d-898f-a6173c200988 tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:56:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3ebc79aa-6d8c-481d-898f-a6173c200988 tempest-CreateVolumesFromSnapshotTest-462764376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:15 devstack sudo[114494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:56:15 devstack sudo[114494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:15 devstack sudo[114494]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3ebc79aa-6d8c-481d-898f-a6173c200988 tempest-CreateVolumesFromSnapshotTest-462764376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.242s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:15 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-3ebc79aa-6d8c-481d-898f-a6173c200988 tempest-CreateVolumesFromSnapshotTest-462764376 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:56:15 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-3ebc79aa-6d8c-481d-898f-a6173c200988 tempest-CreateVolumesFromSnapshotTest-462764376 None] Deleted volume successfully. Aug 11 04:56:15 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-3ebc79aa-6d8c-481d-898f-a6173c200988 tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "cinder-b3021b01-8a71-4500-bc63-a6b24813c36f-delete_volume" released by "delete_volume" :: held 1.057s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:56:15 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-cac76c9a-2540-431c-a813-1a2cb3001a59 tempest-CreateVolumesFromSnapshotTest-462764376 None] Acquiring lock "cinder-d3e73bc3-8b46-4314-9c38-d4c25f910dbe-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:56:15 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-cac76c9a-2540-431c-a813-1a2cb3001a59 tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "cinder-d3e73bc3-8b46-4314-9c38-d4c25f910dbe-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:56:15 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-cac76c9a-2540-431c-a813-1a2cb3001a59 tempest-CreateVolumesFromSnapshotTest-462764376 None] Acquiring lock "cinder-quobyte-d3e73bc3-8b46-4314-9c38-d4c25f910dbe" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:56:15 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-cac76c9a-2540-431c-a813-1a2cb3001a59 tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "cinder-quobyte-d3e73bc3-8b46-4314-9c38-d4c25f910dbe" acquired by "delete_volume" :: waited 0.014s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:56:15 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b187b2-60b8-477d-8bda-3ef8c8880bbf]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:56:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cac76c9a-2540-431c-a813-1a2cb3001a59 tempest-CreateVolumesFromSnapshotTest-462764376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d3e73bc3-8b46-4314-9c38-d4c25f910dbe {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:15 devstack sudo[114497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d3e73bc3-8b46-4314-9c38-d4c25f910dbe Aug 11 04:56:15 devstack sudo[114497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:16 devstack sudo[114497]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cac76c9a-2540-431c-a813-1a2cb3001a59 tempest-CreateVolumesFromSnapshotTest-462764376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d3e73bc3-8b46-4314-9c38-d4c25f910dbe" returned: 0 in 0.346s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cac76c9a-2540-431c-a813-1a2cb3001a59 tempest-CreateVolumesFromSnapshotTest-462764376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d3e73bc3-8b46-4314-9c38-d4c25f910dbe {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:16 devstack sudo[114502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d3e73bc3-8b46-4314-9c38-d4c25f910dbe Aug 11 04:56:16 devstack sudo[114502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:16 devstack sudo[114502]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cac76c9a-2540-431c-a813-1a2cb3001a59 tempest-CreateVolumesFromSnapshotTest-462764376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d3e73bc3-8b46-4314-9c38-d4c25f910dbe" returned: 0 in 0.240s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:16 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-cac76c9a-2540-431c-a813-1a2cb3001a59 tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "cinder-quobyte-d3e73bc3-8b46-4314-9c38-d4c25f910dbe" released by "delete_volume" :: held 0.625s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:56:16 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-cac76c9a-2540-431c-a813-1a2cb3001a59 tempest-CreateVolumesFromSnapshotTest-462764376 None] Created reservations ['352d2707-3ab7-4cda-a2aa-61f352e6d657', '789f3332-0cd2-4505-903f-58e99b9521e6', 'a96137e7-c919-4b2b-a3d7-274ec53bb54d', '298e3921-e17f-43f3-b5a2-c32beee901e5'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:56:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-cac76c9a-2540-431c-a813-1a2cb3001a59 tempest-CreateVolumesFromSnapshotTest-462764376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:56:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-cac76c9a-2540-431c-a813-1a2cb3001a59 tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:56:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-cac76c9a-2540-431c-a813-1a2cb3001a59 tempest-CreateVolumesFromSnapshotTest-462764376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:56:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-cac76c9a-2540-431c-a813-1a2cb3001a59 tempest-CreateVolumesFromSnapshotTest-462764376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:56:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-cac76c9a-2540-431c-a813-1a2cb3001a59 tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:56:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cac76c9a-2540-431c-a813-1a2cb3001a59 tempest-CreateVolumesFromSnapshotTest-462764376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:16 devstack sudo[114505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:56:16 devstack sudo[114505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:16 devstack sudo[114505]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cac76c9a-2540-431c-a813-1a2cb3001a59 tempest-CreateVolumesFromSnapshotTest-462764376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.240s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:16 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-cac76c9a-2540-431c-a813-1a2cb3001a59 tempest-CreateVolumesFromSnapshotTest-462764376 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:56:16 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-cac76c9a-2540-431c-a813-1a2cb3001a59 tempest-CreateVolumesFromSnapshotTest-462764376 None] Deleted volume successfully. Aug 11 04:56:16 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-cac76c9a-2540-431c-a813-1a2cb3001a59 tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "cinder-d3e73bc3-8b46-4314-9c38-d4c25f910dbe-delete_volume" released by "delete_volume" :: held 1.053s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:56:16 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1203d363-8434-49cb-92ca-fc496ef90e74 tempest-CreateVolumesFromSnapshotTest-462764376 None] Acquiring lock "cinder-272fb7e6-694f-4624-8bf7-ed2024ab4e7a-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:56:16 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1203d363-8434-49cb-92ca-fc496ef90e74 tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "cinder-272fb7e6-694f-4624-8bf7-ed2024ab4e7a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:56:16 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1203d363-8434-49cb-92ca-fc496ef90e74 tempest-CreateVolumesFromSnapshotTest-462764376 None] Acquiring lock "cinder-quobyte-272fb7e6-694f-4624-8bf7-ed2024ab4e7a" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:56:16 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1203d363-8434-49cb-92ca-fc496ef90e74 tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "cinder-quobyte-272fb7e6-694f-4624-8bf7-ed2024ab4e7a" acquired by "delete_volume" :: waited 0.015s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:56:16 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a18d88-9850-4205-9a7e-0dedfb0592f2]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:56:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1203d363-8434-49cb-92ca-fc496ef90e74 tempest-CreateVolumesFromSnapshotTest-462764376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-272fb7e6-694f-4624-8bf7-ed2024ab4e7a {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:17 devstack sudo[114508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-272fb7e6-694f-4624-8bf7-ed2024ab4e7a Aug 11 04:56:17 devstack sudo[114508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:17 devstack sudo[114508]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1203d363-8434-49cb-92ca-fc496ef90e74 tempest-CreateVolumesFromSnapshotTest-462764376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-272fb7e6-694f-4624-8bf7-ed2024ab4e7a" returned: 0 in 0.352s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1203d363-8434-49cb-92ca-fc496ef90e74 tempest-CreateVolumesFromSnapshotTest-462764376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-272fb7e6-694f-4624-8bf7-ed2024ab4e7a {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:17 devstack sudo[114514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-272fb7e6-694f-4624-8bf7-ed2024ab4e7a Aug 11 04:56:17 devstack sudo[114514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:17 devstack sudo[114514]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1203d363-8434-49cb-92ca-fc496ef90e74 tempest-CreateVolumesFromSnapshotTest-462764376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-272fb7e6-694f-4624-8bf7-ed2024ab4e7a" returned: 0 in 0.242s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1203d363-8434-49cb-92ca-fc496ef90e74 tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "cinder-quobyte-272fb7e6-694f-4624-8bf7-ed2024ab4e7a" released by "delete_volume" :: held 0.630s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:56:17 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-1203d363-8434-49cb-92ca-fc496ef90e74 tempest-CreateVolumesFromSnapshotTest-462764376 None] Created reservations ['a79aeb51-b75b-4135-a49b-79e90d7670ce', '3ac39c3a-ead7-4d23-9702-39773c88b263', 'c713dd7f-de36-4039-8f6d-2ce0c5d829a7', '64fd757d-7d2a-4966-9966-5856750fa97c'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:56:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1203d363-8434-49cb-92ca-fc496ef90e74 tempest-CreateVolumesFromSnapshotTest-462764376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:56:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1203d363-8434-49cb-92ca-fc496ef90e74 tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:56:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1203d363-8434-49cb-92ca-fc496ef90e74 tempest-CreateVolumesFromSnapshotTest-462764376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:56:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1203d363-8434-49cb-92ca-fc496ef90e74 tempest-CreateVolumesFromSnapshotTest-462764376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:56:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1203d363-8434-49cb-92ca-fc496ef90e74 tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:56:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1203d363-8434-49cb-92ca-fc496ef90e74 tempest-CreateVolumesFromSnapshotTest-462764376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:17 devstack sudo[114517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:56:17 devstack sudo[114517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:17 devstack sudo[114517]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1203d363-8434-49cb-92ca-fc496ef90e74 tempest-CreateVolumesFromSnapshotTest-462764376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.241s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:17 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-1203d363-8434-49cb-92ca-fc496ef90e74 tempest-CreateVolumesFromSnapshotTest-462764376 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:56:17 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-1203d363-8434-49cb-92ca-fc496ef90e74 tempest-CreateVolumesFromSnapshotTest-462764376 None] Deleted volume successfully. Aug 11 04:56:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1203d363-8434-49cb-92ca-fc496ef90e74 tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "cinder-272fb7e6-694f-4624-8bf7-ed2024ab4e7a-delete_volume" released by "delete_volume" :: held 1.062s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:56:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a062c122-0854-4c6f-b1fe-c30e6f0f30a7 tempest-CreateVolumesFromSnapshotTest-462764376 None] Acquiring lock "cinder-f50deb0c-b165-48ec-aec0-bd4ca29d819e-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:56:18 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a062c122-0854-4c6f-b1fe-c30e6f0f30a7 tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "cinder-f50deb0c-b165-48ec-aec0-bd4ca29d819e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:56:18 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a062c122-0854-4c6f-b1fe-c30e6f0f30a7 tempest-CreateVolumesFromSnapshotTest-462764376 None] Acquiring lock "cinder-quobyte-f50deb0c-b165-48ec-aec0-bd4ca29d819e" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:56:18 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a062c122-0854-4c6f-b1fe-c30e6f0f30a7 tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "cinder-quobyte-f50deb0c-b165-48ec-aec0-bd4ca29d819e" acquired by "delete_volume" :: waited 0.015s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:56:18 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6360579-5c44-4511-9087-9ba8e3b1e792]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:56:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a062c122-0854-4c6f-b1fe-c30e6f0f30a7 tempest-CreateVolumesFromSnapshotTest-462764376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f50deb0c-b165-48ec-aec0-bd4ca29d819e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:18 devstack sudo[114520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f50deb0c-b165-48ec-aec0-bd4ca29d819e Aug 11 04:56:18 devstack sudo[114520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:18 devstack sudo[114520]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a062c122-0854-4c6f-b1fe-c30e6f0f30a7 tempest-CreateVolumesFromSnapshotTest-462764376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f50deb0c-b165-48ec-aec0-bd4ca29d819e" returned: 0 in 0.351s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a062c122-0854-4c6f-b1fe-c30e6f0f30a7 tempest-CreateVolumesFromSnapshotTest-462764376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f50deb0c-b165-48ec-aec0-bd4ca29d819e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:18 devstack sudo[114525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f50deb0c-b165-48ec-aec0-bd4ca29d819e Aug 11 04:56:18 devstack sudo[114525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:18 devstack sudo[114525]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a062c122-0854-4c6f-b1fe-c30e6f0f30a7 tempest-CreateVolumesFromSnapshotTest-462764376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f50deb0c-b165-48ec-aec0-bd4ca29d819e" returned: 0 in 0.237s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:18 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a062c122-0854-4c6f-b1fe-c30e6f0f30a7 tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "cinder-quobyte-f50deb0c-b165-48ec-aec0-bd4ca29d819e" released by "delete_volume" :: held 0.622s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:56:18 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-a062c122-0854-4c6f-b1fe-c30e6f0f30a7 tempest-CreateVolumesFromSnapshotTest-462764376 None] Created reservations ['08f68097-cab6-4891-abf5-9e948fc0314f', '192084dd-14f1-4ddb-a864-a7921cde0ab3', '32c48c09-cee7-4ac0-982e-d0dd67457604', '554cbe6d-2d69-4311-92f4-e7358c3d506a'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:56:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a062c122-0854-4c6f-b1fe-c30e6f0f30a7 tempest-CreateVolumesFromSnapshotTest-462764376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:56:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a062c122-0854-4c6f-b1fe-c30e6f0f30a7 tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:56:18 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a062c122-0854-4c6f-b1fe-c30e6f0f30a7 tempest-CreateVolumesFromSnapshotTest-462764376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:56:18 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a062c122-0854-4c6f-b1fe-c30e6f0f30a7 tempest-CreateVolumesFromSnapshotTest-462764376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:56:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a062c122-0854-4c6f-b1fe-c30e6f0f30a7 tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:56:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a062c122-0854-4c6f-b1fe-c30e6f0f30a7 tempest-CreateVolumesFromSnapshotTest-462764376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:18 devstack sudo[114528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:56:18 devstack sudo[114528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:19 devstack sudo[114528]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a062c122-0854-4c6f-b1fe-c30e6f0f30a7 tempest-CreateVolumesFromSnapshotTest-462764376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.231s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:19 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-a062c122-0854-4c6f-b1fe-c30e6f0f30a7 tempest-CreateVolumesFromSnapshotTest-462764376 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:56:19 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-a062c122-0854-4c6f-b1fe-c30e6f0f30a7 tempest-CreateVolumesFromSnapshotTest-462764376 None] Deleted volume successfully. Aug 11 04:56:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a062c122-0854-4c6f-b1fe-c30e6f0f30a7 tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "cinder-f50deb0c-b165-48ec-aec0-bd4ca29d819e-delete_volume" released by "delete_volume" :: held 1.034s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:56:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f2c9465c-226b-41a4-93e7-c7859169ea92 tempest-CreateVolumesFromSnapshotTest-462764376 None] Acquiring lock "cinder-d4d3dc1d-9b8b-4e3d-8a4f-66000d0ba479-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:56:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f2c9465c-226b-41a4-93e7-c7859169ea92 tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "cinder-d4d3dc1d-9b8b-4e3d-8a4f-66000d0ba479-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:56:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f2c9465c-226b-41a4-93e7-c7859169ea92 tempest-CreateVolumesFromSnapshotTest-462764376 None] Acquiring lock "cinder-quobyte-d4d3dc1d-9b8b-4e3d-8a4f-66000d0ba479" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:56:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f2c9465c-226b-41a4-93e7-c7859169ea92 tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "cinder-quobyte-d4d3dc1d-9b8b-4e3d-8a4f-66000d0ba479" acquired by "delete_volume" :: waited 0.014s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:56:19 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[376aa735-70ad-4f1b-a424-b2ffb6502fee]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:56:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f2c9465c-226b-41a4-93e7-c7859169ea92 tempest-CreateVolumesFromSnapshotTest-462764376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d4d3dc1d-9b8b-4e3d-8a4f-66000d0ba479 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:19 devstack sudo[114531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d4d3dc1d-9b8b-4e3d-8a4f-66000d0ba479 Aug 11 04:56:19 devstack sudo[114531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:19 devstack sudo[114531]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f2c9465c-226b-41a4-93e7-c7859169ea92 tempest-CreateVolumesFromSnapshotTest-462764376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d4d3dc1d-9b8b-4e3d-8a4f-66000d0ba479" returned: 0 in 0.349s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f2c9465c-226b-41a4-93e7-c7859169ea92 tempest-CreateVolumesFromSnapshotTest-462764376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d4d3dc1d-9b8b-4e3d-8a4f-66000d0ba479 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:19 devstack sudo[114536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d4d3dc1d-9b8b-4e3d-8a4f-66000d0ba479 Aug 11 04:56:19 devstack sudo[114536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:19 devstack sudo[114536]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f2c9465c-226b-41a4-93e7-c7859169ea92 tempest-CreateVolumesFromSnapshotTest-462764376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-d4d3dc1d-9b8b-4e3d-8a4f-66000d0ba479" returned: 0 in 0.260s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f2c9465c-226b-41a4-93e7-c7859169ea92 tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "cinder-quobyte-d4d3dc1d-9b8b-4e3d-8a4f-66000d0ba479" released by "delete_volume" :: held 0.648s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:56:19 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-f2c9465c-226b-41a4-93e7-c7859169ea92 tempest-CreateVolumesFromSnapshotTest-462764376 None] Created reservations ['34b90084-a5b0-4369-a0f7-5c25e3e7b71d', 'a3b6b2b3-77d1-49bf-a1bb-fd2df67002fb', '98544d05-6968-476a-91a3-f2882bd4887a', 'f5741910-7421-4e8d-b14c-3bccc2132008'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:56:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f2c9465c-226b-41a4-93e7-c7859169ea92 tempest-CreateVolumesFromSnapshotTest-462764376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:56:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f2c9465c-226b-41a4-93e7-c7859169ea92 tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:56:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f2c9465c-226b-41a4-93e7-c7859169ea92 tempest-CreateVolumesFromSnapshotTest-462764376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:56:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f2c9465c-226b-41a4-93e7-c7859169ea92 tempest-CreateVolumesFromSnapshotTest-462764376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:56:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f2c9465c-226b-41a4-93e7-c7859169ea92 tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:56:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f2c9465c-226b-41a4-93e7-c7859169ea92 tempest-CreateVolumesFromSnapshotTest-462764376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:19 devstack sudo[114539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:56:19 devstack sudo[114539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:20 devstack sudo[114539]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f2c9465c-226b-41a4-93e7-c7859169ea92 tempest-CreateVolumesFromSnapshotTest-462764376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.252s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:20 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-f2c9465c-226b-41a4-93e7-c7859169ea92 tempest-CreateVolumesFromSnapshotTest-462764376 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:56:20 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-f2c9465c-226b-41a4-93e7-c7859169ea92 tempest-CreateVolumesFromSnapshotTest-462764376 None] Deleted volume successfully. Aug 11 04:56:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f2c9465c-226b-41a4-93e7-c7859169ea92 tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "cinder-d4d3dc1d-9b8b-4e3d-8a4f-66000d0ba479-delete_volume" released by "delete_volume" :: held 1.094s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:56:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a77734bc-84cd-4a7a-928d-7c6226ceba0b tempest-CreateVolumesFromSnapshotTest-462764376 None] Acquiring lock "cinder-8a7291d0-c35b-49c8-a90c-2dabb1bc6f28-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:56:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a77734bc-84cd-4a7a-928d-7c6226ceba0b tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "cinder-8a7291d0-c35b-49c8-a90c-2dabb1bc6f28-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:56:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a77734bc-84cd-4a7a-928d-7c6226ceba0b tempest-CreateVolumesFromSnapshotTest-462764376 None] Acquiring lock "cinder-quobyte-a0a88ac4-db7b-470a-90e6-a3e706fa9740" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:56:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a77734bc-84cd-4a7a-928d-7c6226ceba0b tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "cinder-quobyte-a0a88ac4-db7b-470a-90e6-a3e706fa9740" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:56:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a77734bc-84cd-4a7a-928d-7c6226ceba0b tempest-CreateVolumesFromSnapshotTest-462764376 None] Acquiring lock "cinder-quobyte-8a7291d0-c35b-49c8-a90c-2dabb1bc6f28" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:56:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a77734bc-84cd-4a7a-928d-7c6226ceba0b tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "cinder-quobyte-8a7291d0-c35b-49c8-a90c-2dabb1bc6f28" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:56:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-a77734bc-84cd-4a7a-928d-7c6226ceba0b tempest-CreateVolumesFromSnapshotTest-462764376 None] Deleting offline snapshot 8a7291d0-c35b-49c8-a90c-2dabb1bc6f28 of volume a0a88ac4-db7b-470a-90e6-a3e706fa9740 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 04:56:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-a77734bc-84cd-4a7a-928d-7c6226ceba0b tempest-CreateVolumesFromSnapshotTest-462764376 None] snapshot_file for this snap is: volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740.8a7291d0-c35b-49c8-a90c-2dabb1bc6f28 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 04:56:20 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed90717-d886-4d6b-90cd-aecd44dab9cb]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:56:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a77734bc-84cd-4a7a-928d-7c6226ceba0b tempest-CreateVolumesFromSnapshotTest-462764376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740.8a7291d0-c35b-49c8-a90c-2dabb1bc6f28 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:20 devstack sudo[114578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740.8a7291d0-c35b-49c8-a90c-2dabb1bc6f28 Aug 11 04:56:20 devstack sudo[114578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:20 devstack sudo[114578]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a77734bc-84cd-4a7a-928d-7c6226ceba0b tempest-CreateVolumesFromSnapshotTest-462764376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740.8a7291d0-c35b-49c8-a90c-2dabb1bc6f28" returned: 0 in 0.369s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-a77734bc-84cd-4a7a-928d-7c6226ceba0b tempest-CreateVolumesFromSnapshotTest-462764376 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:56:20 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7dc1bc6-12b1-47a9-8a7e-fa56f001c9c0]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:56:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a77734bc-84cd-4a7a-928d-7c6226ceba0b tempest-CreateVolumesFromSnapshotTest-462764376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:20 devstack sudo[114583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740 Aug 11 04:56:20 devstack sudo[114583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:21 devstack sudo[114583]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a77734bc-84cd-4a7a-928d-7c6226ceba0b tempest-CreateVolumesFromSnapshotTest-462764376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740" returned: 0 in 0.367s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a77734bc-84cd-4a7a-928d-7c6226ceba0b tempest-CreateVolumesFromSnapshotTest-462764376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740.8a7291d0-c35b-49c8-a90c-2dabb1bc6f28 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:21 devstack sudo[114588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740.8a7291d0-c35b-49c8-a90c-2dabb1bc6f28 Aug 11 04:56:21 devstack sudo[114588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:21 devstack sudo[114588]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a77734bc-84cd-4a7a-928d-7c6226ceba0b tempest-CreateVolumesFromSnapshotTest-462764376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740.8a7291d0-c35b-49c8-a90c-2dabb1bc6f28" returned: 0 in 0.337s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a77734bc-84cd-4a7a-928d-7c6226ceba0b tempest-CreateVolumesFromSnapshotTest-462764376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740.8a7291d0-c35b-49c8-a90c-2dabb1bc6f28 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:21 devstack sudo[114593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740.8a7291d0-c35b-49c8-a90c-2dabb1bc6f28 Aug 11 04:56:21 devstack sudo[114593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:21 devstack sudo[114593]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a77734bc-84cd-4a7a-928d-7c6226ceba0b tempest-CreateVolumesFromSnapshotTest-462764376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740.8a7291d0-c35b-49c8-a90c-2dabb1bc6f28" returned: 0 in 0.244s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a77734bc-84cd-4a7a-928d-7c6226ceba0b tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "cinder-quobyte-8a7291d0-c35b-49c8-a90c-2dabb1bc6f28" released by "_delete_snapshot" :: held 1.420s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:56:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a77734bc-84cd-4a7a-928d-7c6226ceba0b tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "cinder-quobyte-a0a88ac4-db7b-470a-90e6-a3e706fa9740" released by "delete_snapshot" :: held 1.444s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:56:21 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-a77734bc-84cd-4a7a-928d-7c6226ceba0b tempest-CreateVolumesFromSnapshotTest-462764376 None] Created reservations ['f1bbc4ad-e23d-4fa9-a445-8cf50ce3ed13', '0fedccdd-a7a9-4801-b544-9e4b44c61b92', 'f04ec494-ec7c-4773-a6d1-cc16254425f4', 'cd1d6b2b-885b-4a09-b1b1-c3c31d9272c3'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:56:21 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-a77734bc-84cd-4a7a-928d-7c6226ceba0b tempest-CreateVolumesFromSnapshotTest-462764376 None] Delete snapshot completed successfully. Aug 11 04:56:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a77734bc-84cd-4a7a-928d-7c6226ceba0b tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "cinder-8a7291d0-c35b-49c8-a90c-2dabb1bc6f28-delete_snapshot" released by "delete_snapshot" :: held 1.581s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:56:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6c8d34e7-e403-4553-b174-416e86106c6a tempest-CreateVolumesFromSnapshotTest-462764376 None] Acquiring lock "cinder-a0a88ac4-db7b-470a-90e6-a3e706fa9740-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:56:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6c8d34e7-e403-4553-b174-416e86106c6a tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "cinder-a0a88ac4-db7b-470a-90e6-a3e706fa9740-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:56:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6c8d34e7-e403-4553-b174-416e86106c6a tempest-CreateVolumesFromSnapshotTest-462764376 None] Acquiring lock "cinder-quobyte-a0a88ac4-db7b-470a-90e6-a3e706fa9740" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:56:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6c8d34e7-e403-4553-b174-416e86106c6a tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "cinder-quobyte-a0a88ac4-db7b-470a-90e6-a3e706fa9740" acquired by "delete_volume" :: waited 0.013s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:56:22 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b25142e-ce08-49ee-9421-eb9d1620efd9]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:56:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6c8d34e7-e403-4553-b174-416e86106c6a tempest-CreateVolumesFromSnapshotTest-462764376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:22 devstack sudo[114596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740 Aug 11 04:56:22 devstack sudo[114596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:22 devstack sudo[114596]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6c8d34e7-e403-4553-b174-416e86106c6a tempest-CreateVolumesFromSnapshotTest-462764376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740" returned: 0 in 0.362s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6c8d34e7-e403-4553-b174-416e86106c6a tempest-CreateVolumesFromSnapshotTest-462764376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:22 devstack sudo[114601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740 Aug 11 04:56:22 devstack sudo[114601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:23 devstack sudo[114601]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6c8d34e7-e403-4553-b174-416e86106c6a tempest-CreateVolumesFromSnapshotTest-462764376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a0a88ac4-db7b-470a-90e6-a3e706fa9740" returned: 0 in 0.251s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6c8d34e7-e403-4553-b174-416e86106c6a tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "cinder-quobyte-a0a88ac4-db7b-470a-90e6-a3e706fa9740" released by "delete_volume" :: held 0.674s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:56:23 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-6c8d34e7-e403-4553-b174-416e86106c6a tempest-CreateVolumesFromSnapshotTest-462764376 None] Created reservations ['dbb87569-6130-4965-83e0-3fc96a10af5d', '569e99e3-9b65-43a1-b214-5cd6e7ab4385', 'd1352976-58e4-470d-b29b-bd3e029d7c97', '40de57cb-f0a0-4cfd-a047-868b03fae7aa'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:56:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6c8d34e7-e403-4553-b174-416e86106c6a tempest-CreateVolumesFromSnapshotTest-462764376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:56:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6c8d34e7-e403-4553-b174-416e86106c6a tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:56:23 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6c8d34e7-e403-4553-b174-416e86106c6a tempest-CreateVolumesFromSnapshotTest-462764376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:56:23 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6c8d34e7-e403-4553-b174-416e86106c6a tempest-CreateVolumesFromSnapshotTest-462764376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:56:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6c8d34e7-e403-4553-b174-416e86106c6a tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:56:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6c8d34e7-e403-4553-b174-416e86106c6a tempest-CreateVolumesFromSnapshotTest-462764376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:23 devstack sudo[114604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:56:23 devstack sudo[114604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:23 devstack sudo[114604]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6c8d34e7-e403-4553-b174-416e86106c6a tempest-CreateVolumesFromSnapshotTest-462764376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.251s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:23 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-6c8d34e7-e403-4553-b174-416e86106c6a tempest-CreateVolumesFromSnapshotTest-462764376 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:56:23 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-6c8d34e7-e403-4553-b174-416e86106c6a tempest-CreateVolumesFromSnapshotTest-462764376 None] Deleted volume successfully. Aug 11 04:56:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6c8d34e7-e403-4553-b174-416e86106c6a tempest-CreateVolumesFromSnapshotTest-462764376 None] Lock "cinder-a0a88ac4-db7b-470a-90e6-a3e706fa9740-delete_volume" released by "delete_volume" :: held 1.116s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:56:26 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-09c21171-bed2-41ac-b7d7-e676cf6c6042 tempest-CinderUnicodeTest-937732304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:56:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-09c21171-bed2-41ac-b7d7-e676cf6c6042 tempest-CinderUnicodeTest-937732304 None] Flow 'volume_create_manager' (a3451d28-df01-48e3-9084-aaa563f95bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:56:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-09c21171-bed2-41ac-b7d7-e676cf6c6042 tempest-CinderUnicodeTest-937732304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44500f22-3851-45e2-933e-56480691adfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-09c21171-bed2-41ac-b7d7-e676cf6c6042 tempest-CinderUnicodeTest-937732304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44500f22-3851-45e2-933e-56480691adfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8196f62b-e640-4e38-b27e-5988168ae8ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d4d6457c6d94bfbb69c4a867694d59a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:56:26Z,use_quota=True,user_id='dd3bb2555f224b658f7a8b341e4278e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-09c21171-bed2-41ac-b7d7-e676cf6c6042 tempest-CinderUnicodeTest-937732304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ce989ee-3ad0-4fe3-a408-32d731327be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-09c21171-bed2-41ac-b7d7-e676cf6c6042 tempest-CinderUnicodeTest-937732304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ce989ee-3ad0-4fe3-a408-32d731327be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-09c21171-bed2-41ac-b7d7-e676cf6c6042 tempest-CinderUnicodeTest-937732304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69f3d59d-78aa-4539-b5a4-a9711ab151c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-09c21171-bed2-41ac-b7d7-e676cf6c6042 tempest-CinderUnicodeTest-937732304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69f3d59d-78aa-4539-b5a4-a9711ab151c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8196f62b-e640-4e38-b27e-5988168ae8ba', 'volume_name': 'volume-8196f62b-e640-4e38-b27e-5988168ae8ba', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-09c21171-bed2-41ac-b7d7-e676cf6c6042 tempest-CinderUnicodeTest-937732304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12fd49a3-73ab-46b3-9a90-0f260805b507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-09c21171-bed2-41ac-b7d7-e676cf6c6042 tempest-CinderUnicodeTest-937732304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12fd49a3-73ab-46b3-9a90-0f260805b507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-09c21171-bed2-41ac-b7d7-e676cf6c6042 tempest-CinderUnicodeTest-937732304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b69be2fe-7be9-4115-9bba-23b7de0e5022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:26 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-09c21171-bed2-41ac-b7d7-e676cf6c6042 tempest-CinderUnicodeTest-937732304 None] Volume 8196f62b-e640-4e38-b27e-5988168ae8ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8196f62b-e640-4e38-b27e-5988168ae8ba', 'volume_size': 1} Aug 11 04:56:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-09c21171-bed2-41ac-b7d7-e676cf6c6042 tempest-CinderUnicodeTest-937732304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:56:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-09c21171-bed2-41ac-b7d7-e676cf6c6042 tempest-CinderUnicodeTest-937732304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:56:26 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-09c21171-bed2-41ac-b7d7-e676cf6c6042 tempest-CinderUnicodeTest-937732304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8196f62b-e640-4e38-b27e-5988168ae8ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d4d6457c6d94bfbb69c4a867694d59a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:56:26Z,use_quota=True,user_id='dd3bb2555f224b658f7a8b341e4278e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:56:26 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-09c21171-bed2-41ac-b7d7-e676cf6c6042 tempest-CinderUnicodeTest-937732304 None] Creating volume 8196f62b-e640-4e38-b27e-5988168ae8ba {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:56:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-09c21171-bed2-41ac-b7d7-e676cf6c6042 tempest-CinderUnicodeTest-937732304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:56:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-09c21171-bed2-41ac-b7d7-e676cf6c6042 tempest-CinderUnicodeTest-937732304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:56:26 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-09c21171-bed2-41ac-b7d7-e676cf6c6042 tempest-CinderUnicodeTest-937732304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:56:26 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-09c21171-bed2-41ac-b7d7-e676cf6c6042 tempest-CinderUnicodeTest-937732304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:56:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-09c21171-bed2-41ac-b7d7-e676cf6c6042 tempest-CinderUnicodeTest-937732304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:56:26 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-09c21171-bed2-41ac-b7d7-e676cf6c6042 tempest-CinderUnicodeTest-937732304 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:56:26 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-09c21171-bed2-41ac-b7d7-e676cf6c6042 tempest-CinderUnicodeTest-937732304 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:56:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-09c21171-bed2-41ac-b7d7-e676cf6c6042 tempest-CinderUnicodeTest-937732304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8196f62b-e640-4e38-b27e-5988168ae8ba 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:26 devstack sudo[114614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8196f62b-e640-4e38-b27e-5988168ae8ba 1073741824 Aug 11 04:56:26 devstack sudo[114614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:26 devstack sudo[114614]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-09c21171-bed2-41ac-b7d7-e676cf6c6042 tempest-CinderUnicodeTest-937732304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8196f62b-e640-4e38-b27e-5988168ae8ba 1073741824" returned: 0 in 0.409s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-09c21171-bed2-41ac-b7d7-e676cf6c6042 tempest-CinderUnicodeTest-937732304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8196f62b-e640-4e38-b27e-5988168ae8ba {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:26 devstack sudo[114619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8196f62b-e640-4e38-b27e-5988168ae8ba Aug 11 04:56:26 devstack sudo[114619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:26 devstack sudo[114619]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-09c21171-bed2-41ac-b7d7-e676cf6c6042 tempest-CinderUnicodeTest-937732304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8196f62b-e640-4e38-b27e-5988168ae8ba" returned: 0 in 0.243s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:26 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-09c21171-bed2-41ac-b7d7-e676cf6c6042 tempest-CinderUnicodeTest-937732304 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:56:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-09c21171-bed2-41ac-b7d7-e676cf6c6042 tempest-CinderUnicodeTest-937732304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:56:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-09c21171-bed2-41ac-b7d7-e676cf6c6042 tempest-CinderUnicodeTest-937732304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b69be2fe-7be9-4115-9bba-23b7de0e5022) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8196f62b-e640-4e38-b27e-5988168ae8ba', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-09c21171-bed2-41ac-b7d7-e676cf6c6042 tempest-CinderUnicodeTest-937732304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9893cde8-cab5-443d-9275-ddf3125bb83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:26 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-09c21171-bed2-41ac-b7d7-e676cf6c6042 tempest-CinderUnicodeTest-937732304 None] Volume volume-8196f62b-e640-4e38-b27e-5988168ae8ba (8196f62b-e640-4e38-b27e-5988168ae8ba): created successfully Aug 11 04:56:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-09c21171-bed2-41ac-b7d7-e676cf6c6042 tempest-CinderUnicodeTest-937732304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9893cde8-cab5-443d-9275-ddf3125bb83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-09c21171-bed2-41ac-b7d7-e676cf6c6042 tempest-CinderUnicodeTest-937732304 None] Flow 'volume_create_manager' (a3451d28-df01-48e3-9084-aaa563f95bd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:56:26 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-09c21171-bed2-41ac-b7d7-e676cf6c6042 tempest-CinderUnicodeTest-937732304 None] Created volume successfully. Aug 11 04:56:27 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-4270b9bc-5edc-4e96-93a1-9794c4ef7e4d tempest-CinderUnicodeTest-937732304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:56:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4270b9bc-5edc-4e96-93a1-9794c4ef7e4d tempest-CinderUnicodeTest-937732304 None] Flow 'volume_create_manager' (2a878456-0cf6-41ef-b6ff-dd2652031ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:56:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4270b9bc-5edc-4e96-93a1-9794c4ef7e4d tempest-CinderUnicodeTest-937732304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e109e72-c0fd-413b-bdb5-6564a9540df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4270b9bc-5edc-4e96-93a1-9794c4ef7e4d tempest-CinderUnicodeTest-937732304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e109e72-c0fd-413b-bdb5-6564a9540df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:56:27Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1098782308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea912711-e0a0-49b0-ad9b-ee557659320b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d4d6457c6d94bfbb69c4a867694d59a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:56:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:56:28Z,use_quota=True,user_id='dd3bb2555f224b658f7a8b341e4278e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4270b9bc-5edc-4e96-93a1-9794c4ef7e4d tempest-CinderUnicodeTest-937732304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9875e6d9-809f-4c98-87bb-e4004a2e8686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4270b9bc-5edc-4e96-93a1-9794c4ef7e4d tempest-CinderUnicodeTest-937732304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9875e6d9-809f-4c98-87bb-e4004a2e8686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4270b9bc-5edc-4e96-93a1-9794c4ef7e4d tempest-CinderUnicodeTest-937732304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8de9b7f-a380-4800-b347-df197d643c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4270b9bc-5edc-4e96-93a1-9794c4ef7e4d tempest-CinderUnicodeTest-937732304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8de9b7f-a380-4800-b347-df197d643c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea912711-e0a0-49b0-ad9b-ee557659320b', 'volume_name': 'volume-ea912711-e0a0-49b0-ad9b-ee557659320b', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4270b9bc-5edc-4e96-93a1-9794c4ef7e4d tempest-CinderUnicodeTest-937732304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c57915a8-b130-4557-888a-9d494d00ed5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4270b9bc-5edc-4e96-93a1-9794c4ef7e4d tempest-CinderUnicodeTest-937732304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c57915a8-b130-4557-888a-9d494d00ed5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4270b9bc-5edc-4e96-93a1-9794c4ef7e4d tempest-CinderUnicodeTest-937732304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91c2a943-1f24-4df1-b59d-12f9e6551f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:27 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-4270b9bc-5edc-4e96-93a1-9794c4ef7e4d tempest-CinderUnicodeTest-937732304 None] Volume ea912711-e0a0-49b0-ad9b-ee557659320b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea912711-e0a0-49b0-ad9b-ee557659320b', 'volume_size': 1} Aug 11 04:56:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4270b9bc-5edc-4e96-93a1-9794c4ef7e4d tempest-CinderUnicodeTest-937732304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:56:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4270b9bc-5edc-4e96-93a1-9794c4ef7e4d tempest-CinderUnicodeTest-937732304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:56:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4270b9bc-5edc-4e96-93a1-9794c4ef7e4d tempest-CinderUnicodeTest-937732304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:56:27Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1098782308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea912711-e0a0-49b0-ad9b-ee557659320b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d4d6457c6d94bfbb69c4a867694d59a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:56:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:56:28Z,use_quota=True,user_id='dd3bb2555f224b658f7a8b341e4278e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:56:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-4270b9bc-5edc-4e96-93a1-9794c4ef7e4d tempest-CinderUnicodeTest-937732304 None] Creating volume ea912711-e0a0-49b0-ad9b-ee557659320b {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:56:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4270b9bc-5edc-4e96-93a1-9794c4ef7e4d tempest-CinderUnicodeTest-937732304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:56:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4270b9bc-5edc-4e96-93a1-9794c4ef7e4d tempest-CinderUnicodeTest-937732304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:56:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4270b9bc-5edc-4e96-93a1-9794c4ef7e4d tempest-CinderUnicodeTest-937732304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:56:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4270b9bc-5edc-4e96-93a1-9794c4ef7e4d tempest-CinderUnicodeTest-937732304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:56:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4270b9bc-5edc-4e96-93a1-9794c4ef7e4d tempest-CinderUnicodeTest-937732304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:56:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4270b9bc-5edc-4e96-93a1-9794c4ef7e4d tempest-CinderUnicodeTest-937732304 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:56:27 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-4270b9bc-5edc-4e96-93a1-9794c4ef7e4d tempest-CinderUnicodeTest-937732304 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:56:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4270b9bc-5edc-4e96-93a1-9794c4ef7e4d tempest-CinderUnicodeTest-937732304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ea912711-e0a0-49b0-ad9b-ee557659320b 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:27 devstack sudo[114622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ea912711-e0a0-49b0-ad9b-ee557659320b 1073741824 Aug 11 04:56:27 devstack sudo[114622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:28 devstack sudo[114622]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4270b9bc-5edc-4e96-93a1-9794c4ef7e4d tempest-CinderUnicodeTest-937732304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ea912711-e0a0-49b0-ad9b-ee557659320b 1073741824" returned: 0 in 0.407s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4270b9bc-5edc-4e96-93a1-9794c4ef7e4d tempest-CinderUnicodeTest-937732304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ea912711-e0a0-49b0-ad9b-ee557659320b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:28 devstack sudo[114627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ea912711-e0a0-49b0-ad9b-ee557659320b Aug 11 04:56:28 devstack sudo[114627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:28 devstack sudo[114627]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4270b9bc-5edc-4e96-93a1-9794c4ef7e4d tempest-CinderUnicodeTest-937732304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ea912711-e0a0-49b0-ad9b-ee557659320b" returned: 0 in 0.248s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:28 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4270b9bc-5edc-4e96-93a1-9794c4ef7e4d tempest-CinderUnicodeTest-937732304 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:56:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4270b9bc-5edc-4e96-93a1-9794c4ef7e4d tempest-CinderUnicodeTest-937732304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:56:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4270b9bc-5edc-4e96-93a1-9794c4ef7e4d tempest-CinderUnicodeTest-937732304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91c2a943-1f24-4df1-b59d-12f9e6551f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea912711-e0a0-49b0-ad9b-ee557659320b', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4270b9bc-5edc-4e96-93a1-9794c4ef7e4d tempest-CinderUnicodeTest-937732304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c223a391-0f8c-4b29-a026-dbb4d843aa5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:28 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-4270b9bc-5edc-4e96-93a1-9794c4ef7e4d tempest-CinderUnicodeTest-937732304 None] Volume volume-ea912711-e0a0-49b0-ad9b-ee557659320b (ea912711-e0a0-49b0-ad9b-ee557659320b): created successfully Aug 11 04:56:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4270b9bc-5edc-4e96-93a1-9794c4ef7e4d tempest-CinderUnicodeTest-937732304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c223a391-0f8c-4b29-a026-dbb4d843aa5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4270b9bc-5edc-4e96-93a1-9794c4ef7e4d tempest-CinderUnicodeTest-937732304 None] Flow 'volume_create_manager' (2a878456-0cf6-41ef-b6ff-dd2652031ca5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:56:28 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-4270b9bc-5edc-4e96-93a1-9794c4ef7e4d tempest-CinderUnicodeTest-937732304 None] Created volume successfully. Aug 11 04:56:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c99beca0-9a5d-4b4e-a013-6dfbfe4c507a tempest-CinderUnicodeTest-937732304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:56:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c99beca0-9a5d-4b4e-a013-6dfbfe4c507a tempest-CinderUnicodeTest-937732304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:56:28 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-c99beca0-9a5d-4b4e-a013-6dfbfe4c507a tempest-CinderUnicodeTest-937732304 None] Creating offline snapshot 56ce0594-c187-47f6-a059-524b85dfdaf1 of volume ea912711-e0a0-49b0-ad9b-ee557659320b {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 04:56:28 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec469de-6416-48d5-8e9a-dc42c69da5f4]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:56:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c99beca0-9a5d-4b4e-a013-6dfbfe4c507a tempest-CinderUnicodeTest-937732304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ea912711-e0a0-49b0-ad9b-ee557659320b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:28 devstack sudo[114630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ea912711-e0a0-49b0-ad9b-ee557659320b Aug 11 04:56:28 devstack sudo[114630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:29 devstack sudo[114630]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c99beca0-9a5d-4b4e-a013-6dfbfe4c507a tempest-CinderUnicodeTest-937732304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ea912711-e0a0-49b0-ad9b-ee557659320b" returned: 0 in 0.345s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c99beca0-9a5d-4b4e-a013-6dfbfe4c507a tempest-CinderUnicodeTest-937732304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ea912711-e0a0-49b0-ad9b-ee557659320b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ea912711-e0a0-49b0-ad9b-ee557659320b.56ce0594-c187-47f6-a059-524b85dfdaf1 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:29 devstack sudo[114635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ea912711-e0a0-49b0-ad9b-ee557659320b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ea912711-e0a0-49b0-ad9b-ee557659320b.56ce0594-c187-47f6-a059-524b85dfdaf1 1G Aug 11 04:56:29 devstack sudo[114635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:29 devstack sudo[114635]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c99beca0-9a5d-4b4e-a013-6dfbfe4c507a tempest-CinderUnicodeTest-937732304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ea912711-e0a0-49b0-ad9b-ee557659320b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ea912711-e0a0-49b0-ad9b-ee557659320b.56ce0594-c187-47f6-a059-524b85dfdaf1 1G" returned: 0 in 0.385s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c99beca0-9a5d-4b4e-a013-6dfbfe4c507a tempest-CinderUnicodeTest-937732304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea912711-e0a0-49b0-ad9b-ee557659320b -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ea912711-e0a0-49b0-ad9b-ee557659320b.56ce0594-c187-47f6-a059-524b85dfdaf1 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:29 devstack sudo[114640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea912711-e0a0-49b0-ad9b-ee557659320b -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ea912711-e0a0-49b0-ad9b-ee557659320b.56ce0594-c187-47f6-a059-524b85dfdaf1 Aug 11 04:56:29 devstack sudo[114640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:29 devstack sudo[114640]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c99beca0-9a5d-4b4e-a013-6dfbfe4c507a tempest-CinderUnicodeTest-937732304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea912711-e0a0-49b0-ad9b-ee557659320b -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ea912711-e0a0-49b0-ad9b-ee557659320b.56ce0594-c187-47f6-a059-524b85dfdaf1" returned: 0 in 0.290s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:29 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-c99beca0-9a5d-4b4e-a013-6dfbfe4c507a tempest-CinderUnicodeTest-937732304 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ea912711-e0a0-49b0-ad9b-ee557659320b.56ce0594-c187-47f6-a059-524b85dfdaf1 is being set with open permissions: ugo+rw Aug 11 04:56:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c99beca0-9a5d-4b4e-a013-6dfbfe4c507a tempest-CinderUnicodeTest-937732304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ea912711-e0a0-49b0-ad9b-ee557659320b.56ce0594-c187-47f6-a059-524b85dfdaf1 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:29 devstack sudo[114645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ea912711-e0a0-49b0-ad9b-ee557659320b.56ce0594-c187-47f6-a059-524b85dfdaf1 Aug 11 04:56:29 devstack sudo[114645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:30 devstack sudo[114645]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c99beca0-9a5d-4b4e-a013-6dfbfe4c507a tempest-CinderUnicodeTest-937732304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ea912711-e0a0-49b0-ad9b-ee557659320b.56ce0594-c187-47f6-a059-524b85dfdaf1" returned: 0 in 0.233s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c99beca0-9a5d-4b4e-a013-6dfbfe4c507a tempest-CinderUnicodeTest-937732304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ea912711-e0a0-49b0-ad9b-ee557659320b.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:30 devstack sudo[114648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ea912711-e0a0-49b0-ad9b-ee557659320b.info Aug 11 04:56:30 devstack sudo[114648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:30 devstack sudo[114648]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c99beca0-9a5d-4b4e-a013-6dfbfe4c507a tempest-CinderUnicodeTest-937732304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ea912711-e0a0-49b0-ad9b-ee557659320b.info" returned: 0 in 0.253s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:30 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-c99beca0-9a5d-4b4e-a013-6dfbfe4c507a tempest-CinderUnicodeTest-937732304 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ea912711-e0a0-49b0-ad9b-ee557659320b.info is being set with open permissions: ugo+rw Aug 11 04:56:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c99beca0-9a5d-4b4e-a013-6dfbfe4c507a tempest-CinderUnicodeTest-937732304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ea912711-e0a0-49b0-ad9b-ee557659320b.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:30 devstack sudo[114651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ea912711-e0a0-49b0-ad9b-ee557659320b.info Aug 11 04:56:30 devstack sudo[114651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:30 devstack sudo[114651]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c99beca0-9a5d-4b4e-a013-6dfbfe4c507a tempest-CinderUnicodeTest-937732304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ea912711-e0a0-49b0-ad9b-ee557659320b.info" returned: 0 in 0.240s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c99beca0-9a5d-4b4e-a013-6dfbfe4c507a tempest-CinderUnicodeTest-937732304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.828s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:56:30 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-c99beca0-9a5d-4b4e-a013-6dfbfe4c507a tempest-CinderUnicodeTest-937732304 None] Create snapshot completed successfully Aug 11 04:56:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-52e04f60-4055-4aee-82a4-dabdb8ccb5be tempest-CinderUnicodeTest-937732304 None] Acquiring lock "cinder-56ce0594-c187-47f6-a059-524b85dfdaf1-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:56:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-52e04f60-4055-4aee-82a4-dabdb8ccb5be tempest-CinderUnicodeTest-937732304 None] Lock "cinder-56ce0594-c187-47f6-a059-524b85dfdaf1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:56:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-52e04f60-4055-4aee-82a4-dabdb8ccb5be tempest-CinderUnicodeTest-937732304 None] Acquiring lock "cinder-quobyte-ea912711-e0a0-49b0-ad9b-ee557659320b" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:56:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-52e04f60-4055-4aee-82a4-dabdb8ccb5be tempest-CinderUnicodeTest-937732304 None] Lock "cinder-quobyte-ea912711-e0a0-49b0-ad9b-ee557659320b" acquired by "delete_snapshot" :: waited 0.014s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:56:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-52e04f60-4055-4aee-82a4-dabdb8ccb5be tempest-CinderUnicodeTest-937732304 None] Acquiring lock "cinder-quobyte-56ce0594-c187-47f6-a059-524b85dfdaf1" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:56:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-52e04f60-4055-4aee-82a4-dabdb8ccb5be tempest-CinderUnicodeTest-937732304 None] Lock "cinder-quobyte-56ce0594-c187-47f6-a059-524b85dfdaf1" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:56:31 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-52e04f60-4055-4aee-82a4-dabdb8ccb5be tempest-CinderUnicodeTest-937732304 None] Deleting offline snapshot 56ce0594-c187-47f6-a059-524b85dfdaf1 of volume ea912711-e0a0-49b0-ad9b-ee557659320b {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 04:56:31 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-52e04f60-4055-4aee-82a4-dabdb8ccb5be tempest-CinderUnicodeTest-937732304 None] snapshot_file for this snap is: volume-ea912711-e0a0-49b0-ad9b-ee557659320b.56ce0594-c187-47f6-a059-524b85dfdaf1 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 04:56:31 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[927b381b-2a6c-40d9-92fb-f8e1c1afd25f]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:56:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-52e04f60-4055-4aee-82a4-dabdb8ccb5be tempest-CinderUnicodeTest-937732304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ea912711-e0a0-49b0-ad9b-ee557659320b.56ce0594-c187-47f6-a059-524b85dfdaf1 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:31 devstack sudo[114654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ea912711-e0a0-49b0-ad9b-ee557659320b.56ce0594-c187-47f6-a059-524b85dfdaf1 Aug 11 04:56:31 devstack sudo[114654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:31 devstack sudo[114654]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-52e04f60-4055-4aee-82a4-dabdb8ccb5be tempest-CinderUnicodeTest-937732304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ea912711-e0a0-49b0-ad9b-ee557659320b.56ce0594-c187-47f6-a059-524b85dfdaf1" returned: 0 in 0.346s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:31 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-52e04f60-4055-4aee-82a4-dabdb8ccb5be tempest-CinderUnicodeTest-937732304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea912711-e0a0-49b0-ad9b-ee557659320b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:56:31 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70b759a-2cf7-4cd6-9f1d-e5bee8797c29]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:56:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-52e04f60-4055-4aee-82a4-dabdb8ccb5be tempest-CinderUnicodeTest-937732304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ea912711-e0a0-49b0-ad9b-ee557659320b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:31 devstack sudo[114659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ea912711-e0a0-49b0-ad9b-ee557659320b Aug 11 04:56:31 devstack sudo[114659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:31 devstack sudo[114659]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-52e04f60-4055-4aee-82a4-dabdb8ccb5be tempest-CinderUnicodeTest-937732304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ea912711-e0a0-49b0-ad9b-ee557659320b" returned: 0 in 0.347s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-52e04f60-4055-4aee-82a4-dabdb8ccb5be tempest-CinderUnicodeTest-937732304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ea912711-e0a0-49b0-ad9b-ee557659320b.56ce0594-c187-47f6-a059-524b85dfdaf1 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:31 devstack sudo[114664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ea912711-e0a0-49b0-ad9b-ee557659320b.56ce0594-c187-47f6-a059-524b85dfdaf1 Aug 11 04:56:31 devstack sudo[114664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:32 devstack sudo[114664]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-52e04f60-4055-4aee-82a4-dabdb8ccb5be tempest-CinderUnicodeTest-937732304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ea912711-e0a0-49b0-ad9b-ee557659320b.56ce0594-c187-47f6-a059-524b85dfdaf1" returned: 0 in 0.330s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-52e04f60-4055-4aee-82a4-dabdb8ccb5be tempest-CinderUnicodeTest-937732304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ea912711-e0a0-49b0-ad9b-ee557659320b.56ce0594-c187-47f6-a059-524b85dfdaf1 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:32 devstack sudo[114669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ea912711-e0a0-49b0-ad9b-ee557659320b.56ce0594-c187-47f6-a059-524b85dfdaf1 Aug 11 04:56:32 devstack sudo[114669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:32 devstack sudo[114669]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-52e04f60-4055-4aee-82a4-dabdb8ccb5be tempest-CinderUnicodeTest-937732304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ea912711-e0a0-49b0-ad9b-ee557659320b.56ce0594-c187-47f6-a059-524b85dfdaf1" returned: 0 in 0.243s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:32 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-52e04f60-4055-4aee-82a4-dabdb8ccb5be tempest-CinderUnicodeTest-937732304 None] Lock "cinder-quobyte-56ce0594-c187-47f6-a059-524b85dfdaf1" released by "_delete_snapshot" :: held 1.366s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:56:32 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-52e04f60-4055-4aee-82a4-dabdb8ccb5be tempest-CinderUnicodeTest-937732304 None] Lock "cinder-quobyte-ea912711-e0a0-49b0-ad9b-ee557659320b" released by "delete_snapshot" :: held 1.387s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:56:32 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-52e04f60-4055-4aee-82a4-dabdb8ccb5be tempest-CinderUnicodeTest-937732304 None] Created reservations ['37fe5f17-ea67-4f2d-b8b5-0d7516a98715', '76082edc-8e8f-4c0e-89be-298480ed4807', 'd6a1d626-03e2-4f72-9fcb-dde3ce0b6c6f', '01493d9f-a79b-44fe-9a8e-29e7d82b4698'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:56:32 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-52e04f60-4055-4aee-82a4-dabdb8ccb5be tempest-CinderUnicodeTest-937732304 None] Delete snapshot completed successfully. Aug 11 04:56:32 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-52e04f60-4055-4aee-82a4-dabdb8ccb5be tempest-CinderUnicodeTest-937732304 None] Lock "cinder-56ce0594-c187-47f6-a059-524b85dfdaf1-delete_snapshot" released by "delete_snapshot" :: held 1.505s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:56:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d1ff725f-193a-4b56-8199-f9848a4126ab tempest-CinderUnicodeTest-937732304 None] Acquiring lock "cinder-ea912711-e0a0-49b0-ad9b-ee557659320b-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:56:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d1ff725f-193a-4b56-8199-f9848a4126ab tempest-CinderUnicodeTest-937732304 None] Lock "cinder-ea912711-e0a0-49b0-ad9b-ee557659320b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:56:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d1ff725f-193a-4b56-8199-f9848a4126ab tempest-CinderUnicodeTest-937732304 None] Acquiring lock "cinder-quobyte-ea912711-e0a0-49b0-ad9b-ee557659320b" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:56:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d1ff725f-193a-4b56-8199-f9848a4126ab tempest-CinderUnicodeTest-937732304 None] Lock "cinder-quobyte-ea912711-e0a0-49b0-ad9b-ee557659320b" acquired by "delete_volume" :: waited 0.016s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:56:33 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78a2f22-7e19-47be-9bab-c2f2aa3104f5]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:56:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d1ff725f-193a-4b56-8199-f9848a4126ab tempest-CinderUnicodeTest-937732304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ea912711-e0a0-49b0-ad9b-ee557659320b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:33 devstack sudo[114672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ea912711-e0a0-49b0-ad9b-ee557659320b Aug 11 04:56:33 devstack sudo[114672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:33 devstack sudo[114672]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d1ff725f-193a-4b56-8199-f9848a4126ab tempest-CinderUnicodeTest-937732304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ea912711-e0a0-49b0-ad9b-ee557659320b" returned: 0 in 0.356s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d1ff725f-193a-4b56-8199-f9848a4126ab tempest-CinderUnicodeTest-937732304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ea912711-e0a0-49b0-ad9b-ee557659320b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:33 devstack sudo[114678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ea912711-e0a0-49b0-ad9b-ee557659320b Aug 11 04:56:33 devstack sudo[114678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:33 devstack sudo[114678]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d1ff725f-193a-4b56-8199-f9848a4126ab tempest-CinderUnicodeTest-937732304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-ea912711-e0a0-49b0-ad9b-ee557659320b" returned: 0 in 0.242s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d1ff725f-193a-4b56-8199-f9848a4126ab tempest-CinderUnicodeTest-937732304 None] Lock "cinder-quobyte-ea912711-e0a0-49b0-ad9b-ee557659320b" released by "delete_volume" :: held 0.650s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:56:33 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-d1ff725f-193a-4b56-8199-f9848a4126ab tempest-CinderUnicodeTest-937732304 None] Created reservations ['111fb015-35b1-4832-8327-73055fedea12', '696d24af-4d96-47e2-9616-e31c75c1f205', '545d811b-2ce9-40ce-b005-b93262f28e71', 'e9433329-d605-4083-a490-10d14af02658'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:56:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d1ff725f-193a-4b56-8199-f9848a4126ab tempest-CinderUnicodeTest-937732304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:56:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d1ff725f-193a-4b56-8199-f9848a4126ab tempest-CinderUnicodeTest-937732304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:56:33 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d1ff725f-193a-4b56-8199-f9848a4126ab tempest-CinderUnicodeTest-937732304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:56:33 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d1ff725f-193a-4b56-8199-f9848a4126ab tempest-CinderUnicodeTest-937732304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:56:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d1ff725f-193a-4b56-8199-f9848a4126ab tempest-CinderUnicodeTest-937732304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:56:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d1ff725f-193a-4b56-8199-f9848a4126ab tempest-CinderUnicodeTest-937732304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:33 devstack sudo[114681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:56:33 devstack sudo[114681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:34 devstack sudo[114681]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d1ff725f-193a-4b56-8199-f9848a4126ab tempest-CinderUnicodeTest-937732304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.233s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:34 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-d1ff725f-193a-4b56-8199-f9848a4126ab tempest-CinderUnicodeTest-937732304 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:56:34 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-d1ff725f-193a-4b56-8199-f9848a4126ab tempest-CinderUnicodeTest-937732304 None] Deleted volume successfully. Aug 11 04:56:34 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d1ff725f-193a-4b56-8199-f9848a4126ab tempest-CinderUnicodeTest-937732304 None] Lock "cinder-ea912711-e0a0-49b0-ad9b-ee557659320b-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:56:34 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-47d45ec7-b54d-429e-a914-2f22b541b519 tempest-CinderUnicodeTest-937732304 None] Acquiring lock "cinder-8196f62b-e640-4e38-b27e-5988168ae8ba-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:56:34 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-47d45ec7-b54d-429e-a914-2f22b541b519 tempest-CinderUnicodeTest-937732304 None] Lock "cinder-8196f62b-e640-4e38-b27e-5988168ae8ba-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:56:34 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-47d45ec7-b54d-429e-a914-2f22b541b519 tempest-CinderUnicodeTest-937732304 None] Acquiring lock "cinder-quobyte-8196f62b-e640-4e38-b27e-5988168ae8ba" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:56:34 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-47d45ec7-b54d-429e-a914-2f22b541b519 tempest-CinderUnicodeTest-937732304 None] Lock "cinder-quobyte-8196f62b-e640-4e38-b27e-5988168ae8ba" acquired by "delete_volume" :: waited 0.013s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:56:34 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b402650-0e6d-45ec-956a-5cdbbf5d87d2]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:56:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-47d45ec7-b54d-429e-a914-2f22b541b519 tempest-CinderUnicodeTest-937732304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8196f62b-e640-4e38-b27e-5988168ae8ba {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:34 devstack sudo[114684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8196f62b-e640-4e38-b27e-5988168ae8ba Aug 11 04:56:34 devstack sudo[114684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:34 devstack sudo[114684]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-47d45ec7-b54d-429e-a914-2f22b541b519 tempest-CinderUnicodeTest-937732304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8196f62b-e640-4e38-b27e-5988168ae8ba" returned: 0 in 0.358s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-47d45ec7-b54d-429e-a914-2f22b541b519 tempest-CinderUnicodeTest-937732304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8196f62b-e640-4e38-b27e-5988168ae8ba {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:34 devstack sudo[114689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8196f62b-e640-4e38-b27e-5988168ae8ba Aug 11 04:56:34 devstack sudo[114689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:34 devstack sudo[114689]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-47d45ec7-b54d-429e-a914-2f22b541b519 tempest-CinderUnicodeTest-937732304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-8196f62b-e640-4e38-b27e-5988168ae8ba" returned: 0 in 0.232s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:34 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-47d45ec7-b54d-429e-a914-2f22b541b519 tempest-CinderUnicodeTest-937732304 None] Lock "cinder-quobyte-8196f62b-e640-4e38-b27e-5988168ae8ba" released by "delete_volume" :: held 0.629s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:56:34 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-47d45ec7-b54d-429e-a914-2f22b541b519 tempest-CinderUnicodeTest-937732304 None] Created reservations ['bbd500fa-fc71-40ae-a587-ca6a89947d6d', '2f5bb34c-4bc2-45d1-b7bf-5d0e440af02e', '004f4b37-a90d-472c-955e-42e3cfc91689', 'ac097d56-0ce2-4989-a4e4-d917c68e5e94'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:56:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-47d45ec7-b54d-429e-a914-2f22b541b519 tempest-CinderUnicodeTest-937732304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:56:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-47d45ec7-b54d-429e-a914-2f22b541b519 tempest-CinderUnicodeTest-937732304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:56:35 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-47d45ec7-b54d-429e-a914-2f22b541b519 tempest-CinderUnicodeTest-937732304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:56:35 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-47d45ec7-b54d-429e-a914-2f22b541b519 tempest-CinderUnicodeTest-937732304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:56:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-47d45ec7-b54d-429e-a914-2f22b541b519 tempest-CinderUnicodeTest-937732304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:56:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-47d45ec7-b54d-429e-a914-2f22b541b519 tempest-CinderUnicodeTest-937732304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:35 devstack sudo[114692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:56:35 devstack sudo[114692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:35 devstack sudo[114692]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-47d45ec7-b54d-429e-a914-2f22b541b519 tempest-CinderUnicodeTest-937732304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.235s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:35 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-47d45ec7-b54d-429e-a914-2f22b541b519 tempest-CinderUnicodeTest-937732304 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:56:35 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-47d45ec7-b54d-429e-a914-2f22b541b519 tempest-CinderUnicodeTest-937732304 None] Deleted volume successfully. Aug 11 04:56:35 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-47d45ec7-b54d-429e-a914-2f22b541b519 tempest-CinderUnicodeTest-937732304 None] Lock "cinder-8196f62b-e640-4e38-b27e-5988168ae8ba-delete_volume" released by "delete_volume" :: held 1.042s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:56:38 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-623b83eb-009b-4a3e-b0dc-5e3d62e65f81 tempest-ProjectReaderTests-1360645023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:56:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-623b83eb-009b-4a3e-b0dc-5e3d62e65f81 tempest-ProjectReaderTests-1360645023 None] Flow 'volume_create_manager' (c586fd81-4140-4394-9bbe-ee793f4b7b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:56:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-623b83eb-009b-4a3e-b0dc-5e3d62e65f81 tempest-ProjectReaderTests-1360645023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e0c8bc6-aae8-449e-9ea5-a1e09f9c6eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-623b83eb-009b-4a3e-b0dc-5e3d62e65f81 tempest-ProjectReaderTests-1360645023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e0c8bc6-aae8-449e-9ea5-a1e09f9c6eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2094336433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67f2d1fa-5894-4264-a9e1-bd11e9d8c3aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aa449891bd045e88228f8fd12962093',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:56:39Z,use_quota=True,user_id='31682334042e4b3b8a5d5bf2e38f396f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-623b83eb-009b-4a3e-b0dc-5e3d62e65f81 tempest-ProjectReaderTests-1360645023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36eca5f3-c5af-4fd2-a79e-540e07015f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-623b83eb-009b-4a3e-b0dc-5e3d62e65f81 tempest-ProjectReaderTests-1360645023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36eca5f3-c5af-4fd2-a79e-540e07015f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-623b83eb-009b-4a3e-b0dc-5e3d62e65f81 tempest-ProjectReaderTests-1360645023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0153f2c2-b302-434e-abec-3ec625ef315f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-623b83eb-009b-4a3e-b0dc-5e3d62e65f81 tempest-ProjectReaderTests-1360645023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0153f2c2-b302-434e-abec-3ec625ef315f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67f2d1fa-5894-4264-a9e1-bd11e9d8c3aa', 'volume_name': 'volume-67f2d1fa-5894-4264-a9e1-bd11e9d8c3aa', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-623b83eb-009b-4a3e-b0dc-5e3d62e65f81 tempest-ProjectReaderTests-1360645023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3069783-18d1-4640-8c01-31eb1bd2093b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-623b83eb-009b-4a3e-b0dc-5e3d62e65f81 tempest-ProjectReaderTests-1360645023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3069783-18d1-4640-8c01-31eb1bd2093b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-623b83eb-009b-4a3e-b0dc-5e3d62e65f81 tempest-ProjectReaderTests-1360645023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (968830f7-c222-447b-a549-aeb52fab1a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:38 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-623b83eb-009b-4a3e-b0dc-5e3d62e65f81 tempest-ProjectReaderTests-1360645023 None] Volume 67f2d1fa-5894-4264-a9e1-bd11e9d8c3aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67f2d1fa-5894-4264-a9e1-bd11e9d8c3aa', 'volume_size': 1} Aug 11 04:56:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-623b83eb-009b-4a3e-b0dc-5e3d62e65f81 tempest-ProjectReaderTests-1360645023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:56:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-623b83eb-009b-4a3e-b0dc-5e3d62e65f81 tempest-ProjectReaderTests-1360645023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:56:38 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-623b83eb-009b-4a3e-b0dc-5e3d62e65f81 tempest-ProjectReaderTests-1360645023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2094336433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67f2d1fa-5894-4264-a9e1-bd11e9d8c3aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aa449891bd045e88228f8fd12962093',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:56:39Z,use_quota=True,user_id='31682334042e4b3b8a5d5bf2e38f396f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:56:38 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-623b83eb-009b-4a3e-b0dc-5e3d62e65f81 tempest-ProjectReaderTests-1360645023 None] Creating volume 67f2d1fa-5894-4264-a9e1-bd11e9d8c3aa {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:56:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-623b83eb-009b-4a3e-b0dc-5e3d62e65f81 tempest-ProjectReaderTests-1360645023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:56:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-623b83eb-009b-4a3e-b0dc-5e3d62e65f81 tempest-ProjectReaderTests-1360645023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:56:38 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-623b83eb-009b-4a3e-b0dc-5e3d62e65f81 tempest-ProjectReaderTests-1360645023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:56:38 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-623b83eb-009b-4a3e-b0dc-5e3d62e65f81 tempest-ProjectReaderTests-1360645023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:56:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-623b83eb-009b-4a3e-b0dc-5e3d62e65f81 tempest-ProjectReaderTests-1360645023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:56:38 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-623b83eb-009b-4a3e-b0dc-5e3d62e65f81 tempest-ProjectReaderTests-1360645023 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:56:38 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-623b83eb-009b-4a3e-b0dc-5e3d62e65f81 tempest-ProjectReaderTests-1360645023 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:56:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-623b83eb-009b-4a3e-b0dc-5e3d62e65f81 tempest-ProjectReaderTests-1360645023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-67f2d1fa-5894-4264-a9e1-bd11e9d8c3aa 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:38 devstack sudo[114696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-67f2d1fa-5894-4264-a9e1-bd11e9d8c3aa 1073741824 Aug 11 04:56:38 devstack sudo[114696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:39 devstack sudo[114696]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-623b83eb-009b-4a3e-b0dc-5e3d62e65f81 tempest-ProjectReaderTests-1360645023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-67f2d1fa-5894-4264-a9e1-bd11e9d8c3aa 1073741824" returned: 0 in 0.399s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-623b83eb-009b-4a3e-b0dc-5e3d62e65f81 tempest-ProjectReaderTests-1360645023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-67f2d1fa-5894-4264-a9e1-bd11e9d8c3aa {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:39 devstack sudo[114701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-67f2d1fa-5894-4264-a9e1-bd11e9d8c3aa Aug 11 04:56:39 devstack sudo[114701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:39 devstack sudo[114701]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-623b83eb-009b-4a3e-b0dc-5e3d62e65f81 tempest-ProjectReaderTests-1360645023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-67f2d1fa-5894-4264-a9e1-bd11e9d8c3aa" returned: 0 in 0.244s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-623b83eb-009b-4a3e-b0dc-5e3d62e65f81 tempest-ProjectReaderTests-1360645023 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:56:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-623b83eb-009b-4a3e-b0dc-5e3d62e65f81 tempest-ProjectReaderTests-1360645023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:56:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-623b83eb-009b-4a3e-b0dc-5e3d62e65f81 tempest-ProjectReaderTests-1360645023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (968830f7-c222-447b-a549-aeb52fab1a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67f2d1fa-5894-4264-a9e1-bd11e9d8c3aa', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-623b83eb-009b-4a3e-b0dc-5e3d62e65f81 tempest-ProjectReaderTests-1360645023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07afe9d7-bc57-4133-b24c-6ea955bafe3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:39 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-623b83eb-009b-4a3e-b0dc-5e3d62e65f81 tempest-ProjectReaderTests-1360645023 None] Volume volume-67f2d1fa-5894-4264-a9e1-bd11e9d8c3aa (67f2d1fa-5894-4264-a9e1-bd11e9d8c3aa): created successfully Aug 11 04:56:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-623b83eb-009b-4a3e-b0dc-5e3d62e65f81 tempest-ProjectReaderTests-1360645023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07afe9d7-bc57-4133-b24c-6ea955bafe3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-623b83eb-009b-4a3e-b0dc-5e3d62e65f81 tempest-ProjectReaderTests-1360645023 None] Flow 'volume_create_manager' (c586fd81-4140-4394-9bbe-ee793f4b7b46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:56:39 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-623b83eb-009b-4a3e-b0dc-5e3d62e65f81 tempest-ProjectReaderTests-1360645023 None] Created volume successfully. Aug 11 04:56:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9a4e0900-2421-44cc-bfa2-ef12bd756843 tempest-ProjectReaderTests-1360645023 None] Acquiring lock "cinder-67f2d1fa-5894-4264-a9e1-bd11e9d8c3aa-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:56:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9a4e0900-2421-44cc-bfa2-ef12bd756843 tempest-ProjectReaderTests-1360645023 None] Lock "cinder-67f2d1fa-5894-4264-a9e1-bd11e9d8c3aa-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:56:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9a4e0900-2421-44cc-bfa2-ef12bd756843 tempest-ProjectReaderTests-1360645023 None] Acquiring lock "cinder-quobyte-67f2d1fa-5894-4264-a9e1-bd11e9d8c3aa" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:56:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9a4e0900-2421-44cc-bfa2-ef12bd756843 tempest-ProjectReaderTests-1360645023 None] Lock "cinder-quobyte-67f2d1fa-5894-4264-a9e1-bd11e9d8c3aa" acquired by "delete_volume" :: waited 0.016s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:56:39 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ee206b-4269-4810-916a-d08f69a6f6b6]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:56:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9a4e0900-2421-44cc-bfa2-ef12bd756843 tempest-ProjectReaderTests-1360645023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-67f2d1fa-5894-4264-a9e1-bd11e9d8c3aa {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:39 devstack sudo[114705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-67f2d1fa-5894-4264-a9e1-bd11e9d8c3aa Aug 11 04:56:39 devstack sudo[114705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:40 devstack sudo[114705]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9a4e0900-2421-44cc-bfa2-ef12bd756843 tempest-ProjectReaderTests-1360645023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-67f2d1fa-5894-4264-a9e1-bd11e9d8c3aa" returned: 0 in 0.351s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9a4e0900-2421-44cc-bfa2-ef12bd756843 tempest-ProjectReaderTests-1360645023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-67f2d1fa-5894-4264-a9e1-bd11e9d8c3aa {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:40 devstack sudo[114710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-67f2d1fa-5894-4264-a9e1-bd11e9d8c3aa Aug 11 04:56:40 devstack sudo[114710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:40 devstack sudo[114710]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9a4e0900-2421-44cc-bfa2-ef12bd756843 tempest-ProjectReaderTests-1360645023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-67f2d1fa-5894-4264-a9e1-bd11e9d8c3aa" returned: 0 in 0.240s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9a4e0900-2421-44cc-bfa2-ef12bd756843 tempest-ProjectReaderTests-1360645023 None] Lock "cinder-quobyte-67f2d1fa-5894-4264-a9e1-bd11e9d8c3aa" released by "delete_volume" :: held 0.632s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:56:40 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-9a4e0900-2421-44cc-bfa2-ef12bd756843 tempest-ProjectReaderTests-1360645023 None] Created reservations ['8e17409f-8215-4dc5-ab7b-26cb53ae45b0', 'd47a2ee5-149e-461f-b152-e11760149426', '8fdaee0d-744d-477d-ac54-e65a0cd694e6', '899239a0-97e8-4746-8ec9-8658db3962fe'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:56:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9a4e0900-2421-44cc-bfa2-ef12bd756843 tempest-ProjectReaderTests-1360645023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:56:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9a4e0900-2421-44cc-bfa2-ef12bd756843 tempest-ProjectReaderTests-1360645023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:56:40 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9a4e0900-2421-44cc-bfa2-ef12bd756843 tempest-ProjectReaderTests-1360645023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:56:40 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9a4e0900-2421-44cc-bfa2-ef12bd756843 tempest-ProjectReaderTests-1360645023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:56:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9a4e0900-2421-44cc-bfa2-ef12bd756843 tempest-ProjectReaderTests-1360645023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:56:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9a4e0900-2421-44cc-bfa2-ef12bd756843 tempest-ProjectReaderTests-1360645023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:40 devstack sudo[114713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:56:40 devstack sudo[114713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:40 devstack sudo[114713]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9a4e0900-2421-44cc-bfa2-ef12bd756843 tempest-ProjectReaderTests-1360645023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.241s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:40 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-9a4e0900-2421-44cc-bfa2-ef12bd756843 tempest-ProjectReaderTests-1360645023 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:56:40 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-9a4e0900-2421-44cc-bfa2-ef12bd756843 tempest-ProjectReaderTests-1360645023 None] Deleted volume successfully. Aug 11 04:56:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9a4e0900-2421-44cc-bfa2-ef12bd756843 tempest-ProjectReaderTests-1360645023 None] Lock "cinder-67f2d1fa-5894-4264-a9e1-bd11e9d8c3aa-delete_volume" released by "delete_volume" :: held 1.059s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:56:41 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8c7cc9e-d5ee-4ba0-9452-2b7543f0fd73 tempest-ProjectReaderTests-1360645023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:56:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e8c7cc9e-d5ee-4ba0-9452-2b7543f0fd73 tempest-ProjectReaderTests-1360645023 None] Flow 'volume_create_manager' (97431d3e-54ea-4771-a753-3fafaf1d87cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:56:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e8c7cc9e-d5ee-4ba0-9452-2b7543f0fd73 tempest-ProjectReaderTests-1360645023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9077c85-8d3e-4437-a035-6c2de56968f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e8c7cc9e-d5ee-4ba0-9452-2b7543f0fd73 tempest-ProjectReaderTests-1360645023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9077c85-8d3e-4437-a035-6c2de56968f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2003534757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7c1f38d-0d01-4b35-96ee-b5b45e1957a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aa449891bd045e88228f8fd12962093',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:56:41Z,use_quota=True,user_id='31682334042e4b3b8a5d5bf2e38f396f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e8c7cc9e-d5ee-4ba0-9452-2b7543f0fd73 tempest-ProjectReaderTests-1360645023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c7b79a3-58c6-4a1c-81ef-b7619fadceda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e8c7cc9e-d5ee-4ba0-9452-2b7543f0fd73 tempest-ProjectReaderTests-1360645023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c7b79a3-58c6-4a1c-81ef-b7619fadceda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e8c7cc9e-d5ee-4ba0-9452-2b7543f0fd73 tempest-ProjectReaderTests-1360645023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8083f5c8-df61-4508-8b15-ffdc52778beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e8c7cc9e-d5ee-4ba0-9452-2b7543f0fd73 tempest-ProjectReaderTests-1360645023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8083f5c8-df61-4508-8b15-ffdc52778beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7c1f38d-0d01-4b35-96ee-b5b45e1957a9', 'volume_name': 'volume-b7c1f38d-0d01-4b35-96ee-b5b45e1957a9', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e8c7cc9e-d5ee-4ba0-9452-2b7543f0fd73 tempest-ProjectReaderTests-1360645023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (915f31b7-5e11-4a9c-bdc3-7e781570b178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e8c7cc9e-d5ee-4ba0-9452-2b7543f0fd73 tempest-ProjectReaderTests-1360645023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (915f31b7-5e11-4a9c-bdc3-7e781570b178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e8c7cc9e-d5ee-4ba0-9452-2b7543f0fd73 tempest-ProjectReaderTests-1360645023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ff6d345-d839-4957-b15a-514e8b075b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:41 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-e8c7cc9e-d5ee-4ba0-9452-2b7543f0fd73 tempest-ProjectReaderTests-1360645023 None] Volume b7c1f38d-0d01-4b35-96ee-b5b45e1957a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7c1f38d-0d01-4b35-96ee-b5b45e1957a9', 'volume_size': 1} Aug 11 04:56:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e8c7cc9e-d5ee-4ba0-9452-2b7543f0fd73 tempest-ProjectReaderTests-1360645023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:56:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e8c7cc9e-d5ee-4ba0-9452-2b7543f0fd73 tempest-ProjectReaderTests-1360645023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:56:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e8c7cc9e-d5ee-4ba0-9452-2b7543f0fd73 tempest-ProjectReaderTests-1360645023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2003534757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7c1f38d-0d01-4b35-96ee-b5b45e1957a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aa449891bd045e88228f8fd12962093',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:56:41Z,use_quota=True,user_id='31682334042e4b3b8a5d5bf2e38f396f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:56:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-e8c7cc9e-d5ee-4ba0-9452-2b7543f0fd73 tempest-ProjectReaderTests-1360645023 None] Creating volume b7c1f38d-0d01-4b35-96ee-b5b45e1957a9 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:56:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e8c7cc9e-d5ee-4ba0-9452-2b7543f0fd73 tempest-ProjectReaderTests-1360645023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:56:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e8c7cc9e-d5ee-4ba0-9452-2b7543f0fd73 tempest-ProjectReaderTests-1360645023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:56:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e8c7cc9e-d5ee-4ba0-9452-2b7543f0fd73 tempest-ProjectReaderTests-1360645023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:56:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e8c7cc9e-d5ee-4ba0-9452-2b7543f0fd73 tempest-ProjectReaderTests-1360645023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:56:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e8c7cc9e-d5ee-4ba0-9452-2b7543f0fd73 tempest-ProjectReaderTests-1360645023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:56:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e8c7cc9e-d5ee-4ba0-9452-2b7543f0fd73 tempest-ProjectReaderTests-1360645023 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:56:41 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-e8c7cc9e-d5ee-4ba0-9452-2b7543f0fd73 tempest-ProjectReaderTests-1360645023 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:56:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e8c7cc9e-d5ee-4ba0-9452-2b7543f0fd73 tempest-ProjectReaderTests-1360645023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b7c1f38d-0d01-4b35-96ee-b5b45e1957a9 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:41 devstack sudo[114716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b7c1f38d-0d01-4b35-96ee-b5b45e1957a9 1073741824 Aug 11 04:56:41 devstack sudo[114716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:41 devstack sudo[114716]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e8c7cc9e-d5ee-4ba0-9452-2b7543f0fd73 tempest-ProjectReaderTests-1360645023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b7c1f38d-0d01-4b35-96ee-b5b45e1957a9 1073741824" returned: 0 in 0.440s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e8c7cc9e-d5ee-4ba0-9452-2b7543f0fd73 tempest-ProjectReaderTests-1360645023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b7c1f38d-0d01-4b35-96ee-b5b45e1957a9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:41 devstack sudo[114721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b7c1f38d-0d01-4b35-96ee-b5b45e1957a9 Aug 11 04:56:41 devstack sudo[114721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:42 devstack sudo[114721]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e8c7cc9e-d5ee-4ba0-9452-2b7543f0fd73 tempest-ProjectReaderTests-1360645023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b7c1f38d-0d01-4b35-96ee-b5b45e1957a9" returned: 0 in 0.248s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:42 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e8c7cc9e-d5ee-4ba0-9452-2b7543f0fd73 tempest-ProjectReaderTests-1360645023 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:56:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e8c7cc9e-d5ee-4ba0-9452-2b7543f0fd73 tempest-ProjectReaderTests-1360645023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:56:42 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e8c7cc9e-d5ee-4ba0-9452-2b7543f0fd73 tempest-ProjectReaderTests-1360645023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ff6d345-d839-4957-b15a-514e8b075b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7c1f38d-0d01-4b35-96ee-b5b45e1957a9', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:42 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e8c7cc9e-d5ee-4ba0-9452-2b7543f0fd73 tempest-ProjectReaderTests-1360645023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12f5ed8b-69ad-42ee-8e51-c4b49a05b36c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:42 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-e8c7cc9e-d5ee-4ba0-9452-2b7543f0fd73 tempest-ProjectReaderTests-1360645023 None] Volume volume-b7c1f38d-0d01-4b35-96ee-b5b45e1957a9 (b7c1f38d-0d01-4b35-96ee-b5b45e1957a9): created successfully Aug 11 04:56:42 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e8c7cc9e-d5ee-4ba0-9452-2b7543f0fd73 tempest-ProjectReaderTests-1360645023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12f5ed8b-69ad-42ee-8e51-c4b49a05b36c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:42 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e8c7cc9e-d5ee-4ba0-9452-2b7543f0fd73 tempest-ProjectReaderTests-1360645023 None] Flow 'volume_create_manager' (97431d3e-54ea-4771-a753-3fafaf1d87cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:56:42 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-e8c7cc9e-d5ee-4ba0-9452-2b7543f0fd73 tempest-ProjectReaderTests-1360645023 None] Created volume successfully. Aug 11 04:56:42 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-782bbbeb-eb9f-425b-a398-3210c3700186 tempest-ProjectReaderTests-1360645023 None] Acquiring lock "cinder-b7c1f38d-0d01-4b35-96ee-b5b45e1957a9-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:56:42 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-782bbbeb-eb9f-425b-a398-3210c3700186 tempest-ProjectReaderTests-1360645023 None] Lock "cinder-b7c1f38d-0d01-4b35-96ee-b5b45e1957a9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:56:42 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-782bbbeb-eb9f-425b-a398-3210c3700186 tempest-ProjectReaderTests-1360645023 None] Acquiring lock "cinder-quobyte-b7c1f38d-0d01-4b35-96ee-b5b45e1957a9" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:56:42 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-782bbbeb-eb9f-425b-a398-3210c3700186 tempest-ProjectReaderTests-1360645023 None] Lock "cinder-quobyte-b7c1f38d-0d01-4b35-96ee-b5b45e1957a9" acquired by "delete_volume" :: waited 0.016s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:56:42 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ac5374-98e3-471b-aa0b-809bb22e47f8]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:56:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-782bbbeb-eb9f-425b-a398-3210c3700186 tempest-ProjectReaderTests-1360645023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b7c1f38d-0d01-4b35-96ee-b5b45e1957a9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:42 devstack sudo[114726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b7c1f38d-0d01-4b35-96ee-b5b45e1957a9 Aug 11 04:56:42 devstack sudo[114726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:42 devstack sudo[114726]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-782bbbeb-eb9f-425b-a398-3210c3700186 tempest-ProjectReaderTests-1360645023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b7c1f38d-0d01-4b35-96ee-b5b45e1957a9" returned: 0 in 0.356s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-782bbbeb-eb9f-425b-a398-3210c3700186 tempest-ProjectReaderTests-1360645023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b7c1f38d-0d01-4b35-96ee-b5b45e1957a9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:42 devstack sudo[114731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b7c1f38d-0d01-4b35-96ee-b5b45e1957a9 Aug 11 04:56:42 devstack sudo[114731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:43 devstack sudo[114731]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-782bbbeb-eb9f-425b-a398-3210c3700186 tempest-ProjectReaderTests-1360645023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b7c1f38d-0d01-4b35-96ee-b5b45e1957a9" returned: 0 in 0.241s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-782bbbeb-eb9f-425b-a398-3210c3700186 tempest-ProjectReaderTests-1360645023 None] Lock "cinder-quobyte-b7c1f38d-0d01-4b35-96ee-b5b45e1957a9" released by "delete_volume" :: held 0.635s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:56:43 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-782bbbeb-eb9f-425b-a398-3210c3700186 tempest-ProjectReaderTests-1360645023 None] Created reservations ['8abbb3ac-70c4-453f-91be-3332fc1fa19f', '427231ee-0861-41aa-87f9-62ca6381c9dd', 'e4bff2f1-7b8f-4de8-bb11-b241c08eac31', '71f213f7-ce16-4507-ac96-db4792150c34'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:56:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-782bbbeb-eb9f-425b-a398-3210c3700186 tempest-ProjectReaderTests-1360645023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:56:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-782bbbeb-eb9f-425b-a398-3210c3700186 tempest-ProjectReaderTests-1360645023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:56:43 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-782bbbeb-eb9f-425b-a398-3210c3700186 tempest-ProjectReaderTests-1360645023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:56:43 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-782bbbeb-eb9f-425b-a398-3210c3700186 tempest-ProjectReaderTests-1360645023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:56:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-782bbbeb-eb9f-425b-a398-3210c3700186 tempest-ProjectReaderTests-1360645023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:56:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-782bbbeb-eb9f-425b-a398-3210c3700186 tempest-ProjectReaderTests-1360645023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:43 devstack sudo[114734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:56:43 devstack sudo[114734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:43 devstack sudo[114734]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-782bbbeb-eb9f-425b-a398-3210c3700186 tempest-ProjectReaderTests-1360645023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.247s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:43 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-782bbbeb-eb9f-425b-a398-3210c3700186 tempest-ProjectReaderTests-1360645023 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:56:43 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-782bbbeb-eb9f-425b-a398-3210c3700186 tempest-ProjectReaderTests-1360645023 None] Deleted volume successfully. Aug 11 04:56:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-782bbbeb-eb9f-425b-a398-3210c3700186 tempest-ProjectReaderTests-1360645023 None] Lock "cinder-b7c1f38d-0d01-4b35-96ee-b5b45e1957a9-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:56:53 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=92,cinder:UPDATE=119,cinder:INSERT=29,cinder:DELETE=11 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:56:58 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:UPDATE=130,cinder:SELECT=85,cinder:INSERT=31,cinder:DELETE=11 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:56:58 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 04:56:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:56:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:56:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:56:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:56:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:56:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:58 devstack sudo[114775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:56:58 devstack sudo[114775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:58 devstack sudo[114775]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.354s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:56:58 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:56:58 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running periodic task VolumeManager._thread_info {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 04:56:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] thread count: 28 {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 11 04:56:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] thread info: [<_MainThread(MainThread, started 133315846115456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 11 04:56:59 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-b40440bc-42cf-4c4e-a744-6bbc4aa6fbb8 tempest-VolumeDependencyTests-568526517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:56:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b40440bc-42cf-4c4e-a744-6bbc4aa6fbb8 tempest-VolumeDependencyTests-568526517 None] Flow 'volume_create_manager' (ea2ef776-6063-4eaf-bcb4-a64ecbdcb57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:56:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b40440bc-42cf-4c4e-a744-6bbc4aa6fbb8 tempest-VolumeDependencyTests-568526517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb52167e-fd22-4ab3-ad95-26289071d07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b40440bc-42cf-4c4e-a744-6bbc4aa6fbb8 tempest-VolumeDependencyTests-568526517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb52167e-fd22-4ab3-ad95-26289071d07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1353176714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2ac593a-392e-4cfd-9b19-a0f453f56bd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b32a7da622b435fbabd319a97df673f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:56:59Z,use_quota=True,user_id='b75329ac75e44b0bb37de709ebb6112f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b40440bc-42cf-4c4e-a744-6bbc4aa6fbb8 tempest-VolumeDependencyTests-568526517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (796838b9-9f91-4e46-9814-0a219b728515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b40440bc-42cf-4c4e-a744-6bbc4aa6fbb8 tempest-VolumeDependencyTests-568526517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (796838b9-9f91-4e46-9814-0a219b728515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b40440bc-42cf-4c4e-a744-6bbc4aa6fbb8 tempest-VolumeDependencyTests-568526517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (077c57a6-c6a8-4822-b14a-be4231adea0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b40440bc-42cf-4c4e-a744-6bbc4aa6fbb8 tempest-VolumeDependencyTests-568526517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (077c57a6-c6a8-4822-b14a-be4231adea0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2ac593a-392e-4cfd-9b19-a0f453f56bd8', 'volume_name': 'volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b40440bc-42cf-4c4e-a744-6bbc4aa6fbb8 tempest-VolumeDependencyTests-568526517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (439897aa-cd1e-4dd0-8b69-eaa5ca714e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b40440bc-42cf-4c4e-a744-6bbc4aa6fbb8 tempest-VolumeDependencyTests-568526517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (439897aa-cd1e-4dd0-8b69-eaa5ca714e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b40440bc-42cf-4c4e-a744-6bbc4aa6fbb8 tempest-VolumeDependencyTests-568526517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c81764a-ec3a-4894-9254-673c3c85549f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:59 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-b40440bc-42cf-4c4e-a744-6bbc4aa6fbb8 tempest-VolumeDependencyTests-568526517 None] Volume e2ac593a-392e-4cfd-9b19-a0f453f56bd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8', 'volume_size': 1} Aug 11 04:56:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b40440bc-42cf-4c4e-a744-6bbc4aa6fbb8 tempest-VolumeDependencyTests-568526517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:56:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b40440bc-42cf-4c4e-a744-6bbc4aa6fbb8 tempest-VolumeDependencyTests-568526517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:56:59 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b40440bc-42cf-4c4e-a744-6bbc4aa6fbb8 tempest-VolumeDependencyTests-568526517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1353176714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2ac593a-392e-4cfd-9b19-a0f453f56bd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b32a7da622b435fbabd319a97df673f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:56:59Z,use_quota=True,user_id='b75329ac75e44b0bb37de709ebb6112f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:56:59 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-b40440bc-42cf-4c4e-a744-6bbc4aa6fbb8 tempest-VolumeDependencyTests-568526517 None] Creating volume e2ac593a-392e-4cfd-9b19-a0f453f56bd8 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:56:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b40440bc-42cf-4c4e-a744-6bbc4aa6fbb8 tempest-VolumeDependencyTests-568526517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:56:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b40440bc-42cf-4c4e-a744-6bbc4aa6fbb8 tempest-VolumeDependencyTests-568526517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:56:59 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b40440bc-42cf-4c4e-a744-6bbc4aa6fbb8 tempest-VolumeDependencyTests-568526517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:56:59 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b40440bc-42cf-4c4e-a744-6bbc4aa6fbb8 tempest-VolumeDependencyTests-568526517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:56:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b40440bc-42cf-4c4e-a744-6bbc4aa6fbb8 tempest-VolumeDependencyTests-568526517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:56:59 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b40440bc-42cf-4c4e-a744-6bbc4aa6fbb8 tempest-VolumeDependencyTests-568526517 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:56:59 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-b40440bc-42cf-4c4e-a744-6bbc4aa6fbb8 tempest-VolumeDependencyTests-568526517 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:56:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b40440bc-42cf-4c4e-a744-6bbc4aa6fbb8 tempest-VolumeDependencyTests-568526517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:56:59 devstack sudo[114778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8 1073741824 Aug 11 04:56:59 devstack sudo[114778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:56:59 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-94d939b3-8804-4181-b83c-8d1965edf9b0 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:56:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-94d939b3-8804-4181-b83c-8d1965edf9b0 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Flow 'volume_create_manager' (5ab3df72-b93f-44f0-80dc-f497a955dc99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:56:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-94d939b3-8804-4181-b83c-8d1965edf9b0 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6387ca9-5b3c-4332-8a05-358a9a44248a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-94d939b3-8804-4181-b83c-8d1965edf9b0 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6387ca9-5b3c-4332-8a05-358a9a44248a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1800903348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b8e487f-a551-4c3d-b224-531407eff038,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3867b395632476f8e675fc8d19c8b5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:57:00Z,use_quota=True,user_id='62c79abf9c04413bb8269f0a2703e21b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-94d939b3-8804-4181-b83c-8d1965edf9b0 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4468c40a-92cc-479a-b350-e4406f540305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-94d939b3-8804-4181-b83c-8d1965edf9b0 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4468c40a-92cc-479a-b350-e4406f540305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-94d939b3-8804-4181-b83c-8d1965edf9b0 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d454a845-cff3-4d82-a3fb-871178f7800a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-94d939b3-8804-4181-b83c-8d1965edf9b0 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d454a845-cff3-4d82-a3fb-871178f7800a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b8e487f-a551-4c3d-b224-531407eff038', 'volume_name': 'volume-4b8e487f-a551-4c3d-b224-531407eff038', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-94d939b3-8804-4181-b83c-8d1965edf9b0 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f98ea794-5cda-4437-bc21-7ba072d7980c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-94d939b3-8804-4181-b83c-8d1965edf9b0 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f98ea794-5cda-4437-bc21-7ba072d7980c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:56:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-94d939b3-8804-4181-b83c-8d1965edf9b0 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b67d67c7-d377-4cac-9b9d-950f22bb91e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:56:59 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-94d939b3-8804-4181-b83c-8d1965edf9b0 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Volume 4b8e487f-a551-4c3d-b224-531407eff038: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b8e487f-a551-4c3d-b224-531407eff038', 'volume_size': 1} Aug 11 04:56:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-94d939b3-8804-4181-b83c-8d1965edf9b0 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:56:59 devstack sudo[114778]: pam_unix(sudo:session): session closed for user root Aug 11 04:56:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b40440bc-42cf-4c4e-a744-6bbc4aa6fbb8 tempest-VolumeDependencyTests-568526517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8 1073741824" returned: 0 in 0.727s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:00 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e46da44-1460-432e-a9b7-e54f03664239 tempest-CreateVolumesFromImageTest-700369541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:57:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7e46da44-1460-432e-a9b7-e54f03664239 tempest-CreateVolumesFromImageTest-700369541 None] Flow 'volume_create_manager' (9ec330ac-0b93-41ee-bc2f-ea2d0f04cfef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:57:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7e46da44-1460-432e-a9b7-e54f03664239 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de4b737e-e381-4892-9c1d-cb91b80dbf2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b40440bc-42cf-4c4e-a744-6bbc4aa6fbb8 tempest-VolumeDependencyTests-568526517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7e46da44-1460-432e-a9b7-e54f03664239 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de4b737e-e381-4892-9c1d-cb91b80dbf2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-731175757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bd0390f-9b3c-42dc-a67c-0a60317d61df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e996ff4c83084855a45a0864431c1345',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:57:00Z,use_quota=True,user_id='9c5bbe570b204dae90c76fe64bcdff8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7e46da44-1460-432e-a9b7-e54f03664239 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6864a800-43b0-4ff7-a4d4-49eb47d39e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7e46da44-1460-432e-a9b7-e54f03664239 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6864a800-43b0-4ff7-a4d4-49eb47d39e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:00 devstack sudo[114784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8 Aug 11 04:57:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7e46da44-1460-432e-a9b7-e54f03664239 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fb6eb45-51da-4d11-bf84-988d5989a26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:00 devstack sudo[114784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7e46da44-1460-432e-a9b7-e54f03664239 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fb6eb45-51da-4d11-bf84-988d5989a26e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bd0390f-9b3c-42dc-a67c-0a60317d61df', 'volume_name': 'volume-6bd0390f-9b3c-42dc-a67c-0a60317d61df', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7e46da44-1460-432e-a9b7-e54f03664239 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a7f503e-c22b-4cfb-80d5-d217946ce4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7e46da44-1460-432e-a9b7-e54f03664239 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a7f503e-c22b-4cfb-80d5-d217946ce4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7e46da44-1460-432e-a9b7-e54f03664239 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e0540cc-4c3d-448a-9dc1-d037972eeefa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:00 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-7e46da44-1460-432e-a9b7-e54f03664239 tempest-CreateVolumesFromImageTest-700369541 None] Volume 6bd0390f-9b3c-42dc-a67c-0a60317d61df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bd0390f-9b3c-42dc-a67c-0a60317d61df', 'volume_size': 1} Aug 11 04:57:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7e46da44-1460-432e-a9b7-e54f03664239 tempest-CreateVolumesFromImageTest-700369541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:00 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-97ac0ffc-3a35-49fe-a2cd-9884a433ac31 tempest-CreateVolumesFromImageTest-700369541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:57:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-97ac0ffc-3a35-49fe-a2cd-9884a433ac31 tempest-CreateVolumesFromImageTest-700369541 None] Flow 'volume_create_manager' (eb031a46-2ef9-42ab-8067-3c857804e8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:57:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-97ac0ffc-3a35-49fe-a2cd-9884a433ac31 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c51dd41-3adb-49be-b2b4-ee62cb2cf3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-97ac0ffc-3a35-49fe-a2cd-9884a433ac31 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c51dd41-3adb-49be-b2b4-ee62cb2cf3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-859130498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b492482d-06a5-4b6e-9191-dd2b2556198e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e996ff4c83084855a45a0864431c1345',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:57:00Z,use_quota=True,user_id='9c5bbe570b204dae90c76fe64bcdff8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-97ac0ffc-3a35-49fe-a2cd-9884a433ac31 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0a36c58-dfd4-4994-8698-bd2d3a4038fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-97ac0ffc-3a35-49fe-a2cd-9884a433ac31 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0a36c58-dfd4-4994-8698-bd2d3a4038fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-97ac0ffc-3a35-49fe-a2cd-9884a433ac31 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a52efd1e-8183-4351-801f-0da0f02c8c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-97ac0ffc-3a35-49fe-a2cd-9884a433ac31 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a52efd1e-8183-4351-801f-0da0f02c8c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b492482d-06a5-4b6e-9191-dd2b2556198e', 'volume_name': 'volume-b492482d-06a5-4b6e-9191-dd2b2556198e', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-97ac0ffc-3a35-49fe-a2cd-9884a433ac31 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d2ed1c4-d846-4774-95d9-b2b32a4f8684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-97ac0ffc-3a35-49fe-a2cd-9884a433ac31 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d2ed1c4-d846-4774-95d9-b2b32a4f8684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:00 devstack sudo[114784]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-97ac0ffc-3a35-49fe-a2cd-9884a433ac31 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2547afc3-f567-46ba-96a4-30770bc4542f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:00 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-97ac0ffc-3a35-49fe-a2cd-9884a433ac31 tempest-CreateVolumesFromImageTest-700369541 None] Volume b492482d-06a5-4b6e-9191-dd2b2556198e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b492482d-06a5-4b6e-9191-dd2b2556198e', 'volume_size': 1} Aug 11 04:57:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-97ac0ffc-3a35-49fe-a2cd-9884a433ac31 tempest-CreateVolumesFromImageTest-700369541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b40440bc-42cf-4c4e-a744-6bbc4aa6fbb8 tempest-VolumeDependencyTests-568526517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8" returned: 0 in 0.408s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:00 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b40440bc-42cf-4c4e-a744-6bbc4aa6fbb8 tempest-VolumeDependencyTests-568526517 None] <== create_volume: return (1221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:57:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b40440bc-42cf-4c4e-a744-6bbc4aa6fbb8 tempest-VolumeDependencyTests-568526517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-94d939b3-8804-4181-b83c-8d1965edf9b0 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.530s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:00 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-94d939b3-8804-4181-b83c-8d1965edf9b0 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1800903348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b8e487f-a551-4c3d-b224-531407eff038,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3867b395632476f8e675fc8d19c8b5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:57:00Z,use_quota=True,user_id='62c79abf9c04413bb8269f0a2703e21b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:57:00 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-94d939b3-8804-4181-b83c-8d1965edf9b0 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Creating volume 4b8e487f-a551-4c3d-b224-531407eff038 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:57:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-94d939b3-8804-4181-b83c-8d1965edf9b0 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-94d939b3-8804-4181-b83c-8d1965edf9b0 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:00 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-94d939b3-8804-4181-b83c-8d1965edf9b0 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:57:00 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-94d939b3-8804-4181-b83c-8d1965edf9b0 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:57:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-94d939b3-8804-4181-b83c-8d1965edf9b0 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:00 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-94d939b3-8804-4181-b83c-8d1965edf9b0 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:57:00 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-94d939b3-8804-4181-b83c-8d1965edf9b0 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:57:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-94d939b3-8804-4181-b83c-8d1965edf9b0 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-4b8e487f-a551-4c3d-b224-531407eff038 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:00 devstack sudo[114787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-4b8e487f-a551-4c3d-b224-531407eff038 1073741824 Aug 11 04:57:00 devstack sudo[114787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b40440bc-42cf-4c4e-a744-6bbc4aa6fbb8 tempest-VolumeDependencyTests-568526517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c81764a-ec3a-4894-9254-673c3c85549f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b40440bc-42cf-4c4e-a744-6bbc4aa6fbb8 tempest-VolumeDependencyTests-568526517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c2a7c2f-2b06-4045-9f3a-5fb5a7baa4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:00 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-b40440bc-42cf-4c4e-a744-6bbc4aa6fbb8 tempest-VolumeDependencyTests-568526517 None] Volume volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8 (e2ac593a-392e-4cfd-9b19-a0f453f56bd8): created successfully Aug 11 04:57:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b40440bc-42cf-4c4e-a744-6bbc4aa6fbb8 tempest-VolumeDependencyTests-568526517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c2a7c2f-2b06-4045-9f3a-5fb5a7baa4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b40440bc-42cf-4c4e-a744-6bbc4aa6fbb8 tempest-VolumeDependencyTests-568526517 None] Flow 'volume_create_manager' (ea2ef776-6063-4eaf-bcb4-a64ecbdcb57e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:57:00 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-b40440bc-42cf-4c4e-a744-6bbc4aa6fbb8 tempest-VolumeDependencyTests-568526517 None] Created volume successfully. Aug 11 04:57:00 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-7844c9ae-558f-4edd-8465-e2d7c28b2307 tempest-CreateVolumesFromImageTest-700369541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:57:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7844c9ae-558f-4edd-8465-e2d7c28b2307 tempest-CreateVolumesFromImageTest-700369541 None] Flow 'volume_create_manager' (bbe40252-ad8d-4c26-b3c8-3fb28f7bfb7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:57:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7844c9ae-558f-4edd-8465-e2d7c28b2307 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d848848d-034b-49ff-a9bb-4f7f6b679173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7844c9ae-558f-4edd-8465-e2d7c28b2307 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d848848d-034b-49ff-a9bb-4f7f6b679173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1840224219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53301df6-291b-45ac-a618-fe6df2af728c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e996ff4c83084855a45a0864431c1345',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:57:01Z,use_quota=True,user_id='9c5bbe570b204dae90c76fe64bcdff8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7844c9ae-558f-4edd-8465-e2d7c28b2307 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f41331f-9baa-430a-ab77-290349ac0b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7844c9ae-558f-4edd-8465-e2d7c28b2307 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f41331f-9baa-430a-ab77-290349ac0b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7844c9ae-558f-4edd-8465-e2d7c28b2307 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b994264-1f79-43e0-b915-9f4e6ae81a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7844c9ae-558f-4edd-8465-e2d7c28b2307 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b994264-1f79-43e0-b915-9f4e6ae81a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53301df6-291b-45ac-a618-fe6df2af728c', 'volume_name': 'volume-53301df6-291b-45ac-a618-fe6df2af728c', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7844c9ae-558f-4edd-8465-e2d7c28b2307 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (264552f1-f7e2-4170-9546-e5994adb50d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7844c9ae-558f-4edd-8465-e2d7c28b2307 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (264552f1-f7e2-4170-9546-e5994adb50d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7844c9ae-558f-4edd-8465-e2d7c28b2307 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9f2d372-26e3-415f-85d4-9ec76b2224a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:00 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-7844c9ae-558f-4edd-8465-e2d7c28b2307 tempest-CreateVolumesFromImageTest-700369541 None] Volume 53301df6-291b-45ac-a618-fe6df2af728c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53301df6-291b-45ac-a618-fe6df2af728c', 'volume_size': 1} Aug 11 04:57:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7844c9ae-558f-4edd-8465-e2d7c28b2307 tempest-CreateVolumesFromImageTest-700369541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:01 devstack sudo[114787]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-94d939b3-8804-4181-b83c-8d1965edf9b0 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-4b8e487f-a551-4c3d-b224-531407eff038 1073741824" returned: 0 in 0.705s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-94d939b3-8804-4181-b83c-8d1965edf9b0 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-4b8e487f-a551-4c3d-b224-531407eff038 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:01 devstack sudo[114794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-4b8e487f-a551-4c3d-b224-531407eff038 Aug 11 04:57:01 devstack sudo[114794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:01 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fa92678-37c2-48df-b92e-1d1e3adeb2a8 tempest-CreateVolumesFromImageTest-700369541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:57:01 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9fa92678-37c2-48df-b92e-1d1e3adeb2a8 tempest-CreateVolumesFromImageTest-700369541 None] Flow 'volume_create_manager' (a9853489-2188-4790-aa7b-90dac589f5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:57:01 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9fa92678-37c2-48df-b92e-1d1e3adeb2a8 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (070608b2-c194-498b-b130-f7cf0aade6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:01 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9fa92678-37c2-48df-b92e-1d1e3adeb2a8 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (070608b2-c194-498b-b130-f7cf0aade6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-388261067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f70c9c66-80a3-4487-baa4-d2a905b400cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e996ff4c83084855a45a0864431c1345',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:57:01Z,use_quota=True,user_id='9c5bbe570b204dae90c76fe64bcdff8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:01 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9fa92678-37c2-48df-b92e-1d1e3adeb2a8 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5484b4ed-3211-47e3-b90f-034d14e4f367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:01 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9fa92678-37c2-48df-b92e-1d1e3adeb2a8 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5484b4ed-3211-47e3-b90f-034d14e4f367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:01 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9fa92678-37c2-48df-b92e-1d1e3adeb2a8 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c193946-5758-4c3a-8f66-3130e36fd4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:01 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9fa92678-37c2-48df-b92e-1d1e3adeb2a8 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c193946-5758-4c3a-8f66-3130e36fd4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f70c9c66-80a3-4487-baa4-d2a905b400cd', 'volume_name': 'volume-f70c9c66-80a3-4487-baa4-d2a905b400cd', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:01 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9fa92678-37c2-48df-b92e-1d1e3adeb2a8 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c8eac80-c0c8-48bd-aee3-2814cbfaf8fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:01 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9fa92678-37c2-48df-b92e-1d1e3adeb2a8 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c8eac80-c0c8-48bd-aee3-2814cbfaf8fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:01 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9fa92678-37c2-48df-b92e-1d1e3adeb2a8 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bc8b1eb-eb82-4d46-9d38-669ae1682858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:01 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-9fa92678-37c2-48df-b92e-1d1e3adeb2a8 tempest-CreateVolumesFromImageTest-700369541 None] Volume f70c9c66-80a3-4487-baa4-d2a905b400cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f70c9c66-80a3-4487-baa4-d2a905b400cd', 'volume_size': 1} Aug 11 04:57:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9fa92678-37c2-48df-b92e-1d1e3adeb2a8 tempest-CreateVolumesFromImageTest-700369541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:01 devstack sudo[114794]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-94d939b3-8804-4181-b83c-8d1965edf9b0 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-4b8e487f-a551-4c3d-b224-531407eff038" returned: 0 in 0.406s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:01 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-94d939b3-8804-4181-b83c-8d1965edf9b0 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:57:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-94d939b3-8804-4181-b83c-8d1965edf9b0 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7e46da44-1460-432e-a9b7-e54f03664239 tempest-CreateVolumesFromImageTest-700369541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.536s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:01 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7e46da44-1460-432e-a9b7-e54f03664239 tempest-CreateVolumesFromImageTest-700369541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-731175757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bd0390f-9b3c-42dc-a67c-0a60317d61df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e996ff4c83084855a45a0864431c1345',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:57:00Z,use_quota=True,user_id='9c5bbe570b204dae90c76fe64bcdff8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:57:01 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-7e46da44-1460-432e-a9b7-e54f03664239 tempest-CreateVolumesFromImageTest-700369541 None] Creating volume 6bd0390f-9b3c-42dc-a67c-0a60317d61df {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:57:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7e46da44-1460-432e-a9b7-e54f03664239 tempest-CreateVolumesFromImageTest-700369541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7e46da44-1460-432e-a9b7-e54f03664239 tempest-CreateVolumesFromImageTest-700369541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:01 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7e46da44-1460-432e-a9b7-e54f03664239 tempest-CreateVolumesFromImageTest-700369541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:57:01 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7e46da44-1460-432e-a9b7-e54f03664239 tempest-CreateVolumesFromImageTest-700369541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:57:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7e46da44-1460-432e-a9b7-e54f03664239 tempest-CreateVolumesFromImageTest-700369541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:01 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7e46da44-1460-432e-a9b7-e54f03664239 tempest-CreateVolumesFromImageTest-700369541 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:57:01 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-7e46da44-1460-432e-a9b7-e54f03664239 tempest-CreateVolumesFromImageTest-700369541 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:57:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7e46da44-1460-432e-a9b7-e54f03664239 tempest-CreateVolumesFromImageTest-700369541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6bd0390f-9b3c-42dc-a67c-0a60317d61df 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:01 devstack sudo[114797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6bd0390f-9b3c-42dc-a67c-0a60317d61df 1073741824 Aug 11 04:57:01 devstack sudo[114797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:01 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-94d939b3-8804-4181-b83c-8d1965edf9b0 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b67d67c7-d377-4cac-9b9d-950f22bb91e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b8e487f-a551-4c3d-b224-531407eff038', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:01 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-94d939b3-8804-4181-b83c-8d1965edf9b0 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe9bfd32-da56-40e3-8167-87ae13dea68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:01 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-94d939b3-8804-4181-b83c-8d1965edf9b0 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Volume volume-4b8e487f-a551-4c3d-b224-531407eff038 (4b8e487f-a551-4c3d-b224-531407eff038): created successfully Aug 11 04:57:01 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-94d939b3-8804-4181-b83c-8d1965edf9b0 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe9bfd32-da56-40e3-8167-87ae13dea68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:01 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-94d939b3-8804-4181-b83c-8d1965edf9b0 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Flow 'volume_create_manager' (5ab3df72-b93f-44f0-80dc-f497a955dc99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:57:01 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-542c22a1-7bfe-4a7e-b4e5-5a16dd0a0f05 tempest-CreateVolumesFromImageTest-700369541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:57:01 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-542c22a1-7bfe-4a7e-b4e5-5a16dd0a0f05 tempest-CreateVolumesFromImageTest-700369541 None] Flow 'volume_create_manager' (ec1da6a0-cac0-42ea-b3a2-08e84abbd99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:57:01 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-542c22a1-7bfe-4a7e-b4e5-5a16dd0a0f05 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50bc7020-3d95-4ba3-9ce2-9d30002fc165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:01 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-94d939b3-8804-4181-b83c-8d1965edf9b0 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Created volume successfully. Aug 11 04:57:01 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-542c22a1-7bfe-4a7e-b4e5-5a16dd0a0f05 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50bc7020-3d95-4ba3-9ce2-9d30002fc165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1026891886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72e88e40-ed60-43d3-b76a-e1a9eae2e547,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e996ff4c83084855a45a0864431c1345',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:57:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:57:02Z,use_quota=True,user_id='9c5bbe570b204dae90c76fe64bcdff8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:01 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-542c22a1-7bfe-4a7e-b4e5-5a16dd0a0f05 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bbba0a9-9ff9-4270-a593-92470caf4f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:01 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-542c22a1-7bfe-4a7e-b4e5-5a16dd0a0f05 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bbba0a9-9ff9-4270-a593-92470caf4f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:01 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-542c22a1-7bfe-4a7e-b4e5-5a16dd0a0f05 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d6ad05d-63c5-48a0-98e3-b7aa19125a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:01 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-542c22a1-7bfe-4a7e-b4e5-5a16dd0a0f05 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d6ad05d-63c5-48a0-98e3-b7aa19125a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72e88e40-ed60-43d3-b76a-e1a9eae2e547', 'volume_name': 'volume-72e88e40-ed60-43d3-b76a-e1a9eae2e547', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:01 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-542c22a1-7bfe-4a7e-b4e5-5a16dd0a0f05 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b38e3e3e-3f42-461b-84e2-49ed292885bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:01 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-542c22a1-7bfe-4a7e-b4e5-5a16dd0a0f05 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b38e3e3e-3f42-461b-84e2-49ed292885bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:01 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-542c22a1-7bfe-4a7e-b4e5-5a16dd0a0f05 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff7bdbbc-9687-48ff-98eb-da31b86bc900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:01 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-542c22a1-7bfe-4a7e-b4e5-5a16dd0a0f05 tempest-CreateVolumesFromImageTest-700369541 None] Volume 72e88e40-ed60-43d3-b76a-e1a9eae2e547: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72e88e40-ed60-43d3-b76a-e1a9eae2e547', 'volume_size': 1} Aug 11 04:57:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-542c22a1-7bfe-4a7e-b4e5-5a16dd0a0f05 tempest-CreateVolumesFromImageTest-700369541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c6681ff9-f1f9-421f-96b9-3f6022582277 tempest-VolumeDependencyTests-568526517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:02 devstack sudo[114797]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7e46da44-1460-432e-a9b7-e54f03664239 tempest-CreateVolumesFromImageTest-700369541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6bd0390f-9b3c-42dc-a67c-0a60317d61df 1073741824" returned: 0 in 0.555s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7e46da44-1460-432e-a9b7-e54f03664239 tempest-CreateVolumesFromImageTest-700369541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6bd0390f-9b3c-42dc-a67c-0a60317d61df {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:02 devstack sudo[114803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6bd0390f-9b3c-42dc-a67c-0a60317d61df Aug 11 04:57:02 devstack sudo[114803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:02 devstack sudo[114803]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7e46da44-1460-432e-a9b7-e54f03664239 tempest-CreateVolumesFromImageTest-700369541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6bd0390f-9b3c-42dc-a67c-0a60317d61df" returned: 0 in 0.266s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7e46da44-1460-432e-a9b7-e54f03664239 tempest-CreateVolumesFromImageTest-700369541 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:57:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7e46da44-1460-432e-a9b7-e54f03664239 tempest-CreateVolumesFromImageTest-700369541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-97ac0ffc-3a35-49fe-a2cd-9884a433ac31 tempest-CreateVolumesFromImageTest-700369541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.116s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-97ac0ffc-3a35-49fe-a2cd-9884a433ac31 tempest-CreateVolumesFromImageTest-700369541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-859130498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b492482d-06a5-4b6e-9191-dd2b2556198e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e996ff4c83084855a45a0864431c1345',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:57:00Z,use_quota=True,user_id='9c5bbe570b204dae90c76fe64bcdff8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:57:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-97ac0ffc-3a35-49fe-a2cd-9884a433ac31 tempest-CreateVolumesFromImageTest-700369541 None] Creating volume b492482d-06a5-4b6e-9191-dd2b2556198e {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:57:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-97ac0ffc-3a35-49fe-a2cd-9884a433ac31 tempest-CreateVolumesFromImageTest-700369541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-97ac0ffc-3a35-49fe-a2cd-9884a433ac31 tempest-CreateVolumesFromImageTest-700369541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-97ac0ffc-3a35-49fe-a2cd-9884a433ac31 tempest-CreateVolumesFromImageTest-700369541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:57:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-97ac0ffc-3a35-49fe-a2cd-9884a433ac31 tempest-CreateVolumesFromImageTest-700369541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:57:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-97ac0ffc-3a35-49fe-a2cd-9884a433ac31 tempest-CreateVolumesFromImageTest-700369541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-97ac0ffc-3a35-49fe-a2cd-9884a433ac31 tempest-CreateVolumesFromImageTest-700369541 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:57:02 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-97ac0ffc-3a35-49fe-a2cd-9884a433ac31 tempest-CreateVolumesFromImageTest-700369541 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:57:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-97ac0ffc-3a35-49fe-a2cd-9884a433ac31 tempest-CreateVolumesFromImageTest-700369541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b492482d-06a5-4b6e-9191-dd2b2556198e 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:02 devstack sudo[114806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b492482d-06a5-4b6e-9191-dd2b2556198e 1073741824 Aug 11 04:57:02 devstack sudo[114806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7e46da44-1460-432e-a9b7-e54f03664239 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e0540cc-4c3d-448a-9dc1-d037972eeefa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bd0390f-9b3c-42dc-a67c-0a60317d61df', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7e46da44-1460-432e-a9b7-e54f03664239 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (651db8c9-4a5f-425f-a33b-4a7a8af59e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:02 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-7e46da44-1460-432e-a9b7-e54f03664239 tempest-CreateVolumesFromImageTest-700369541 None] Volume volume-6bd0390f-9b3c-42dc-a67c-0a60317d61df (6bd0390f-9b3c-42dc-a67c-0a60317d61df): created successfully Aug 11 04:57:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7e46da44-1460-432e-a9b7-e54f03664239 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (651db8c9-4a5f-425f-a33b-4a7a8af59e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7e46da44-1460-432e-a9b7-e54f03664239 tempest-CreateVolumesFromImageTest-700369541 None] Flow 'volume_create_manager' (9ec330ac-0b93-41ee-bc2f-ea2d0f04cfef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:57:02 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-7e46da44-1460-432e-a9b7-e54f03664239 tempest-CreateVolumesFromImageTest-700369541 None] Created volume successfully. Aug 11 04:57:03 devstack sudo[114806]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-97ac0ffc-3a35-49fe-a2cd-9884a433ac31 tempest-CreateVolumesFromImageTest-700369541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b492482d-06a5-4b6e-9191-dd2b2556198e 1073741824" returned: 0 in 0.545s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-97ac0ffc-3a35-49fe-a2cd-9884a433ac31 tempest-CreateVolumesFromImageTest-700369541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b492482d-06a5-4b6e-9191-dd2b2556198e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:03 devstack sudo[114812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b492482d-06a5-4b6e-9191-dd2b2556198e Aug 11 04:57:03 devstack sudo[114812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:03 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-64055590-ff92-45df-ac76-06651471dca7 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:57:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-64055590-ff92-45df-ac76-06651471dca7 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Flow 'volume_create_manager' (d1f2e926-5b33-4130-9d1d-fd6ec19a1300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:57:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-64055590-ff92-45df-ac76-06651471dca7 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97983a48-4a5c-4f7f-8671-47972cdcdb17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-64055590-ff92-45df-ac76-06651471dca7 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97983a48-4a5c-4f7f-8671-47972cdcdb17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1660535852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75c00221-f835-4022-a026-eae82a4b0d12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3867b395632476f8e675fc8d19c8b5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:57:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:57:03Z,use_quota=True,user_id='62c79abf9c04413bb8269f0a2703e21b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-64055590-ff92-45df-ac76-06651471dca7 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b3ded1-79b4-4215-8806-43b84852f86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-64055590-ff92-45df-ac76-06651471dca7 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b3ded1-79b4-4215-8806-43b84852f86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-64055590-ff92-45df-ac76-06651471dca7 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29b43cdb-2974-47d7-857f-c53952daaf0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-64055590-ff92-45df-ac76-06651471dca7 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29b43cdb-2974-47d7-857f-c53952daaf0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75c00221-f835-4022-a026-eae82a4b0d12', 'volume_name': 'volume-75c00221-f835-4022-a026-eae82a4b0d12', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-64055590-ff92-45df-ac76-06651471dca7 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a45fdd8a-b4ce-4ecc-b071-b677ab674c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-64055590-ff92-45df-ac76-06651471dca7 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a45fdd8a-b4ce-4ecc-b071-b677ab674c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-64055590-ff92-45df-ac76-06651471dca7 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fd5c50c-f5ed-4098-983e-2f2aabca9d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:03 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-64055590-ff92-45df-ac76-06651471dca7 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Volume 75c00221-f835-4022-a026-eae82a4b0d12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75c00221-f835-4022-a026-eae82a4b0d12', 'volume_size': 1} Aug 11 04:57:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-64055590-ff92-45df-ac76-06651471dca7 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:03 devstack sudo[114812]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-97ac0ffc-3a35-49fe-a2cd-9884a433ac31 tempest-CreateVolumesFromImageTest-700369541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b492482d-06a5-4b6e-9191-dd2b2556198e" returned: 0 in 0.341s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:03 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-97ac0ffc-3a35-49fe-a2cd-9884a433ac31 tempest-CreateVolumesFromImageTest-700369541 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:57:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-97ac0ffc-3a35-49fe-a2cd-9884a433ac31 tempest-CreateVolumesFromImageTest-700369541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7844c9ae-558f-4edd-8465-e2d7c28b2307 tempest-CreateVolumesFromImageTest-700369541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.568s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:03 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7844c9ae-558f-4edd-8465-e2d7c28b2307 tempest-CreateVolumesFromImageTest-700369541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1840224219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53301df6-291b-45ac-a618-fe6df2af728c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e996ff4c83084855a45a0864431c1345',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:57:01Z,use_quota=True,user_id='9c5bbe570b204dae90c76fe64bcdff8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:57:03 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-7844c9ae-558f-4edd-8465-e2d7c28b2307 tempest-CreateVolumesFromImageTest-700369541 None] Creating volume 53301df6-291b-45ac-a618-fe6df2af728c {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:57:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7844c9ae-558f-4edd-8465-e2d7c28b2307 tempest-CreateVolumesFromImageTest-700369541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7844c9ae-558f-4edd-8465-e2d7c28b2307 tempest-CreateVolumesFromImageTest-700369541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:03 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7844c9ae-558f-4edd-8465-e2d7c28b2307 tempest-CreateVolumesFromImageTest-700369541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:57:03 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7844c9ae-558f-4edd-8465-e2d7c28b2307 tempest-CreateVolumesFromImageTest-700369541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:57:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7844c9ae-558f-4edd-8465-e2d7c28b2307 tempest-CreateVolumesFromImageTest-700369541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:03 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7844c9ae-558f-4edd-8465-e2d7c28b2307 tempest-CreateVolumesFromImageTest-700369541 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:57:03 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-7844c9ae-558f-4edd-8465-e2d7c28b2307 tempest-CreateVolumesFromImageTest-700369541 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:57:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7844c9ae-558f-4edd-8465-e2d7c28b2307 tempest-CreateVolumesFromImageTest-700369541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-53301df6-291b-45ac-a618-fe6df2af728c 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:03 devstack sudo[114816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-53301df6-291b-45ac-a618-fe6df2af728c 1073741824 Aug 11 04:57:03 devstack sudo[114816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-97ac0ffc-3a35-49fe-a2cd-9884a433ac31 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2547afc3-f567-46ba-96a4-30770bc4542f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b492482d-06a5-4b6e-9191-dd2b2556198e', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-97ac0ffc-3a35-49fe-a2cd-9884a433ac31 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c82e0577-62d6-4bcc-aa73-7a92ae3d7ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:03 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-97ac0ffc-3a35-49fe-a2cd-9884a433ac31 tempest-CreateVolumesFromImageTest-700369541 None] Volume volume-b492482d-06a5-4b6e-9191-dd2b2556198e (b492482d-06a5-4b6e-9191-dd2b2556198e): created successfully Aug 11 04:57:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-97ac0ffc-3a35-49fe-a2cd-9884a433ac31 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c82e0577-62d6-4bcc-aa73-7a92ae3d7ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-97ac0ffc-3a35-49fe-a2cd-9884a433ac31 tempest-CreateVolumesFromImageTest-700369541 None] Flow 'volume_create_manager' (eb031a46-2ef9-42ab-8067-3c857804e8eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:57:03 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-97ac0ffc-3a35-49fe-a2cd-9884a433ac31 tempest-CreateVolumesFromImageTest-700369541 None] Created volume successfully. Aug 11 04:57:03 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-c742c0ac-3a06-4fc9-ad68-3997731490e6 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:57:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c742c0ac-3a06-4fc9-ad68-3997731490e6 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Flow 'volume_create_manager' (ec561b45-fa9b-403a-bea8-74b2b1a0c1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:57:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c742c0ac-3a06-4fc9-ad68-3997731490e6 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9638d855-844d-4974-aa34-8f1bc9d3ed5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c742c0ac-3a06-4fc9-ad68-3997731490e6 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9638d855-844d-4974-aa34-8f1bc9d3ed5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1554986706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeacf600-e46d-4235-b49f-124bc731ca40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3867b395632476f8e675fc8d19c8b5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:57:04Z,use_quota=True,user_id='62c79abf9c04413bb8269f0a2703e21b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c742c0ac-3a06-4fc9-ad68-3997731490e6 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c82a73ae-e3b1-4092-be39-eafab5f3b272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c742c0ac-3a06-4fc9-ad68-3997731490e6 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c82a73ae-e3b1-4092-be39-eafab5f3b272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c742c0ac-3a06-4fc9-ad68-3997731490e6 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fccad3ab-864b-445a-982a-3b9fbd50bb15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c742c0ac-3a06-4fc9-ad68-3997731490e6 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fccad3ab-864b-445a-982a-3b9fbd50bb15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aeacf600-e46d-4235-b49f-124bc731ca40', 'volume_name': 'volume-aeacf600-e46d-4235-b49f-124bc731ca40', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c742c0ac-3a06-4fc9-ad68-3997731490e6 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbc8d71e-1f19-4cde-af1a-81e96e3ab60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c742c0ac-3a06-4fc9-ad68-3997731490e6 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbc8d71e-1f19-4cde-af1a-81e96e3ab60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c742c0ac-3a06-4fc9-ad68-3997731490e6 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf26a993-c756-495a-9a73-cf97dad8160e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:04 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-c742c0ac-3a06-4fc9-ad68-3997731490e6 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Volume aeacf600-e46d-4235-b49f-124bc731ca40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aeacf600-e46d-4235-b49f-124bc731ca40', 'volume_size': 1} Aug 11 04:57:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c742c0ac-3a06-4fc9-ad68-3997731490e6 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:04 devstack sudo[114816]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7844c9ae-558f-4edd-8465-e2d7c28b2307 tempest-CreateVolumesFromImageTest-700369541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-53301df6-291b-45ac-a618-fe6df2af728c 1073741824" returned: 0 in 0.654s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7844c9ae-558f-4edd-8465-e2d7c28b2307 tempest-CreateVolumesFromImageTest-700369541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-53301df6-291b-45ac-a618-fe6df2af728c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:04 devstack sudo[114822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-53301df6-291b-45ac-a618-fe6df2af728c Aug 11 04:57:04 devstack sudo[114822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:04 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9527634-bec0-4dd8-9cdc-56013624d527 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:57:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a9527634-bec0-4dd8-9cdc-56013624d527 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Flow 'volume_create_manager' (01df69eb-4cb9-4351-a3b8-7336df513881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:57:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a9527634-bec0-4dd8-9cdc-56013624d527 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebadac62-12b8-447c-8009-9581209e6624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:04 devstack sudo[114822]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a9527634-bec0-4dd8-9cdc-56013624d527 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebadac62-12b8-447c-8009-9581209e6624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:57:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-996322414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75c03aeb-1d94-4efe-b124-bd9f4cfa2c96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3867b395632476f8e675fc8d19c8b5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:57:04Z,use_quota=True,user_id='62c79abf9c04413bb8269f0a2703e21b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a9527634-bec0-4dd8-9cdc-56013624d527 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aa9baf7-f8fb-4c83-a480-afcba9ccc411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a9527634-bec0-4dd8-9cdc-56013624d527 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aa9baf7-f8fb-4c83-a480-afcba9ccc411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a9527634-bec0-4dd8-9cdc-56013624d527 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba77ed03-4f39-4cc9-9846-35734b2df524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a9527634-bec0-4dd8-9cdc-56013624d527 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba77ed03-4f39-4cc9-9846-35734b2df524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75c03aeb-1d94-4efe-b124-bd9f4cfa2c96', 'volume_name': 'volume-75c03aeb-1d94-4efe-b124-bd9f4cfa2c96', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a9527634-bec0-4dd8-9cdc-56013624d527 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (318bae2f-1f96-40b9-9050-698cdea5015e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a9527634-bec0-4dd8-9cdc-56013624d527 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (318bae2f-1f96-40b9-9050-698cdea5015e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a9527634-bec0-4dd8-9cdc-56013624d527 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa8f5492-d9ad-44ec-b8e8-77a32a168a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:04 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-a9527634-bec0-4dd8-9cdc-56013624d527 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Volume 75c03aeb-1d94-4efe-b124-bd9f4cfa2c96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75c03aeb-1d94-4efe-b124-bd9f4cfa2c96', 'volume_size': 1} Aug 11 04:57:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a9527634-bec0-4dd8-9cdc-56013624d527 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7844c9ae-558f-4edd-8465-e2d7c28b2307 tempest-CreateVolumesFromImageTest-700369541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-53301df6-291b-45ac-a618-fe6df2af728c" returned: 0 in 0.382s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:04 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7844c9ae-558f-4edd-8465-e2d7c28b2307 tempest-CreateVolumesFromImageTest-700369541 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:57:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7844c9ae-558f-4edd-8465-e2d7c28b2307 tempest-CreateVolumesFromImageTest-700369541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9fa92678-37c2-48df-b92e-1d1e3adeb2a8 tempest-CreateVolumesFromImageTest-700369541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.149s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:04 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9fa92678-37c2-48df-b92e-1d1e3adeb2a8 tempest-CreateVolumesFromImageTest-700369541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-388261067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f70c9c66-80a3-4487-baa4-d2a905b400cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e996ff4c83084855a45a0864431c1345',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:57:01Z,use_quota=True,user_id='9c5bbe570b204dae90c76fe64bcdff8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:57:04 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-9fa92678-37c2-48df-b92e-1d1e3adeb2a8 tempest-CreateVolumesFromImageTest-700369541 None] Creating volume f70c9c66-80a3-4487-baa4-d2a905b400cd {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:57:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9fa92678-37c2-48df-b92e-1d1e3adeb2a8 tempest-CreateVolumesFromImageTest-700369541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9fa92678-37c2-48df-b92e-1d1e3adeb2a8 tempest-CreateVolumesFromImageTest-700369541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:04 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9fa92678-37c2-48df-b92e-1d1e3adeb2a8 tempest-CreateVolumesFromImageTest-700369541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:57:04 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9fa92678-37c2-48df-b92e-1d1e3adeb2a8 tempest-CreateVolumesFromImageTest-700369541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:57:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9fa92678-37c2-48df-b92e-1d1e3adeb2a8 tempest-CreateVolumesFromImageTest-700369541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:04 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9fa92678-37c2-48df-b92e-1d1e3adeb2a8 tempest-CreateVolumesFromImageTest-700369541 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:57:04 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-9fa92678-37c2-48df-b92e-1d1e3adeb2a8 tempest-CreateVolumesFromImageTest-700369541 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:57:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9fa92678-37c2-48df-b92e-1d1e3adeb2a8 tempest-CreateVolumesFromImageTest-700369541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f70c9c66-80a3-4487-baa4-d2a905b400cd 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:04 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:57:04 devstack sudo[114825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f70c9c66-80a3-4487-baa4-d2a905b400cd 1073741824 Aug 11 04:57:04 devstack sudo[114825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Flow 'volume_create_manager' (e6ebd031-cb32-44ac-91ca-edf68516bee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:57:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2393092d-ebae-463b-8348-a27ec710dd56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7844c9ae-558f-4edd-8465-e2d7c28b2307 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9f2d372-26e3-415f-85d4-9ec76b2224a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53301df6-291b-45ac-a618-fe6df2af728c', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7844c9ae-558f-4edd-8465-e2d7c28b2307 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dffd7318-f651-42eb-a0c5-36abf570820e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2393092d-ebae-463b-8348-a27ec710dd56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:57:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cbdac75-a280-47cd-99aa-4bbb83f5f645,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0298ccb5e3314d9f97e92d2c3fb64a78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:57:05Z,use_quota=True,user_id='bc609e2d3f97472c90d12054225240d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2405181-3d87-4189-b9f7-ddfc4c061871),volume_type_id=b2405181-3d87-4189-b9f7-ddfc4c061871)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2a9d746-83fc-4f12-8331-46fc4821f33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2a9d746-83fc-4f12-8331-46fc4821f33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a73c1afc-3f69-4078-a47c-1597ffe7ab97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:04 devstack cinder-volume[94472]: DEBUG cinder.image.glance [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Creating Keystone auth plugin from conf {{(pid=94472) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 11 04:57:04 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-7844c9ae-558f-4edd-8465-e2d7c28b2307 tempest-CreateVolumesFromImageTest-700369541 None] Volume volume-53301df6-291b-45ac-a618-fe6df2af728c (53301df6-291b-45ac-a618-fe6df2af728c): created successfully Aug 11 04:57:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7844c9ae-558f-4edd-8465-e2d7c28b2307 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dffd7318-f651-42eb-a0c5-36abf570820e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7844c9ae-558f-4edd-8465-e2d7c28b2307 tempest-CreateVolumesFromImageTest-700369541 None] Flow 'volume_create_manager' (bbe40252-ad8d-4c26-b3c8-3fb28f7bfb7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:57:04 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-7844c9ae-558f-4edd-8465-e2d7c28b2307 tempest-CreateVolumesFromImageTest-700369541 None] Created volume successfully. Aug 11 04:57:04 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-6624e0a5-f45f-40a3-9d09-1a1a5b0b3b05 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:57:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6624e0a5-f45f-40a3-9d09-1a1a5b0b3b05 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Flow 'volume_create_manager' (ac7e1eb9-9d4b-4261-8d01-917f7f516813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:57:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6624e0a5-f45f-40a3-9d09-1a1a5b0b3b05 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6bf76b1-1633-482e-aaa3-a407ff3dcc73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6624e0a5-f45f-40a3-9d09-1a1a5b0b3b05 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6bf76b1-1633-482e-aaa3-a407ff3dcc73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:57:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1722370040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=206da10d-ab7c-403a-979d-3b8496f77039,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3867b395632476f8e675fc8d19c8b5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:57:05Z,use_quota=True,user_id='62c79abf9c04413bb8269f0a2703e21b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6624e0a5-f45f-40a3-9d09-1a1a5b0b3b05 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42a6205e-bf54-4a68-a341-981d38f42024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6624e0a5-f45f-40a3-9d09-1a1a5b0b3b05 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42a6205e-bf54-4a68-a341-981d38f42024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6624e0a5-f45f-40a3-9d09-1a1a5b0b3b05 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26325025-b10d-4f46-8095-678f1f842437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6624e0a5-f45f-40a3-9d09-1a1a5b0b3b05 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26325025-b10d-4f46-8095-678f1f842437) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '206da10d-ab7c-403a-979d-3b8496f77039', 'volume_name': 'volume-206da10d-ab7c-403a-979d-3b8496f77039', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6624e0a5-f45f-40a3-9d09-1a1a5b0b3b05 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe24ad9a-47fd-4ac9-a39e-dd09a80bad89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6624e0a5-f45f-40a3-9d09-1a1a5b0b3b05 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe24ad9a-47fd-4ac9-a39e-dd09a80bad89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6624e0a5-f45f-40a3-9d09-1a1a5b0b3b05 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56978fb8-a8c3-4168-8c55-9550070128dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:05 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-6624e0a5-f45f-40a3-9d09-1a1a5b0b3b05 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Volume 206da10d-ab7c-403a-979d-3b8496f77039: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-206da10d-ab7c-403a-979d-3b8496f77039', 'volume_size': 1} Aug 11 04:57:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6624e0a5-f45f-40a3-9d09-1a1a5b0b3b05 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:05 devstack sudo[114825]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9fa92678-37c2-48df-b92e-1d1e3adeb2a8 tempest-CreateVolumesFromImageTest-700369541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f70c9c66-80a3-4487-baa4-d2a905b400cd 1073741824" returned: 0 in 0.529s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9fa92678-37c2-48df-b92e-1d1e3adeb2a8 tempest-CreateVolumesFromImageTest-700369541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f70c9c66-80a3-4487-baa4-d2a905b400cd {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a73c1afc-3f69-4078-a47c-1597ffe7ab97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9cbdac75-a280-47cd-99aa-4bbb83f5f645', 'volume_name': 'volume-9cbdac75-a280-47cd-99aa-4bbb83f5f645', 'volume_size': 1, 'image_id': '4498f448-e9ec-41c0-9b71-e67db74999ef', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4498f448-e9ec-41c0-9b71-e67db74999ef', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6de54229af74fb106042adb4b1ef0ba1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0298ccb5e3314d9f97e92d2c3fb64a78', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9e3291edf32fffc3dea9b05b31d818b03c728b87e4f3c1933914ac3ff5fafda4e4b94f27ec3ad9eb36a18914ee5280baa12052f13475da2d905d47a72a81a978', 'id': '4498f448-e9ec-41c0-9b71-e67db74999ef', 'created_at': datetime.datetime(2026, 8, 11, 2, 57, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 2, 57, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4498f448-e9ec-41c0-9b71-e67db74999ef/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (736e47e7-9039-4d32-a745-14a3f189e1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:05 devstack sudo[114831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f70c9c66-80a3-4487-baa4-d2a905b400cd Aug 11 04:57:05 devstack sudo[114831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (736e47e7-9039-4d32-a745-14a3f189e1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86b5d9fc-fba3-4169-a613-28f5556969c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:05 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Volume 9cbdac75-a280-47cd-99aa-4bbb83f5f645: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9cbdac75-a280-47cd-99aa-4bbb83f5f645', 'volume_size': 1, 'image_id': '4498f448-e9ec-41c0-9b71-e67db74999ef', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4498f448-e9ec-41c0-9b71-e67db74999ef', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6de54229af74fb106042adb4b1ef0ba1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0298ccb5e3314d9f97e92d2c3fb64a78', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9e3291edf32fffc3dea9b05b31d818b03c728b87e4f3c1933914ac3ff5fafda4e4b94f27ec3ad9eb36a18914ee5280baa12052f13475da2d905d47a72a81a978', 'id': '4498f448-e9ec-41c0-9b71-e67db74999ef', 'created_at': datetime.datetime(2026, 8, 11, 2, 57, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 2, 57, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4498f448-e9ec-41c0-9b71-e67db74999ef/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 11 04:57:05 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Trying to clone 9cbdac75-a280-47cd-99aa-4bbb83f5f645 from image 4498f448-e9ec-41c0-9b71-e67db74999ef at location (None, [{'url': 'file:///opt/stack/data/glance/images/4498f448-e9ec-41c0-9b71-e67db74999ef', 'metadata': {}}]). {{(pid=94472) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 11 04:57:05 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-168bba0d-3742-48e1-8303-0f7473a61780 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:57:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-168bba0d-3742-48e1-8303-0f7473a61780 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Flow 'volume_create_manager' (50b85f8c-6a0f-4bd3-a38a-c6a0e1be1f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:57:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-168bba0d-3742-48e1-8303-0f7473a61780 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f98b799-aac7-44c4-be1c-ea5811c3b9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-168bba0d-3742-48e1-8303-0f7473a61780 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f98b799-aac7-44c4-be1c-ea5811c3b9e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-898447323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69dfcf99-6006-442d-8523-e344950c4db4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3867b395632476f8e675fc8d19c8b5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:57:05Z,use_quota=True,user_id='62c79abf9c04413bb8269f0a2703e21b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-168bba0d-3742-48e1-8303-0f7473a61780 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3626259f-083b-4bbe-9d95-c825e1817851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-168bba0d-3742-48e1-8303-0f7473a61780 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3626259f-083b-4bbe-9d95-c825e1817851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-168bba0d-3742-48e1-8303-0f7473a61780 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05f77f13-c658-4a3c-927b-63ad1edf1ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-168bba0d-3742-48e1-8303-0f7473a61780 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05f77f13-c658-4a3c-927b-63ad1edf1ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69dfcf99-6006-442d-8523-e344950c4db4', 'volume_name': 'volume-69dfcf99-6006-442d-8523-e344950c4db4', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-168bba0d-3742-48e1-8303-0f7473a61780 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebe7edb6-d8d7-49f1-830f-ed4751abde51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-168bba0d-3742-48e1-8303-0f7473a61780 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebe7edb6-d8d7-49f1-830f-ed4751abde51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-168bba0d-3742-48e1-8303-0f7473a61780 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33618db2-320a-4017-bfa4-4821ec3acb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:05 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-168bba0d-3742-48e1-8303-0f7473a61780 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Volume 69dfcf99-6006-442d-8523-e344950c4db4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69dfcf99-6006-442d-8523-e344950c4db4', 'volume_size': 1} Aug 11 04:57:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-168bba0d-3742-48e1-8303-0f7473a61780 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:05 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4498f448-e9ec-41c0-9b71-e67db74999ef_cy4as1q9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 11 04:57:05 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Image download 0.00 MB at 0.00 MB/s Aug 11 04:57:05 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[987e7c95-95a6-44e4-94a3-5123f92d1bb3]: (4, 'raw') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:57:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4498f448-e9ec-41c0-9b71-e67db74999ef_cy4as1q9devstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:05 devstack sudo[114831]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9fa92678-37c2-48df-b92e-1d1e3adeb2a8 tempest-CreateVolumesFromImageTest-700369541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f70c9c66-80a3-4487-baa4-d2a905b400cd" returned: 0 in 0.273s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:05 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9fa92678-37c2-48df-b92e-1d1e3adeb2a8 tempest-CreateVolumesFromImageTest-700369541 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:57:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9fa92678-37c2-48df-b92e-1d1e3adeb2a8 tempest-CreateVolumesFromImageTest-700369541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-542c22a1-7bfe-4a7e-b4e5-5a16dd0a0f05 tempest-CreateVolumesFromImageTest-700369541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.558s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:05 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-542c22a1-7bfe-4a7e-b4e5-5a16dd0a0f05 tempest-CreateVolumesFromImageTest-700369541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1026891886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72e88e40-ed60-43d3-b76a-e1a9eae2e547,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e996ff4c83084855a45a0864431c1345',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:57:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:57:02Z,use_quota=True,user_id='9c5bbe570b204dae90c76fe64bcdff8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:57:05 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-542c22a1-7bfe-4a7e-b4e5-5a16dd0a0f05 tempest-CreateVolumesFromImageTest-700369541 None] Creating volume 72e88e40-ed60-43d3-b76a-e1a9eae2e547 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:57:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-542c22a1-7bfe-4a7e-b4e5-5a16dd0a0f05 tempest-CreateVolumesFromImageTest-700369541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-542c22a1-7bfe-4a7e-b4e5-5a16dd0a0f05 tempest-CreateVolumesFromImageTest-700369541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:05 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-542c22a1-7bfe-4a7e-b4e5-5a16dd0a0f05 tempest-CreateVolumesFromImageTest-700369541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:57:05 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-542c22a1-7bfe-4a7e-b4e5-5a16dd0a0f05 tempest-CreateVolumesFromImageTest-700369541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:57:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-542c22a1-7bfe-4a7e-b4e5-5a16dd0a0f05 tempest-CreateVolumesFromImageTest-700369541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:05 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-542c22a1-7bfe-4a7e-b4e5-5a16dd0a0f05 tempest-CreateVolumesFromImageTest-700369541 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:57:05 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-542c22a1-7bfe-4a7e-b4e5-5a16dd0a0f05 tempest-CreateVolumesFromImageTest-700369541 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:57:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-542c22a1-7bfe-4a7e-b4e5-5a16dd0a0f05 tempest-CreateVolumesFromImageTest-700369541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-72e88e40-ed60-43d3-b76a-e1a9eae2e547 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:05 devstack sudo[114835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-72e88e40-ed60-43d3-b76a-e1a9eae2e547 1073741824 Aug 11 04:57:05 devstack sudo[114835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9fa92678-37c2-48df-b92e-1d1e3adeb2a8 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bc8b1eb-eb82-4d46-9d38-669ae1682858) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f70c9c66-80a3-4487-baa4-d2a905b400cd', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9fa92678-37c2-48df-b92e-1d1e3adeb2a8 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39e00f61-15cf-4410-9aa5-aae2fb09977f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:05 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-9fa92678-37c2-48df-b92e-1d1e3adeb2a8 tempest-CreateVolumesFromImageTest-700369541 None] Volume volume-f70c9c66-80a3-4487-baa4-d2a905b400cd (f70c9c66-80a3-4487-baa4-d2a905b400cd): created successfully Aug 11 04:57:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9fa92678-37c2-48df-b92e-1d1e3adeb2a8 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39e00f61-15cf-4410-9aa5-aae2fb09977f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9fa92678-37c2-48df-b92e-1d1e3adeb2a8 tempest-CreateVolumesFromImageTest-700369541 None] Flow 'volume_create_manager' (a9853489-2188-4790-aa7b-90dac589f5f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:57:05 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-9fa92678-37c2-48df-b92e-1d1e3adeb2a8 tempest-CreateVolumesFromImageTest-700369541 None] Created volume successfully. Aug 11 04:57:05 devstack sudo[114834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4498f448-e9ec-41c0-9b71-e67db74999ef_cy4as1q9devstack@QuobyteHD Aug 11 04:57:05 devstack sudo[114834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:05 devstack sudo[114834]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4498f448-e9ec-41c0-9b71-e67db74999ef_cy4as1q9devstack@QuobyteHD" returned: 0 in 0.341s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4498f448-e9ec-41c0-9b71-e67db74999ef_cy4as1q9devstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:05 devstack sudo[114843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4498f448-e9ec-41c0-9b71-e67db74999ef_cy4as1q9devstack@QuobyteHD Aug 11 04:57:05 devstack sudo[114843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:05 devstack sudo[114835]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-542c22a1-7bfe-4a7e-b4e5-5a16dd0a0f05 tempest-CreateVolumesFromImageTest-700369541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-72e88e40-ed60-43d3-b76a-e1a9eae2e547 1073741824" returned: 0 in 0.427s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-542c22a1-7bfe-4a7e-b4e5-5a16dd0a0f05 tempest-CreateVolumesFromImageTest-700369541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-72e88e40-ed60-43d3-b76a-e1a9eae2e547 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:06 devstack sudo[114845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-72e88e40-ed60-43d3-b76a-e1a9eae2e547 Aug 11 04:57:06 devstack sudo[114845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:06 devstack sudo[114843]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4498f448-e9ec-41c0-9b71-e67db74999ef_cy4as1q9devstack@QuobyteHD" returned: 1 in 0.328s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4498f448-e9ec-41c0-9b71-e67db74999ef_cy4as1q9devstack@QuobyteHD' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 11 04:57:06 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Temporary image 4498f448-e9ec-41c0-9b71-e67db74999ef is fetched for user bc609e2d3f97472c90d12054225240d1. {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 11 04:57:06 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa308a2-beeb-41c8-a45b-8c721a95d7d0]: (4, 'raw') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:57:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4498f448-e9ec-41c0-9b71-e67db74999ef_cy4as1q9devstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:06 devstack sudo[114845]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-542c22a1-7bfe-4a7e-b4e5-5a16dd0a0f05 tempest-CreateVolumesFromImageTest-700369541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-72e88e40-ed60-43d3-b76a-e1a9eae2e547" returned: 0 in 0.268s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:06 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-542c22a1-7bfe-4a7e-b4e5-5a16dd0a0f05 tempest-CreateVolumesFromImageTest-700369541 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:57:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-542c22a1-7bfe-4a7e-b4e5-5a16dd0a0f05 tempest-CreateVolumesFromImageTest-700369541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c6681ff9-f1f9-421f-96b9-3f6022582277 tempest-VolumeDependencyTests-568526517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.279s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:06 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-c6681ff9-f1f9-421f-96b9-3f6022582277 tempest-VolumeDependencyTests-568526517 None] Creating offline snapshot 4ab295a0-8281-4d8f-9870-4c64a0d1e19d of volume e2ac593a-392e-4cfd-9b19-a0f453f56bd8 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 04:57:06 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-542c22a1-7bfe-4a7e-b4e5-5a16dd0a0f05 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff7bdbbc-9687-48ff-98eb-da31b86bc900) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72e88e40-ed60-43d3-b76a-e1a9eae2e547', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:06 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-542c22a1-7bfe-4a7e-b4e5-5a16dd0a0f05 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3bf6b54-6afc-4013-8c3d-d55386a90bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:06 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[610c0843-700d-4472-990a-46b8496431db]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:57:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c6681ff9-f1f9-421f-96b9-3f6022582277 tempest-VolumeDependencyTests-568526517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:06 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-542c22a1-7bfe-4a7e-b4e5-5a16dd0a0f05 tempest-CreateVolumesFromImageTest-700369541 None] Volume volume-72e88e40-ed60-43d3-b76a-e1a9eae2e547 (72e88e40-ed60-43d3-b76a-e1a9eae2e547): created successfully Aug 11 04:57:06 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-542c22a1-7bfe-4a7e-b4e5-5a16dd0a0f05 tempest-CreateVolumesFromImageTest-700369541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3bf6b54-6afc-4013-8c3d-d55386a90bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:06 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-542c22a1-7bfe-4a7e-b4e5-5a16dd0a0f05 tempest-CreateVolumesFromImageTest-700369541 None] Flow 'volume_create_manager' (ec1da6a0-cac0-42ea-b3a2-08e84abbd99d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:57:06 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-542c22a1-7bfe-4a7e-b4e5-5a16dd0a0f05 tempest-CreateVolumesFromImageTest-700369541 None] Created volume successfully. Aug 11 04:57:06 devstack sudo[114851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4498f448-e9ec-41c0-9b71-e67db74999ef_cy4as1q9devstack@QuobyteHD Aug 11 04:57:06 devstack sudo[114851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:06 devstack sudo[114852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8 Aug 11 04:57:06 devstack sudo[114852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:06 devstack sudo[114851]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4498f448-e9ec-41c0-9b71-e67db74999ef_cy4as1q9devstack@QuobyteHD" returned: 0 in 0.330s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4498f448-e9ec-41c0-9b71-e67db74999ef_cy4as1q9devstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:06 devstack sudo[114852]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:06 devstack sudo[114857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4498f448-e9ec-41c0-9b71-e67db74999ef_cy4as1q9devstack@QuobyteHD Aug 11 04:57:06 devstack sudo[114857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c6681ff9-f1f9-421f-96b9-3f6022582277 tempest-VolumeDependencyTests-568526517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8" returned: 0 in 0.397s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c6681ff9-f1f9-421f-96b9-3f6022582277 tempest-VolumeDependencyTests-568526517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8.4ab295a0-8281-4d8f-9870-4c64a0d1e19d 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:06 devstack sudo[114862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8.4ab295a0-8281-4d8f-9870-4c64a0d1e19d 1G Aug 11 04:57:06 devstack sudo[114862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:06 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-85bd0e06-766a-46a6-ae6c-e0c5e09a289c tempest-CreateVolumesFromImageTest-700369541 None] Acquiring lock "cinder-72e88e40-ed60-43d3-b76a-e1a9eae2e547-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:06 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-85bd0e06-766a-46a6-ae6c-e0c5e09a289c tempest-CreateVolumesFromImageTest-700369541 None] Lock "cinder-72e88e40-ed60-43d3-b76a-e1a9eae2e547-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:06 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-85bd0e06-766a-46a6-ae6c-e0c5e09a289c tempest-CreateVolumesFromImageTest-700369541 None] Acquiring lock "cinder-quobyte-72e88e40-ed60-43d3-b76a-e1a9eae2e547" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:06 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-85bd0e06-766a-46a6-ae6c-e0c5e09a289c tempest-CreateVolumesFromImageTest-700369541 None] Lock "cinder-quobyte-72e88e40-ed60-43d3-b76a-e1a9eae2e547" acquired by "delete_volume" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:06 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4bdf98c-564b-47e8-bfe7-29478c7e4962]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:57:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-85bd0e06-766a-46a6-ae6c-e0c5e09a289c tempest-CreateVolumesFromImageTest-700369541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-72e88e40-ed60-43d3-b76a-e1a9eae2e547 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:06 devstack sudo[114857]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4498f448-e9ec-41c0-9b71-e67db74999ef_cy4as1q9devstack@QuobyteHD" returned: 1 in 0.360s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4498f448-e9ec-41c0-9b71-e67db74999ef_cy4as1q9devstack@QuobyteHD' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 11 04:57:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:06 devstack sudo[114864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-72e88e40-ed60-43d3-b76a-e1a9eae2e547 Aug 11 04:57:06 devstack sudo[114864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:07 devstack sudo[114862]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c6681ff9-f1f9-421f-96b9-3f6022582277 tempest-VolumeDependencyTests-568526517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8.4ab295a0-8281-4d8f-9870-4c64a0d1e19d 1G" returned: 0 in 0.408s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c6681ff9-f1f9-421f-96b9-3f6022582277 tempest-VolumeDependencyTests-568526517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8.4ab295a0-8281-4d8f-9870-4c64a0d1e19d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:07 devstack sudo[114873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8.4ab295a0-8281-4d8f-9870-4c64a0d1e19d Aug 11 04:57:07 devstack sudo[114873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:07 devstack sudo[114864]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-85bd0e06-766a-46a6-ae6c-e0c5e09a289c tempest-CreateVolumesFromImageTest-700369541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-72e88e40-ed60-43d3-b76a-e1a9eae2e547" returned: 0 in 0.359s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-85bd0e06-766a-46a6-ae6c-e0c5e09a289c tempest-CreateVolumesFromImageTest-700369541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-72e88e40-ed60-43d3-b76a-e1a9eae2e547 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:07 devstack sudo[114878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-72e88e40-ed60-43d3-b76a-e1a9eae2e547 Aug 11 04:57:07 devstack sudo[114878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:07 devstack sudo[114873]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c6681ff9-f1f9-421f-96b9-3f6022582277 tempest-VolumeDependencyTests-568526517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8.4ab295a0-8281-4d8f-9870-4c64a0d1e19d" returned: 0 in 0.306s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:07 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-c6681ff9-f1f9-421f-96b9-3f6022582277 tempest-VolumeDependencyTests-568526517 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8.4ab295a0-8281-4d8f-9870-4c64a0d1e19d is being set with open permissions: ugo+rw Aug 11 04:57:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c6681ff9-f1f9-421f-96b9-3f6022582277 tempest-VolumeDependencyTests-568526517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8.4ab295a0-8281-4d8f-9870-4c64a0d1e19d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:07 devstack sudo[114883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8.4ab295a0-8281-4d8f-9870-4c64a0d1e19d Aug 11 04:57:07 devstack sudo[114883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:07 devstack sudo[114878]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-85bd0e06-766a-46a6-ae6c-e0c5e09a289c tempest-CreateVolumesFromImageTest-700369541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-72e88e40-ed60-43d3-b76a-e1a9eae2e547" returned: 0 in 0.267s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:07 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-85bd0e06-766a-46a6-ae6c-e0c5e09a289c tempest-CreateVolumesFromImageTest-700369541 None] Lock "cinder-quobyte-72e88e40-ed60-43d3-b76a-e1a9eae2e547" released by "delete_volume" :: held 0.678s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:07 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-85bd0e06-766a-46a6-ae6c-e0c5e09a289c tempest-CreateVolumesFromImageTest-700369541 None] Created reservations ['23910c13-e144-4604-b671-3f78a5aed978', 'b3060f69-8d31-4e2e-8fa3-b03b291bb6ca', 'a741368e-504b-4d2e-8665-a83e9e62dfdb', '90be60aa-e6c8-4c5c-b42b-a40c83b212af'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:57:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-85bd0e06-766a-46a6-ae6c-e0c5e09a289c tempest-CreateVolumesFromImageTest-700369541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-85bd0e06-766a-46a6-ae6c-e0c5e09a289c tempest-CreateVolumesFromImageTest-700369541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:07 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-85bd0e06-766a-46a6-ae6c-e0c5e09a289c tempest-CreateVolumesFromImageTest-700369541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:57:07 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-85bd0e06-766a-46a6-ae6c-e0c5e09a289c tempest-CreateVolumesFromImageTest-700369541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:57:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-85bd0e06-766a-46a6-ae6c-e0c5e09a289c tempest-CreateVolumesFromImageTest-700369541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-85bd0e06-766a-46a6-ae6c-e0c5e09a289c tempest-CreateVolumesFromImageTest-700369541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:07 devstack sudo[114883]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c6681ff9-f1f9-421f-96b9-3f6022582277 tempest-VolumeDependencyTests-568526517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8.4ab295a0-8281-4d8f-9870-4c64a0d1e19d" returned: 0 in 0.242s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:07 devstack sudo[114887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:57:07 devstack sudo[114887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c6681ff9-f1f9-421f-96b9-3f6022582277 tempest-VolumeDependencyTests-568526517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:07 devstack sudo[114889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8.info Aug 11 04:57:07 devstack sudo[114889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:07 devstack sudo[114887]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-85bd0e06-766a-46a6-ae6c-e0c5e09a289c tempest-CreateVolumesFromImageTest-700369541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.268s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:07 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-85bd0e06-766a-46a6-ae6c-e0c5e09a289c tempest-CreateVolumesFromImageTest-700369541 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:57:07 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-85bd0e06-766a-46a6-ae6c-e0c5e09a289c tempest-CreateVolumesFromImageTest-700369541 None] Deleted volume successfully. Aug 11 04:57:07 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a9c13303-1478-4e12-b213-a32e01471034 tempest-CreateVolumesFromImageTest-700369541 None] Acquiring lock "cinder-f70c9c66-80a3-4487-baa4-d2a905b400cd-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:07 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-85bd0e06-766a-46a6-ae6c-e0c5e09a289c tempest-CreateVolumesFromImageTest-700369541 None] Lock "cinder-72e88e40-ed60-43d3-b76a-e1a9eae2e547-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:07 devstack sudo[114889]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:07 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a9c13303-1478-4e12-b213-a32e01471034 tempest-CreateVolumesFromImageTest-700369541 None] Lock "cinder-f70c9c66-80a3-4487-baa4-d2a905b400cd-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c6681ff9-f1f9-421f-96b9-3f6022582277 tempest-VolumeDependencyTests-568526517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8.info" returned: 0 in 0.281s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:07 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-c6681ff9-f1f9-421f-96b9-3f6022582277 tempest-VolumeDependencyTests-568526517 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8.info is being set with open permissions: ugo+rw Aug 11 04:57:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c6681ff9-f1f9-421f-96b9-3f6022582277 tempest-VolumeDependencyTests-568526517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:08 devstack sudo[114893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8.info Aug 11 04:57:08 devstack sudo[114893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:08 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a9c13303-1478-4e12-b213-a32e01471034 tempest-CreateVolumesFromImageTest-700369541 None] Acquiring lock "cinder-quobyte-f70c9c66-80a3-4487-baa4-d2a905b400cd" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:08 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a9c13303-1478-4e12-b213-a32e01471034 tempest-CreateVolumesFromImageTest-700369541 None] Lock "cinder-quobyte-f70c9c66-80a3-4487-baa4-d2a905b400cd" acquired by "delete_volume" :: waited 0.015s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:08 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[5594fda7-904c-4044-8b79-9252823c36e4]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:57:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a9c13303-1478-4e12-b213-a32e01471034 tempest-CreateVolumesFromImageTest-700369541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f70c9c66-80a3-4487-baa4-d2a905b400cd {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:08 devstack sudo[114895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f70c9c66-80a3-4487-baa4-d2a905b400cd Aug 11 04:57:08 devstack sudo[114895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:08 devstack sudo[114893]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c6681ff9-f1f9-421f-96b9-3f6022582277 tempest-VolumeDependencyTests-568526517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8.info" returned: 0 in 0.244s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c6681ff9-f1f9-421f-96b9-3f6022582277 tempest-VolumeDependencyTests-568526517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.976s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-64055590-ff92-45df-ac76-06651471dca7 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.777s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:08 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-64055590-ff92-45df-ac76-06651471dca7 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1660535852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75c00221-f835-4022-a026-eae82a4b0d12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3867b395632476f8e675fc8d19c8b5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:57:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:57:03Z,use_quota=True,user_id='62c79abf9c04413bb8269f0a2703e21b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:57:08 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-64055590-ff92-45df-ac76-06651471dca7 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Creating volume 75c00221-f835-4022-a026-eae82a4b0d12 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:57:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-64055590-ff92-45df-ac76-06651471dca7 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-64055590-ff92-45df-ac76-06651471dca7 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:08 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-64055590-ff92-45df-ac76-06651471dca7 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:57:08 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-64055590-ff92-45df-ac76-06651471dca7 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:57:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-64055590-ff92-45df-ac76-06651471dca7 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:08 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-64055590-ff92-45df-ac76-06651471dca7 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:57:08 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-64055590-ff92-45df-ac76-06651471dca7 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:57:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-64055590-ff92-45df-ac76-06651471dca7 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-75c00221-f835-4022-a026-eae82a4b0d12 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:08 devstack sudo[114898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-75c00221-f835-4022-a026-eae82a4b0d12 1073741824 Aug 11 04:57:08 devstack sudo[114898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:08 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-c6681ff9-f1f9-421f-96b9-3f6022582277 tempest-VolumeDependencyTests-568526517 None] Create snapshot completed successfully Aug 11 04:57:08 devstack sudo[114895]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a9c13303-1478-4e12-b213-a32e01471034 tempest-CreateVolumesFromImageTest-700369541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f70c9c66-80a3-4487-baa4-d2a905b400cd" returned: 0 in 0.405s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a9c13303-1478-4e12-b213-a32e01471034 tempest-CreateVolumesFromImageTest-700369541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f70c9c66-80a3-4487-baa4-d2a905b400cd {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:08 devstack sudo[114903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f70c9c66-80a3-4487-baa4-d2a905b400cd Aug 11 04:57:08 devstack sudo[114903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:08 devstack sudo[114903]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a9c13303-1478-4e12-b213-a32e01471034 tempest-CreateVolumesFromImageTest-700369541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f70c9c66-80a3-4487-baa4-d2a905b400cd" returned: 0 in 0.277s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:08 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a9c13303-1478-4e12-b213-a32e01471034 tempest-CreateVolumesFromImageTest-700369541 None] Lock "cinder-quobyte-f70c9c66-80a3-4487-baa4-d2a905b400cd" released by "delete_volume" :: held 0.723s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:08 devstack sudo[114898]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-64055590-ff92-45df-ac76-06651471dca7 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-75c00221-f835-4022-a026-eae82a4b0d12 1073741824" returned: 0 in 0.512s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-64055590-ff92-45df-ac76-06651471dca7 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-75c00221-f835-4022-a026-eae82a4b0d12 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:08 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-a9c13303-1478-4e12-b213-a32e01471034 tempest-CreateVolumesFromImageTest-700369541 None] Created reservations ['19f155bc-c5a0-4413-b700-1eff33a72bc8', 'da4c6316-8074-4f09-ab67-8a7d38a60cf9', 'e4d1e9a8-1029-434d-851d-e4c005796e4d', 'bee8bb22-a037-44eb-9929-b6a80bb293b4'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:57:08 devstack sudo[114910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-75c00221-f835-4022-a026-eae82a4b0d12 Aug 11 04:57:08 devstack sudo[114910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a9c13303-1478-4e12-b213-a32e01471034 tempest-CreateVolumesFromImageTest-700369541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a9c13303-1478-4e12-b213-a32e01471034 tempest-CreateVolumesFromImageTest-700369541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:08 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a9c13303-1478-4e12-b213-a32e01471034 tempest-CreateVolumesFromImageTest-700369541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:57:08 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a9c13303-1478-4e12-b213-a32e01471034 tempest-CreateVolumesFromImageTest-700369541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:57:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a9c13303-1478-4e12-b213-a32e01471034 tempest-CreateVolumesFromImageTest-700369541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a9c13303-1478-4e12-b213-a32e01471034 tempest-CreateVolumesFromImageTest-700369541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:08 devstack sudo[114912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:57:08 devstack sudo[114912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:08 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-4853c0be-ce64-4786-a0c9-6f477ab37206 tempest-VolumeDependencyTests-568526517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:57:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4853c0be-ce64-4786-a0c9-6f477ab37206 tempest-VolumeDependencyTests-568526517 None] Flow 'volume_create_manager' (79beef54-3413-4b43-9209-63b013378c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:57:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4853c0be-ce64-4786-a0c9-6f477ab37206 tempest-VolumeDependencyTests-568526517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b6b5cbb-6996-442e-81eb-a83bc7ae7a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4853c0be-ce64-4786-a0c9-6f477ab37206 tempest-VolumeDependencyTests-568526517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b6b5cbb-6996-442e-81eb-a83bc7ae7a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:57:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1242712267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=248edb84-4873-4da4-9da5-423dd3c8b493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b32a7da622b435fbabd319a97df673f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:57:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4ab295a0-8281-4d8f-9870-4c64a0d1e19d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:57:09Z,use_quota=True,user_id='b75329ac75e44b0bb37de709ebb6112f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4853c0be-ce64-4786-a0c9-6f477ab37206 tempest-VolumeDependencyTests-568526517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ab90696-8e01-4284-9737-34de392e0b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4853c0be-ce64-4786-a0c9-6f477ab37206 tempest-VolumeDependencyTests-568526517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ab90696-8e01-4284-9737-34de392e0b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4853c0be-ce64-4786-a0c9-6f477ab37206 tempest-VolumeDependencyTests-568526517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b77c606-6a93-4c1f-a938-a5a693f45691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4853c0be-ce64-4786-a0c9-6f477ab37206 tempest-VolumeDependencyTests-568526517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b77c606-6a93-4c1f-a938-a5a693f45691) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '248edb84-4873-4da4-9da5-423dd3c8b493', 'volume_name': 'volume-248edb84-4873-4da4-9da5-423dd3c8b493', 'volume_size': 1, 'snapshot_id': '4ab295a0-8281-4d8f-9870-4c64a0d1e19d'}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4853c0be-ce64-4786-a0c9-6f477ab37206 tempest-VolumeDependencyTests-568526517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b343a8ac-1997-4740-bc30-bdf916879a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:09 devstack sudo[114910]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4853c0be-ce64-4786-a0c9-6f477ab37206 tempest-VolumeDependencyTests-568526517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b343a8ac-1997-4740-bc30-bdf916879a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4853c0be-ce64-4786-a0c9-6f477ab37206 tempest-VolumeDependencyTests-568526517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5f260b0-5ba2-4809-8af9-a2049c10e7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:09 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-4853c0be-ce64-4786-a0c9-6f477ab37206 tempest-VolumeDependencyTests-568526517 None] Volume 248edb84-4873-4da4-9da5-423dd3c8b493: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-248edb84-4873-4da4-9da5-423dd3c8b493', 'volume_size': 1, 'snapshot_id': '4ab295a0-8281-4d8f-9870-4c64a0d1e19d'} Aug 11 04:57:09 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1daf64dd-207a-45d2-b940-da4c5b8a93be tempest-CreateVolumesFromImageTest-700369541 None] Acquiring lock "cinder-53301df6-291b-45ac-a618-fe6df2af728c-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-64055590-ff92-45df-ac76-06651471dca7 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-75c00221-f835-4022-a026-eae82a4b0d12" returned: 0 in 0.330s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-64055590-ff92-45df-ac76-06651471dca7 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:57:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-64055590-ff92-45df-ac76-06651471dca7 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c742c0ac-3a06-4fc9-ad68-3997731490e6 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.093s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c742c0ac-3a06-4fc9-ad68-3997731490e6 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1554986706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeacf600-e46d-4235-b49f-124bc731ca40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3867b395632476f8e675fc8d19c8b5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:57:04Z,use_quota=True,user_id='62c79abf9c04413bb8269f0a2703e21b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:57:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-c742c0ac-3a06-4fc9-ad68-3997731490e6 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Creating volume aeacf600-e46d-4235-b49f-124bc731ca40 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:57:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c742c0ac-3a06-4fc9-ad68-3997731490e6 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c742c0ac-3a06-4fc9-ad68-3997731490e6 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c742c0ac-3a06-4fc9-ad68-3997731490e6 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:57:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c742c0ac-3a06-4fc9-ad68-3997731490e6 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:57:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c742c0ac-3a06-4fc9-ad68-3997731490e6 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c742c0ac-3a06-4fc9-ad68-3997731490e6 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:57:09 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-c742c0ac-3a06-4fc9-ad68-3997731490e6 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:57:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c742c0ac-3a06-4fc9-ad68-3997731490e6 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-aeacf600-e46d-4235-b49f-124bc731ca40 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4853c0be-ce64-4786-a0c9-6f477ab37206 tempest-VolumeDependencyTests-568526517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:09 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1daf64dd-207a-45d2-b940-da4c5b8a93be tempest-CreateVolumesFromImageTest-700369541 None] Lock "cinder-53301df6-291b-45ac-a618-fe6df2af728c-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:09 devstack sudo[114916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-aeacf600-e46d-4235-b49f-124bc731ca40 1073741824 Aug 11 04:57:09 devstack sudo[114916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-64055590-ff92-45df-ac76-06651471dca7 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fd5c50c-f5ed-4098-983e-2f2aabca9d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75c00221-f835-4022-a026-eae82a4b0d12', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-64055590-ff92-45df-ac76-06651471dca7 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d36c08c3-aba4-432d-bff0-85d29ec65069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:09 devstack sudo[114912]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a9c13303-1478-4e12-b213-a32e01471034 tempest-CreateVolumesFromImageTest-700369541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.312s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:09 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-a9c13303-1478-4e12-b213-a32e01471034 tempest-CreateVolumesFromImageTest-700369541 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:57:09 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-a9c13303-1478-4e12-b213-a32e01471034 tempest-CreateVolumesFromImageTest-700369541 None] Deleted volume successfully. Aug 11 04:57:09 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-64055590-ff92-45df-ac76-06651471dca7 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Volume volume-75c00221-f835-4022-a026-eae82a4b0d12 (75c00221-f835-4022-a026-eae82a4b0d12): created successfully Aug 11 04:57:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-64055590-ff92-45df-ac76-06651471dca7 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d36c08c3-aba4-432d-bff0-85d29ec65069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-64055590-ff92-45df-ac76-06651471dca7 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Flow 'volume_create_manager' (d1f2e926-5b33-4130-9d1d-fd6ec19a1300) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:57:09 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-64055590-ff92-45df-ac76-06651471dca7 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Created volume successfully. Aug 11 04:57:09 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1daf64dd-207a-45d2-b940-da4c5b8a93be tempest-CreateVolumesFromImageTest-700369541 None] Acquiring lock "cinder-quobyte-53301df6-291b-45ac-a618-fe6df2af728c" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:09 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a9c13303-1478-4e12-b213-a32e01471034 tempest-CreateVolumesFromImageTest-700369541 None] Lock "cinder-f70c9c66-80a3-4487-baa4-d2a905b400cd-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:09 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1daf64dd-207a-45d2-b940-da4c5b8a93be tempest-CreateVolumesFromImageTest-700369541 None] Lock "cinder-quobyte-53301df6-291b-45ac-a618-fe6df2af728c" acquired by "delete_volume" :: waited 0.022s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:09 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[94fc5cb9-0fae-460a-89cf-c498b83c3b5a]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:57:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1daf64dd-207a-45d2-b940-da4c5b8a93be tempest-CreateVolumesFromImageTest-700369541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-53301df6-291b-45ac-a618-fe6df2af728c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:09 devstack sudo[114918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-53301df6-291b-45ac-a618-fe6df2af728c Aug 11 04:57:09 devstack sudo[114918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:09 devstack sudo[114916]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c742c0ac-3a06-4fc9-ad68-3997731490e6 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-aeacf600-e46d-4235-b49f-124bc731ca40 1073741824" returned: 0 in 0.482s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c742c0ac-3a06-4fc9-ad68-3997731490e6 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-aeacf600-e46d-4235-b49f-124bc731ca40 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:09 devstack sudo[114918]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1daf64dd-207a-45d2-b940-da4c5b8a93be tempest-CreateVolumesFromImageTest-700369541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-53301df6-291b-45ac-a618-fe6df2af728c" returned: 0 in 0.406s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1daf64dd-207a-45d2-b940-da4c5b8a93be tempest-CreateVolumesFromImageTest-700369541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-53301df6-291b-45ac-a618-fe6df2af728c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:09 devstack sudo[114927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-aeacf600-e46d-4235-b49f-124bc731ca40 Aug 11 04:57:09 devstack sudo[114927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:09 devstack sudo[114928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-53301df6-291b-45ac-a618-fe6df2af728c Aug 11 04:57:09 devstack sudo[114928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:09 devstack sudo[114927]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c742c0ac-3a06-4fc9-ad68-3997731490e6 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-aeacf600-e46d-4235-b49f-124bc731ca40" returned: 0 in 0.250s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c742c0ac-3a06-4fc9-ad68-3997731490e6 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:57:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c742c0ac-3a06-4fc9-ad68-3997731490e6 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a9527634-bec0-4dd8-9cdc-56013624d527 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.319s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a9527634-bec0-4dd8-9cdc-56013624d527 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:57:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-996322414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75c03aeb-1d94-4efe-b124-bd9f4cfa2c96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3867b395632476f8e675fc8d19c8b5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:57:04Z,use_quota=True,user_id='62c79abf9c04413bb8269f0a2703e21b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:57:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-a9527634-bec0-4dd8-9cdc-56013624d527 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Creating volume 75c03aeb-1d94-4efe-b124-bd9f4cfa2c96 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:57:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a9527634-bec0-4dd8-9cdc-56013624d527 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a9527634-bec0-4dd8-9cdc-56013624d527 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a9527634-bec0-4dd8-9cdc-56013624d527 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:57:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a9527634-bec0-4dd8-9cdc-56013624d527 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:57:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a9527634-bec0-4dd8-9cdc-56013624d527 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a9527634-bec0-4dd8-9cdc-56013624d527 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:57:09 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-a9527634-bec0-4dd8-9cdc-56013624d527 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:57:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a9527634-bec0-4dd8-9cdc-56013624d527 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-75c03aeb-1d94-4efe-b124-bd9f4cfa2c96 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:09 devstack sudo[114928]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1daf64dd-207a-45d2-b940-da4c5b8a93be tempest-CreateVolumesFromImageTest-700369541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-53301df6-291b-45ac-a618-fe6df2af728c" returned: 0 in 0.265s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:09 devstack sudo[114933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-75c03aeb-1d94-4efe-b124-bd9f4cfa2c96 1073741824 Aug 11 04:57:09 devstack sudo[114933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c742c0ac-3a06-4fc9-ad68-3997731490e6 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf26a993-c756-495a-9a73-cf97dad8160e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aeacf600-e46d-4235-b49f-124bc731ca40', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c742c0ac-3a06-4fc9-ad68-3997731490e6 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2809ce34-158f-4e55-b482-e5aba46bfa1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1daf64dd-207a-45d2-b940-da4c5b8a93be tempest-CreateVolumesFromImageTest-700369541 None] Lock "cinder-quobyte-53301df6-291b-45ac-a618-fe6df2af728c" released by "delete_volume" :: held 0.727s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:10 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-c742c0ac-3a06-4fc9-ad68-3997731490e6 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Volume volume-aeacf600-e46d-4235-b49f-124bc731ca40 (aeacf600-e46d-4235-b49f-124bc731ca40): created successfully Aug 11 04:57:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c742c0ac-3a06-4fc9-ad68-3997731490e6 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2809ce34-158f-4e55-b482-e5aba46bfa1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c742c0ac-3a06-4fc9-ad68-3997731490e6 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Flow 'volume_create_manager' (ec561b45-fa9b-403a-bea8-74b2b1a0c1a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:57:10 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-c742c0ac-3a06-4fc9-ad68-3997731490e6 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Created volume successfully. Aug 11 04:57:10 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-1daf64dd-207a-45d2-b940-da4c5b8a93be tempest-CreateVolumesFromImageTest-700369541 None] Created reservations ['291fcc6d-e48b-42c2-bc6b-1aa7fc27d7b5', '063a7852-c7a5-4a7a-a730-5586d29b686d', '9a33603d-40d4-4086-8cf8-5d91fc118c64', 'f4fc6007-2d39-4a85-b451-7d305f53fb99'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:57:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1daf64dd-207a-45d2-b940-da4c5b8a93be tempest-CreateVolumesFromImageTest-700369541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1daf64dd-207a-45d2-b940-da4c5b8a93be tempest-CreateVolumesFromImageTest-700369541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:10 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1daf64dd-207a-45d2-b940-da4c5b8a93be tempest-CreateVolumesFromImageTest-700369541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:57:10 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1daf64dd-207a-45d2-b940-da4c5b8a93be tempest-CreateVolumesFromImageTest-700369541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:57:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1daf64dd-207a-45d2-b940-da4c5b8a93be tempest-CreateVolumesFromImageTest-700369541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1daf64dd-207a-45d2-b940-da4c5b8a93be tempest-CreateVolumesFromImageTest-700369541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:10 devstack sudo[114935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:57:10 devstack sudo[114935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ef902a3a-6a86-4414-9439-6e67a0048f9e tempest-CreateVolumesFromImageTest-700369541 None] Acquiring lock "cinder-b492482d-06a5-4b6e-9191-dd2b2556198e-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ef902a3a-6a86-4414-9439-6e67a0048f9e tempest-CreateVolumesFromImageTest-700369541 None] Lock "cinder-b492482d-06a5-4b6e-9191-dd2b2556198e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ef902a3a-6a86-4414-9439-6e67a0048f9e tempest-CreateVolumesFromImageTest-700369541 None] Acquiring lock "cinder-quobyte-b492482d-06a5-4b6e-9191-dd2b2556198e" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ef902a3a-6a86-4414-9439-6e67a0048f9e tempest-CreateVolumesFromImageTest-700369541 None] Lock "cinder-quobyte-b492482d-06a5-4b6e-9191-dd2b2556198e" acquired by "delete_volume" :: waited 0.015s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:10 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c96fa4-207a-4158-882c-77a1061bceea]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:57:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ef902a3a-6a86-4414-9439-6e67a0048f9e tempest-CreateVolumesFromImageTest-700369541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b492482d-06a5-4b6e-9191-dd2b2556198e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:10 devstack sudo[114935]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1daf64dd-207a-45d2-b940-da4c5b8a93be tempest-CreateVolumesFromImageTest-700369541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.289s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:10 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-1daf64dd-207a-45d2-b940-da4c5b8a93be tempest-CreateVolumesFromImageTest-700369541 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:57:10 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-1daf64dd-207a-45d2-b940-da4c5b8a93be tempest-CreateVolumesFromImageTest-700369541 None] Deleted volume successfully. Aug 11 04:57:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1daf64dd-207a-45d2-b940-da4c5b8a93be tempest-CreateVolumesFromImageTest-700369541 None] Lock "cinder-53301df6-291b-45ac-a618-fe6df2af728c-delete_volume" released by "delete_volume" :: held 1.271s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:10 devstack sudo[114933]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a9527634-bec0-4dd8-9cdc-56013624d527 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-75c03aeb-1d94-4efe-b124-bd9f4cfa2c96 1073741824" returned: 0 in 0.512s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a9527634-bec0-4dd8-9cdc-56013624d527 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-75c03aeb-1d94-4efe-b124-bd9f4cfa2c96 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:10 devstack sudo[114941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b492482d-06a5-4b6e-9191-dd2b2556198e Aug 11 04:57:10 devstack sudo[114941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:10 devstack sudo[114944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-75c03aeb-1d94-4efe-b124-bd9f4cfa2c96 Aug 11 04:57:10 devstack sudo[114944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:10 devstack sudo[114944]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a9527634-bec0-4dd8-9cdc-56013624d527 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-75c03aeb-1d94-4efe-b124-bd9f4cfa2c96" returned: 0 in 0.267s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:10 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a9527634-bec0-4dd8-9cdc-56013624d527 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:57:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a9527634-bec0-4dd8-9cdc-56013624d527 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6624e0a5-f45f-40a3-9d09-1a1a5b0b3b05 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.773s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:10 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6624e0a5-f45f-40a3-9d09-1a1a5b0b3b05 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:57:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1722370040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=206da10d-ab7c-403a-979d-3b8496f77039,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3867b395632476f8e675fc8d19c8b5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:57:05Z,use_quota=True,user_id='62c79abf9c04413bb8269f0a2703e21b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:57:10 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-6624e0a5-f45f-40a3-9d09-1a1a5b0b3b05 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Creating volume 206da10d-ab7c-403a-979d-3b8496f77039 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:57:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6624e0a5-f45f-40a3-9d09-1a1a5b0b3b05 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6624e0a5-f45f-40a3-9d09-1a1a5b0b3b05 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:10 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6624e0a5-f45f-40a3-9d09-1a1a5b0b3b05 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:57:10 devstack sudo[114941]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:10 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6624e0a5-f45f-40a3-9d09-1a1a5b0b3b05 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:57:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6624e0a5-f45f-40a3-9d09-1a1a5b0b3b05 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:10 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6624e0a5-f45f-40a3-9d09-1a1a5b0b3b05 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:57:10 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-6624e0a5-f45f-40a3-9d09-1a1a5b0b3b05 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:57:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6624e0a5-f45f-40a3-9d09-1a1a5b0b3b05 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-206da10d-ab7c-403a-979d-3b8496f77039 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ef902a3a-6a86-4414-9439-6e67a0048f9e tempest-CreateVolumesFromImageTest-700369541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b492482d-06a5-4b6e-9191-dd2b2556198e" returned: 0 in 0.413s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ef902a3a-6a86-4414-9439-6e67a0048f9e tempest-CreateVolumesFromImageTest-700369541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b492482d-06a5-4b6e-9191-dd2b2556198e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:10 devstack sudo[114952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-206da10d-ab7c-403a-979d-3b8496f77039 1073741824 Aug 11 04:57:10 devstack sudo[114952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a9527634-bec0-4dd8-9cdc-56013624d527 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa8f5492-d9ad-44ec-b8e8-77a32a168a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75c03aeb-1d94-4efe-b124-bd9f4cfa2c96', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a9527634-bec0-4dd8-9cdc-56013624d527 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7efb797c-0a01-4aed-be40-e4f5f4d82255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:10 devstack sudo[114953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b492482d-06a5-4b6e-9191-dd2b2556198e Aug 11 04:57:10 devstack sudo[114953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:10 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-a9527634-bec0-4dd8-9cdc-56013624d527 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Volume volume-75c03aeb-1d94-4efe-b124-bd9f4cfa2c96 (75c03aeb-1d94-4efe-b124-bd9f4cfa2c96): created successfully Aug 11 04:57:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a9527634-bec0-4dd8-9cdc-56013624d527 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7efb797c-0a01-4aed-be40-e4f5f4d82255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a9527634-bec0-4dd8-9cdc-56013624d527 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Flow 'volume_create_manager' (01df69eb-4cb9-4351-a3b8-7336df513881) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:57:10 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-a9527634-bec0-4dd8-9cdc-56013624d527 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Created volume successfully. Aug 11 04:57:11 devstack sudo[114953]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ef902a3a-6a86-4414-9439-6e67a0048f9e tempest-CreateVolumesFromImageTest-700369541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b492482d-06a5-4b6e-9191-dd2b2556198e" returned: 0 in 0.247s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ef902a3a-6a86-4414-9439-6e67a0048f9e tempest-CreateVolumesFromImageTest-700369541 None] Lock "cinder-quobyte-b492482d-06a5-4b6e-9191-dd2b2556198e" released by "delete_volume" :: held 0.706s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:11 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-ef902a3a-6a86-4414-9439-6e67a0048f9e tempest-CreateVolumesFromImageTest-700369541 None] Created reservations ['560550bd-98ed-454d-a3e7-4a700e6ea46d', 'bda1feef-3cb7-4f6c-9986-8858762c088d', 'a7d6dc08-feec-4e52-b707-eccbdae4a962', '6efcd3b3-3d34-41a6-81f6-a40a8844c11d'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:57:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ef902a3a-6a86-4414-9439-6e67a0048f9e tempest-CreateVolumesFromImageTest-700369541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ef902a3a-6a86-4414-9439-6e67a0048f9e tempest-CreateVolumesFromImageTest-700369541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ef902a3a-6a86-4414-9439-6e67a0048f9e tempest-CreateVolumesFromImageTest-700369541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:57:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ef902a3a-6a86-4414-9439-6e67a0048f9e tempest-CreateVolumesFromImageTest-700369541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:57:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ef902a3a-6a86-4414-9439-6e67a0048f9e tempest-CreateVolumesFromImageTest-700369541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ef902a3a-6a86-4414-9439-6e67a0048f9e tempest-CreateVolumesFromImageTest-700369541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:11 devstack sudo[114961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:57:11 devstack sudo[114961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:11 devstack sudo[114952]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6624e0a5-f45f-40a3-9d09-1a1a5b0b3b05 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-206da10d-ab7c-403a-979d-3b8496f77039 1073741824" returned: 0 in 0.447s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6624e0a5-f45f-40a3-9d09-1a1a5b0b3b05 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-206da10d-ab7c-403a-979d-3b8496f77039 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:11 devstack sudo[114963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-206da10d-ab7c-403a-979d-3b8496f77039 Aug 11 04:57:11 devstack sudo[114963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:11 devstack sudo[114961]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-66bb5c93-3d64-460b-ae1d-9c9081a9c466 tempest-CreateVolumesFromImageTest-700369541 None] Acquiring lock "cinder-6bd0390f-9b3c-42dc-a67c-0a60317d61df-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ef902a3a-6a86-4414-9439-6e67a0048f9e tempest-CreateVolumesFromImageTest-700369541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.271s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:11 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-ef902a3a-6a86-4414-9439-6e67a0048f9e tempest-CreateVolumesFromImageTest-700369541 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:57:11 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-ef902a3a-6a86-4414-9439-6e67a0048f9e tempest-CreateVolumesFromImageTest-700369541 None] Deleted volume successfully. Aug 11 04:57:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-66bb5c93-3d64-460b-ae1d-9c9081a9c466 tempest-CreateVolumesFromImageTest-700369541 None] Lock "cinder-6bd0390f-9b3c-42dc-a67c-0a60317d61df-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ef902a3a-6a86-4414-9439-6e67a0048f9e tempest-CreateVolumesFromImageTest-700369541 None] Lock "cinder-b492482d-06a5-4b6e-9191-dd2b2556198e-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-66bb5c93-3d64-460b-ae1d-9c9081a9c466 tempest-CreateVolumesFromImageTest-700369541 None] Acquiring lock "cinder-quobyte-6bd0390f-9b3c-42dc-a67c-0a60317d61df" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:11 devstack sudo[114963]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6624e0a5-f45f-40a3-9d09-1a1a5b0b3b05 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-206da10d-ab7c-403a-979d-3b8496f77039" returned: 0 in 0.263s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6624e0a5-f45f-40a3-9d09-1a1a5b0b3b05 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:57:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6624e0a5-f45f-40a3-9d09-1a1a5b0b3b05 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-66bb5c93-3d64-460b-ae1d-9c9081a9c466 tempest-CreateVolumesFromImageTest-700369541 None] Lock "cinder-quobyte-6bd0390f-9b3c-42dc-a67c-0a60317d61df" acquired by "delete_volume" :: waited 0.018s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-168bba0d-3742-48e1-8303-0f7473a61780 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.158s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-168bba0d-3742-48e1-8303-0f7473a61780 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-898447323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69dfcf99-6006-442d-8523-e344950c4db4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3867b395632476f8e675fc8d19c8b5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:57:05Z,use_quota=True,user_id='62c79abf9c04413bb8269f0a2703e21b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:57:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-168bba0d-3742-48e1-8303-0f7473a61780 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Creating volume 69dfcf99-6006-442d-8523-e344950c4db4 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:57:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-168bba0d-3742-48e1-8303-0f7473a61780 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-168bba0d-3742-48e1-8303-0f7473a61780 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-168bba0d-3742-48e1-8303-0f7473a61780 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:57:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-168bba0d-3742-48e1-8303-0f7473a61780 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:57:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-168bba0d-3742-48e1-8303-0f7473a61780 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-168bba0d-3742-48e1-8303-0f7473a61780 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:57:11 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-168bba0d-3742-48e1-8303-0f7473a61780 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:57:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-168bba0d-3742-48e1-8303-0f7473a61780 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-69dfcf99-6006-442d-8523-e344950c4db4 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:11 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[94bb4c00-fa77-4143-aa16-7f25f11c0d2a]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:57:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-66bb5c93-3d64-460b-ae1d-9c9081a9c466 tempest-CreateVolumesFromImageTest-700369541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6bd0390f-9b3c-42dc-a67c-0a60317d61df {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:11 devstack sudo[114967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-69dfcf99-6006-442d-8523-e344950c4db4 1073741824 Aug 11 04:57:11 devstack sudo[114967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6624e0a5-f45f-40a3-9d09-1a1a5b0b3b05 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56978fb8-a8c3-4168-8c55-9550070128dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-206da10d-ab7c-403a-979d-3b8496f77039', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6624e0a5-f45f-40a3-9d09-1a1a5b0b3b05 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1633e228-2880-4d9d-95f6-bf94e403e4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:11 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-6624e0a5-f45f-40a3-9d09-1a1a5b0b3b05 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Volume volume-206da10d-ab7c-403a-979d-3b8496f77039 (206da10d-ab7c-403a-979d-3b8496f77039): created successfully Aug 11 04:57:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6624e0a5-f45f-40a3-9d09-1a1a5b0b3b05 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1633e228-2880-4d9d-95f6-bf94e403e4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6624e0a5-f45f-40a3-9d09-1a1a5b0b3b05 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Flow 'volume_create_manager' (ac7e1eb9-9d4b-4261-8d01-917f7f516813) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:57:11 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-6624e0a5-f45f-40a3-9d09-1a1a5b0b3b05 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Created volume successfully. Aug 11 04:57:11 devstack sudo[114968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6bd0390f-9b3c-42dc-a67c-0a60317d61df Aug 11 04:57:11 devstack sudo[114968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:11 devstack sudo[114968]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-66bb5c93-3d64-460b-ae1d-9c9081a9c466 tempest-CreateVolumesFromImageTest-700369541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6bd0390f-9b3c-42dc-a67c-0a60317d61df" returned: 0 in 0.405s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-66bb5c93-3d64-460b-ae1d-9c9081a9c466 tempest-CreateVolumesFromImageTest-700369541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6bd0390f-9b3c-42dc-a67c-0a60317d61df {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:12 devstack sudo[114978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6bd0390f-9b3c-42dc-a67c-0a60317d61df Aug 11 04:57:12 devstack sudo[114978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:12 devstack sudo[114967]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-168bba0d-3742-48e1-8303-0f7473a61780 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-69dfcf99-6006-442d-8523-e344950c4db4 1073741824" returned: 0 in 0.460s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-168bba0d-3742-48e1-8303-0f7473a61780 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-69dfcf99-6006-442d-8523-e344950c4db4 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:12 devstack sudo[114980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-69dfcf99-6006-442d-8523-e344950c4db4 Aug 11 04:57:12 devstack sudo[114980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:12 devstack sudo[114978]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-66bb5c93-3d64-460b-ae1d-9c9081a9c466 tempest-CreateVolumesFromImageTest-700369541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6bd0390f-9b3c-42dc-a67c-0a60317d61df" returned: 0 in 0.255s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:12 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-66bb5c93-3d64-460b-ae1d-9c9081a9c466 tempest-CreateVolumesFromImageTest-700369541 None] Lock "cinder-quobyte-6bd0390f-9b3c-42dc-a67c-0a60317d61df" released by "delete_volume" :: held 0.718s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:12 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-66bb5c93-3d64-460b-ae1d-9c9081a9c466 tempest-CreateVolumesFromImageTest-700369541 None] Created reservations ['8e77fe07-5e60-4c27-a1e5-964b6cf94de8', '27f710f4-94ba-40c3-a125-84bedd6148a8', '54b442ac-2129-4d35-a935-d879ccefe880', '13a240b5-7bed-4866-a4ca-fd05311a7b10'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:57:12 devstack sudo[114980]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-168bba0d-3742-48e1-8303-0f7473a61780 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-69dfcf99-6006-442d-8523-e344950c4db4" returned: 0 in 0.251s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-168bba0d-3742-48e1-8303-0f7473a61780 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:57:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-168bba0d-3742-48e1-8303-0f7473a61780 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.393s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:57:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cbdac75-a280-47cd-99aa-4bbb83f5f645,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0298ccb5e3314d9f97e92d2c3fb64a78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:57:05Z,use_quota=True,user_id='bc609e2d3f97472c90d12054225240d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2405181-3d87-4189-b9f7-ddfc4c061871),volume_type_id=b2405181-3d87-4189-b9f7-ddfc4c061871)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:57:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Creating volume 9cbdac75-a280-47cd-99aa-4bbb83f5f645 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:57:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:57:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:57:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:57:12 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:57:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9cbdac75-a280-47cd-99aa-4bbb83f5f645 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:12 devstack sudo[114984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9cbdac75-a280-47cd-99aa-4bbb83f5f645 1073741824 Aug 11 04:57:12 devstack sudo[114984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-168bba0d-3742-48e1-8303-0f7473a61780 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33618db2-320a-4017-bfa4-4821ec3acb25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69dfcf99-6006-442d-8523-e344950c4db4', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-168bba0d-3742-48e1-8303-0f7473a61780 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (066bb3cd-b2c1-4547-a019-a5882b305668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:12 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-168bba0d-3742-48e1-8303-0f7473a61780 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Volume volume-69dfcf99-6006-442d-8523-e344950c4db4 (69dfcf99-6006-442d-8523-e344950c4db4): created successfully Aug 11 04:57:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-168bba0d-3742-48e1-8303-0f7473a61780 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (066bb3cd-b2c1-4547-a019-a5882b305668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-168bba0d-3742-48e1-8303-0f7473a61780 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Flow 'volume_create_manager' (50b85f8c-6a0f-4bd3-a38a-c6a0e1be1f02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:57:12 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-168bba0d-3742-48e1-8303-0f7473a61780 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Created volume successfully. Aug 11 04:57:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-66bb5c93-3d64-460b-ae1d-9c9081a9c466 tempest-CreateVolumesFromImageTest-700369541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-66bb5c93-3d64-460b-ae1d-9c9081a9c466 tempest-CreateVolumesFromImageTest-700369541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-66bb5c93-3d64-460b-ae1d-9c9081a9c466 tempest-CreateVolumesFromImageTest-700369541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:57:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-66bb5c93-3d64-460b-ae1d-9c9081a9c466 tempest-CreateVolumesFromImageTest-700369541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:57:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-66bb5c93-3d64-460b-ae1d-9c9081a9c466 tempest-CreateVolumesFromImageTest-700369541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-66bb5c93-3d64-460b-ae1d-9c9081a9c466 tempest-CreateVolumesFromImageTest-700369541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:12 devstack sudo[114986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:57:12 devstack sudo[114986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:12 devstack sudo[114986]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-66bb5c93-3d64-460b-ae1d-9c9081a9c466 tempest-CreateVolumesFromImageTest-700369541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.260s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:12 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-66bb5c93-3d64-460b-ae1d-9c9081a9c466 tempest-CreateVolumesFromImageTest-700369541 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:57:12 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-66bb5c93-3d64-460b-ae1d-9c9081a9c466 tempest-CreateVolumesFromImageTest-700369541 None] Deleted volume successfully. Aug 11 04:57:12 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-66bb5c93-3d64-460b-ae1d-9c9081a9c466 tempest-CreateVolumesFromImageTest-700369541 None] Lock "cinder-6bd0390f-9b3c-42dc-a67c-0a60317d61df-delete_volume" released by "delete_volume" :: held 1.269s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:12 devstack sudo[114984]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9cbdac75-a280-47cd-99aa-4bbb83f5f645 1073741824" returned: 0 in 0.484s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9cbdac75-a280-47cd-99aa-4bbb83f5f645 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:12 devstack sudo[114992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9cbdac75-a280-47cd-99aa-4bbb83f5f645 Aug 11 04:57:12 devstack sudo[114992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:12 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c53b2184-d0d1-4391-aa64-2d7160336e8d tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Acquiring lock "cinder-69dfcf99-6006-442d-8523-e344950c4db4-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:12 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c53b2184-d0d1-4391-aa64-2d7160336e8d tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "cinder-69dfcf99-6006-442d-8523-e344950c4db4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:13 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c53b2184-d0d1-4391-aa64-2d7160336e8d tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Acquiring lock "cinder-quobyte-69dfcf99-6006-442d-8523-e344950c4db4" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:13 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c53b2184-d0d1-4391-aa64-2d7160336e8d tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "cinder-quobyte-69dfcf99-6006-442d-8523-e344950c4db4" acquired by "delete_volume" :: waited 0.024s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:13 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f50962-b91c-4f00-9d9a-37b2d6a39bea]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:57:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c53b2184-d0d1-4391-aa64-2d7160336e8d tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-69dfcf99-6006-442d-8523-e344950c4db4 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:13 devstack sudo[114992]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:13 devstack sudo[114994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-69dfcf99-6006-442d-8523-e344950c4db4 Aug 11 04:57:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9cbdac75-a280-47cd-99aa-4bbb83f5f645" returned: 0 in 0.289s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:57:13 devstack sudo[114994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4853c0be-ce64-4786-a0c9-6f477ab37206 tempest-VolumeDependencyTests-568526517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.053s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:13 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4853c0be-ce64-4786-a0c9-6f477ab37206 tempest-VolumeDependencyTests-568526517 None] Acquiring lock "cinder-quobyte-4ab295a0-8281-4d8f-9870-4c64a0d1e19d-248edb84-4873-4da4-9da5-423dd3c8b493" by "_create_volume_from_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:13 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4853c0be-ce64-4786-a0c9-6f477ab37206 tempest-VolumeDependencyTests-568526517 None] Lock "cinder-quobyte-4ab295a0-8281-4d8f-9870-4c64a0d1e19d-248edb84-4873-4da4-9da5-423dd3c8b493" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4853c0be-ce64-4786-a0c9-6f477ab37206 tempest-VolumeDependencyTests-568526517 None] Creating volume 248edb84-4873-4da4-9da5-423dd3c8b493 from snapshot 4ab295a0-8281-4d8f-9870-4c64a0d1e19d {{(pid=94472) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 11 04:57:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4853c0be-ce64-4786-a0c9-6f477ab37206 tempest-VolumeDependencyTests-568526517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4853c0be-ce64-4786-a0c9-6f477ab37206 tempest-VolumeDependencyTests-568526517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4853c0be-ce64-4786-a0c9-6f477ab37206 tempest-VolumeDependencyTests-568526517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:57:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4853c0be-ce64-4786-a0c9-6f477ab37206 tempest-VolumeDependencyTests-568526517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:57:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4853c0be-ce64-4786-a0c9-6f477ab37206 tempest-VolumeDependencyTests-568526517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4853c0be-ce64-4786-a0c9-6f477ab37206 tempest-VolumeDependencyTests-568526517 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:57:13 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4853c0be-ce64-4786-a0c9-6f477ab37206 tempest-VolumeDependencyTests-568526517 None] Acquiring lock "cinder-quobyte-248edb84-4873-4da4-9da5-423dd3c8b493" by "_copy_volume_from_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:13 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Attempting download of 4498f448-e9ec-41c0-9b71-e67db74999ef ((None, [{'url': 'file:///opt/stack/data/glance/images/4498f448-e9ec-41c0-9b71-e67db74999ef', 'metadata': {}}])) to volume 9cbdac75-a280-47cd-99aa-4bbb83f5f645. {{(pid=94472) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 11 04:57:13 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4853c0be-ce64-4786-a0c9-6f477ab37206 tempest-VolumeDependencyTests-568526517 None] Lock "cinder-quobyte-248edb84-4873-4da4-9da5-423dd3c8b493" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4853c0be-ce64-4786-a0c9-6f477ab37206 tempest-VolumeDependencyTests-568526517 None] snapshot: 4ab295a0-8281-4d8f-9870-4c64a0d1e19d, volume: 248edb84-4873-4da4-9da5-423dd3c8b493, {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 11 04:57:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4853c0be-ce64-4786-a0c9-6f477ab37206 tempest-VolumeDependencyTests-568526517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4853c0be-ce64-4786-a0c9-6f477ab37206 tempest-VolumeDependencyTests-568526517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4853c0be-ce64-4786-a0c9-6f477ab37206 tempest-VolumeDependencyTests-568526517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:57:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4853c0be-ce64-4786-a0c9-6f477ab37206 tempest-VolumeDependencyTests-568526517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:57:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4853c0be-ce64-4786-a0c9-6f477ab37206 tempest-VolumeDependencyTests-568526517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:13 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb45e31-bb04-428b-8886-4f10ee16ee7c]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:57:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4853c0be-ce64-4786-a0c9-6f477ab37206 tempest-VolumeDependencyTests-568526517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8.4ab295a0-8281-4d8f-9870-4c64a0d1e19d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:13 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a62c2e-070a-48f2-b914-d540d0e2d004]: (4, 'raw') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:57:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4498f448-e9ec-41c0-9b71-e67db74999ef_qb1lkbza {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:13 devstack sudo[114997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8.4ab295a0-8281-4d8f-9870-4c64a0d1e19d Aug 11 04:57:13 devstack sudo[114997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:13 devstack sudo[114998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4498f448-e9ec-41c0-9b71-e67db74999ef_qb1lkbza Aug 11 04:57:13 devstack sudo[114998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:13 devstack sudo[114994]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c53b2184-d0d1-4391-aa64-2d7160336e8d tempest-CreateVolumesFromSourceVolumeTest-986996286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-69dfcf99-6006-442d-8523-e344950c4db4" returned: 0 in 0.502s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c53b2184-d0d1-4391-aa64-2d7160336e8d tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-69dfcf99-6006-442d-8523-e344950c4db4 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:13 devstack sudo[115005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-69dfcf99-6006-442d-8523-e344950c4db4 Aug 11 04:57:13 devstack sudo[115005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:13 devstack sudo[114998]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4498f448-e9ec-41c0-9b71-e67db74999ef_qb1lkbza" returned: 0 in 0.450s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4498f448-e9ec-41c0-9b71-e67db74999ef_qb1lkbza {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:13 devstack sudo[114997]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4853c0be-ce64-4786-a0c9-6f477ab37206 tempest-VolumeDependencyTests-568526517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8.4ab295a0-8281-4d8f-9870-4c64a0d1e19d" returned: 0 in 0.501s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-4853c0be-ce64-4786-a0c9-6f477ab37206 tempest-VolumeDependencyTests-568526517 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:57:13 devstack sudo[115005]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c53b2184-d0d1-4391-aa64-2d7160336e8d tempest-CreateVolumesFromSourceVolumeTest-986996286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-69dfcf99-6006-442d-8523-e344950c4db4" returned: 0 in 0.289s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:13 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb2de70-bf0e-468e-826f-b846c945750e]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:57:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4853c0be-ce64-4786-a0c9-6f477ab37206 tempest-VolumeDependencyTests-568526517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:13 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c53b2184-d0d1-4391-aa64-2d7160336e8d tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "cinder-quobyte-69dfcf99-6006-442d-8523-e344950c4db4" released by "delete_volume" :: held 0.850s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:13 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-c53b2184-d0d1-4391-aa64-2d7160336e8d tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Created reservations ['d0365108-1d7f-4c99-a716-d55384ec9858', '6be40e9a-3dd9-4451-ac1e-27315e75b9f8', '3ebacd81-7cfe-4494-84e0-45bf8a201fa5', '703f23cb-dcfb-49a9-8fa0-cb92f54d98aa'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:57:13 devstack sudo[115013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4498f448-e9ec-41c0-9b71-e67db74999ef_qb1lkbza Aug 11 04:57:13 devstack sudo[115013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:14 devstack sudo[115014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8 Aug 11 04:57:14 devstack sudo[115014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c53b2184-d0d1-4391-aa64-2d7160336e8d tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c53b2184-d0d1-4391-aa64-2d7160336e8d tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c53b2184-d0d1-4391-aa64-2d7160336e8d tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:57:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c53b2184-d0d1-4391-aa64-2d7160336e8d tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:57:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c53b2184-d0d1-4391-aa64-2d7160336e8d tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c53b2184-d0d1-4391-aa64-2d7160336e8d tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:14 devstack sudo[115017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:57:14 devstack sudo[115017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ac6600f6-951a-45c5-9d7f-c1f9e7de4ea9 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Acquiring lock "cinder-206da10d-ab7c-403a-979d-3b8496f77039-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ac6600f6-951a-45c5-9d7f-c1f9e7de4ea9 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "cinder-206da10d-ab7c-403a-979d-3b8496f77039-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:14 devstack sudo[115013]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4498f448-e9ec-41c0-9b71-e67db74999ef_qb1lkbza" returned: 1 in 0.505s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4498f448-e9ec-41c0-9b71-e67db74999ef_qb1lkbza' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 11 04:57:14 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d93475f-d1c1-4462-a0dc-4a792599e8cf]: (4, 'raw') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:57:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4498f448-e9ec-41c0-9b71-e67db74999ef_cy4as1q9devstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ac6600f6-951a-45c5-9d7f-c1f9e7de4ea9 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Acquiring lock "cinder-quobyte-206da10d-ab7c-403a-979d-3b8496f77039" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ac6600f6-951a-45c5-9d7f-c1f9e7de4ea9 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "cinder-quobyte-206da10d-ab7c-403a-979d-3b8496f77039" acquired by "delete_volume" :: waited 0.030s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:14 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f4fc53-2524-4a8b-a57c-53ac4972a9ac]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:57:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ac6600f6-951a-45c5-9d7f-c1f9e7de4ea9 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-206da10d-ab7c-403a-979d-3b8496f77039 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:14 devstack sudo[115014]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4853c0be-ce64-4786-a0c9-6f477ab37206 tempest-VolumeDependencyTests-568526517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8" returned: 0 in 0.624s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4853c0be-ce64-4786-a0c9-6f477ab37206 tempest-VolumeDependencyTests-568526517 None] will copy from snapshot at /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8 {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 11 04:57:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4853c0be-ce64-4786-a0c9-6f477ab37206 tempest-VolumeDependencyTests-568526517 None] Creating direct copy from snapshot {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 11 04:57:14 devstack sudo[115017]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:14 devstack sudo[115021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4498f448-e9ec-41c0-9b71-e67db74999ef_cy4as1q9devstack@QuobyteHD Aug 11 04:57:14 devstack sudo[115021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:14 devstack cinder-volume[94472]: DEBUG cinder.utils [None req-4853c0be-ce64-4786-a0c9-6f477ab37206 tempest-VolumeDependencyTests-568526517 None] Path /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-248edb84-4873-4da4-9da5-423dd3c8b493 not found in is_blk_device check {{(pid=94472) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 11 04:57:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4853c0be-ce64-4786-a0c9-6f477ab37206 tempest-VolumeDependencyTests-568526517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-248edb84-4873-4da4-9da5-423dd3c8b493 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c53b2184-d0d1-4391-aa64-2d7160336e8d tempest-CreateVolumesFromSourceVolumeTest-986996286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.435s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:14 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-c53b2184-d0d1-4391-aa64-2d7160336e8d tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:57:14 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-c53b2184-d0d1-4391-aa64-2d7160336e8d tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Deleted volume successfully. Aug 11 04:57:14 devstack sudo[115028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-248edb84-4873-4da4-9da5-423dd3c8b493 Aug 11 04:57:14 devstack sudo[115028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c53b2184-d0d1-4391-aa64-2d7160336e8d tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "cinder-69dfcf99-6006-442d-8523-e344950c4db4-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:14 devstack sudo[115025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-206da10d-ab7c-403a-979d-3b8496f77039 Aug 11 04:57:14 devstack sudo[115025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:14 devstack sudo[115021]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4498f448-e9ec-41c0-9b71-e67db74999ef_cy4as1q9devstack@QuobyteHD" returned: 0 in 0.500s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4498f448-e9ec-41c0-9b71-e67db74999ef_cy4as1q9devstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:14 devstack sudo[115025]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ac6600f6-951a-45c5-9d7f-c1f9e7de4ea9 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-206da10d-ab7c-403a-979d-3b8496f77039" returned: 0 in 0.517s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ac6600f6-951a-45c5-9d7f-c1f9e7de4ea9 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-206da10d-ab7c-403a-979d-3b8496f77039 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:14 devstack sudo[115037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4498f448-e9ec-41c0-9b71-e67db74999ef_cy4as1q9devstack@QuobyteHD Aug 11 04:57:14 devstack sudo[115037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:14 devstack sudo[115041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-206da10d-ab7c-403a-979d-3b8496f77039 Aug 11 04:57:14 devstack sudo[115041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:15 devstack sudo[115037]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4498f448-e9ec-41c0-9b71-e67db74999ef_cy4as1q9devstack@QuobyteHD" returned: 1 in 0.438s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4498f448-e9ec-41c0-9b71-e67db74999ef_cy4as1q9devstack@QuobyteHD' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 11 04:57:15 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] 4498f448-e9ec-41c0-9b71-e67db74999ef was raw, converting to qcow2 {{(pid=94472) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 11 04:57:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4498f448-e9ec-41c0-9b71-e67db74999ef_cy4as1q9devstack@QuobyteHD /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9cbdac75-a280-47cd-99aa-4bbb83f5f645 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:15 devstack sudo[115053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4498f448-e9ec-41c0-9b71-e67db74999ef_cy4as1q9devstack@QuobyteHD /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9cbdac75-a280-47cd-99aa-4bbb83f5f645 Aug 11 04:57:15 devstack sudo[115053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:15 devstack sudo[115041]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ac6600f6-951a-45c5-9d7f-c1f9e7de4ea9 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-206da10d-ab7c-403a-979d-3b8496f77039" returned: 0 in 0.701s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:15 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ac6600f6-951a-45c5-9d7f-c1f9e7de4ea9 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "cinder-quobyte-206da10d-ab7c-403a-979d-3b8496f77039" released by "delete_volume" :: held 1.314s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:15 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-ac6600f6-951a-45c5-9d7f-c1f9e7de4ea9 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Created reservations ['0f237b63-db26-42ad-97bf-f888f0945895', '3e59e6c2-93d9-44d6-8541-839a15918d5f', '3a044d45-a6d2-4d49-9654-5c224e03714f', 'e2298de7-313e-4bf5-a400-0185dc5a3924'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:57:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ac6600f6-951a-45c5-9d7f-c1f9e7de4ea9 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ac6600f6-951a-45c5-9d7f-c1f9e7de4ea9 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ac6600f6-951a-45c5-9d7f-c1f9e7de4ea9 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:57:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ac6600f6-951a-45c5-9d7f-c1f9e7de4ea9 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:57:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ac6600f6-951a-45c5-9d7f-c1f9e7de4ea9 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ac6600f6-951a-45c5-9d7f-c1f9e7de4ea9 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:16 devstack sudo[115059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:57:16 devstack sudo[115059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:16 devstack sudo[115059]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ac6600f6-951a-45c5-9d7f-c1f9e7de4ea9 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.396s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:16 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-ac6600f6-951a-45c5-9d7f-c1f9e7de4ea9 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:57:16 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-ac6600f6-951a-45c5-9d7f-c1f9e7de4ea9 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Deleted volume successfully. Aug 11 04:57:16 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ac6600f6-951a-45c5-9d7f-c1f9e7de4ea9 tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "cinder-206da10d-ab7c-403a-979d-3b8496f77039-delete_volume" released by "delete_volume" :: held 2.280s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:16 devstack sudo[115053]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4498f448-e9ec-41c0-9b71-e67db74999ef_cy4as1q9devstack@QuobyteHD /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9cbdac75-a280-47cd-99aa-4bbb83f5f645" returned: 0 in 1.248s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:16 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4498f448-e9ec-41c0-9b71-e67db74999ef_cy4as1q9devstack@QuobyteHD, size 0.00 MB, duration 1.25 sec, destination /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9cbdac75-a280-47cd-99aa-4bbb83f5f645 {{(pid=94472) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 11 04:57:16 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Converted 0.00 MB image at 0.00 MB/s Aug 11 04:57:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9cbdac75-a280-47cd-99aa-4bbb83f5f645 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:16 devstack sudo[115063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9cbdac75-a280-47cd-99aa-4bbb83f5f645 1G Aug 11 04:57:16 devstack sudo[115063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:16 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5406ac16-9cdc-438f-b91f-c81ad43457cf tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Acquiring lock "cinder-75c03aeb-1d94-4efe-b124-bd9f4cfa2c96-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:16 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5406ac16-9cdc-438f-b91f-c81ad43457cf tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "cinder-75c03aeb-1d94-4efe-b124-bd9f4cfa2c96-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:16 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5406ac16-9cdc-438f-b91f-c81ad43457cf tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Acquiring lock "cinder-quobyte-75c03aeb-1d94-4efe-b124-bd9f4cfa2c96" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:16 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5406ac16-9cdc-438f-b91f-c81ad43457cf tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "cinder-quobyte-75c03aeb-1d94-4efe-b124-bd9f4cfa2c96" acquired by "delete_volume" :: waited 0.044s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:17 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b348727-6bc3-4c3e-8bc1-9d7c011f3904]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:57:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5406ac16-9cdc-438f-b91f-c81ad43457cf tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-75c03aeb-1d94-4efe-b124-bd9f4cfa2c96 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:17 devstack sudo[115063]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9cbdac75-a280-47cd-99aa-4bbb83f5f645 1G" returned: 0 in 0.692s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:17 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Downloaded image 4498f448-e9ec-41c0-9b71-e67db74999ef ((None, [{'url': 'file:///opt/stack/data/glance/images/4498f448-e9ec-41c0-9b71-e67db74999ef', 'metadata': {}}])) to volume 9cbdac75-a280-47cd-99aa-4bbb83f5f645 successfully. {{(pid=94472) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 11 04:57:17 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Temporary image 4498f448-e9ec-41c0-9b71-e67db74999ef for user bc609e2d3f97472c90d12054225240d1 is deleted. {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 11 04:57:17 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Marking volume 9cbdac75-a280-47cd-99aa-4bbb83f5f645 as bootable. {{(pid=94472) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 11 04:57:17 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Copying metadata from image 4498f448-e9ec-41c0-9b71-e67db74999ef to 9cbdac75-a280-47cd-99aa-4bbb83f5f645. {{(pid=94472) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 11 04:57:17 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Creating volume glance metadata for volume 9cbdac75-a280-47cd-99aa-4bbb83f5f645 backed by image 4498f448-e9ec-41c0-9b71-e67db74999ef with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '4498f448-e9ec-41c0-9b71-e67db74999ef', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '6de54229af74fb106042adb4b1ef0ba1', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94472) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 11 04:57:17 devstack sudo[115068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-75c03aeb-1d94-4efe-b124-bd9f4cfa2c96 Aug 11 04:57:17 devstack sudo[115068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86b5d9fc-fba3-4169-a613-28f5556969c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cbdac75-a280-47cd-99aa-4bbb83f5f645', 'volume_size': 1, 'image_id': '4498f448-e9ec-41c0-9b71-e67db74999ef', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4498f448-e9ec-41c0-9b71-e67db74999ef', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6de54229af74fb106042adb4b1ef0ba1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0298ccb5e3314d9f97e92d2c3fb64a78', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9e3291edf32fffc3dea9b05b31d818b03c728b87e4f3c1933914ac3ff5fafda4e4b94f27ec3ad9eb36a18914ee5280baa12052f13475da2d905d47a72a81a978', 'id': '4498f448-e9ec-41c0-9b71-e67db74999ef', 'created_at': datetime.datetime(2026, 8, 11, 2, 57, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 2, 57, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4498f448-e9ec-41c0-9b71-e67db74999ef/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95df2489-5128-4dcc-807d-d317b194189c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:17 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Volume volume-9cbdac75-a280-47cd-99aa-4bbb83f5f645 (9cbdac75-a280-47cd-99aa-4bbb83f5f645): created successfully Aug 11 04:57:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95df2489-5128-4dcc-807d-d317b194189c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Flow 'volume_create_manager' (e6ebd031-cb32-44ac-91ca-edf68516bee2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:57:17 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-15b48a16-d2af-4448-a8e6-5cd924733d03 tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Created volume successfully. Aug 11 04:57:17 devstack sudo[115068]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5406ac16-9cdc-438f-b91f-c81ad43457cf tempest-CreateVolumesFromSourceVolumeTest-986996286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-75c03aeb-1d94-4efe-b124-bd9f4cfa2c96" returned: 0 in 0.857s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5406ac16-9cdc-438f-b91f-c81ad43457cf tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-75c03aeb-1d94-4efe-b124-bd9f4cfa2c96 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:17 devstack sudo[115073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-75c03aeb-1d94-4efe-b124-bd9f4cfa2c96 Aug 11 04:57:17 devstack sudo[115073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:18 devstack sudo[115073]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5406ac16-9cdc-438f-b91f-c81ad43457cf tempest-CreateVolumesFromSourceVolumeTest-986996286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-75c03aeb-1d94-4efe-b124-bd9f4cfa2c96" returned: 0 in 0.429s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:18 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5406ac16-9cdc-438f-b91f-c81ad43457cf tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "cinder-quobyte-75c03aeb-1d94-4efe-b124-bd9f4cfa2c96" released by "delete_volume" :: held 1.421s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:18 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-5406ac16-9cdc-438f-b91f-c81ad43457cf tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Created reservations ['6b148f80-8c9d-4417-b56d-c5a1e7673da0', '7b963576-95e8-4d93-a51d-29db6cc65adb', 'acea3b0a-06cf-4ed4-aa24-f0b4ae774559', 'c7b7fe17-c6d0-4ddd-931e-1790d0ef4ade'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:57:18 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cf191f1-bb0e-4eaf-a1d9-f8a7fb0bc4cd tempest-CreateVolumesFromSnapshotTest-363080733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:57:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1cf191f1-bb0e-4eaf-a1d9-f8a7fb0bc4cd tempest-CreateVolumesFromSnapshotTest-363080733 None] Flow 'volume_create_manager' (0866511a-ad11-44c0-966c-afcf1860c539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:57:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1cf191f1-bb0e-4eaf-a1d9-f8a7fb0bc4cd tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68d8ee2d-9df8-4a44-b25c-ecb26951ba67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1cf191f1-bb0e-4eaf-a1d9-f8a7fb0bc4cd tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68d8ee2d-9df8-4a44-b25c-ecb26951ba67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1372403346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17832647-6d92-42bb-ae3c-327529a76c9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='374985e9117444e5ab2e2ae93f2e06e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:57:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:57:19Z,use_quota=True,user_id='482bf3ec5a074681ba2ff543f830c769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1cf191f1-bb0e-4eaf-a1d9-f8a7fb0bc4cd tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bccf3bd-3ea2-433d-bfdc-f1abe50d7844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1cf191f1-bb0e-4eaf-a1d9-f8a7fb0bc4cd tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bccf3bd-3ea2-433d-bfdc-f1abe50d7844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1cf191f1-bb0e-4eaf-a1d9-f8a7fb0bc4cd tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3f8dc23-6572-4123-97a6-e2b17989e0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1cf191f1-bb0e-4eaf-a1d9-f8a7fb0bc4cd tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3f8dc23-6572-4123-97a6-e2b17989e0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17832647-6d92-42bb-ae3c-327529a76c9d', 'volume_name': 'volume-17832647-6d92-42bb-ae3c-327529a76c9d', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1cf191f1-bb0e-4eaf-a1d9-f8a7fb0bc4cd tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d689abec-50be-4811-b96f-98f898ce599b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1cf191f1-bb0e-4eaf-a1d9-f8a7fb0bc4cd tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d689abec-50be-4811-b96f-98f898ce599b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1cf191f1-bb0e-4eaf-a1d9-f8a7fb0bc4cd tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91c8ba5d-2c31-4d51-86c2-ca2260672391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:18 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-1cf191f1-bb0e-4eaf-a1d9-f8a7fb0bc4cd tempest-CreateVolumesFromSnapshotTest-363080733 None] Volume 17832647-6d92-42bb-ae3c-327529a76c9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17832647-6d92-42bb-ae3c-327529a76c9d', 'volume_size': 1} Aug 11 04:57:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1cf191f1-bb0e-4eaf-a1d9-f8a7fb0bc4cd tempest-CreateVolumesFromSnapshotTest-363080733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:18 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a79bc6c9-40bd-490c-8262-1fc0cd8333cd tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Acquiring lock "cinder-9cbdac75-a280-47cd-99aa-4bbb83f5f645-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5406ac16-9cdc-438f-b91f-c81ad43457cf tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5406ac16-9cdc-438f-b91f-c81ad43457cf tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:18 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-5406ac16-9cdc-438f-b91f-c81ad43457cf tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:57:18 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-5406ac16-9cdc-438f-b91f-c81ad43457cf tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:57:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5406ac16-9cdc-438f-b91f-c81ad43457cf tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5406ac16-9cdc-438f-b91f-c81ad43457cf tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:18 devstack sudo[115076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:57:18 devstack sudo[115076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a79bc6c9-40bd-490c-8262-1fc0cd8333cd tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Lock "cinder-9cbdac75-a280-47cd-99aa-4bbb83f5f645-delete_volume" acquired by "delete_volume" :: waited 0.107s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a79bc6c9-40bd-490c-8262-1fc0cd8333cd tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Acquiring lock "cinder-quobyte-9cbdac75-a280-47cd-99aa-4bbb83f5f645" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a79bc6c9-40bd-490c-8262-1fc0cd8333cd tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Lock "cinder-quobyte-9cbdac75-a280-47cd-99aa-4bbb83f5f645" acquired by "delete_volume" :: waited 0.025s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:19 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5765431-4e5d-47fc-94ad-3ed43e3c4dae]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:57:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a79bc6c9-40bd-490c-8262-1fc0cd8333cd tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9cbdac75-a280-47cd-99aa-4bbb83f5f645 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:19 devstack sudo[115076]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5406ac16-9cdc-438f-b91f-c81ad43457cf tempest-CreateVolumesFromSourceVolumeTest-986996286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.425s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:19 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-5406ac16-9cdc-438f-b91f-c81ad43457cf tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:57:19 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-5406ac16-9cdc-438f-b91f-c81ad43457cf tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Deleted volume successfully. Aug 11 04:57:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5406ac16-9cdc-438f-b91f-c81ad43457cf tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "cinder-75c03aeb-1d94-4efe-b124-bd9f4cfa2c96-delete_volume" released by "delete_volume" :: held 2.575s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6a322bd6-91fb-4a1d-8d97-85bae8e116cb tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Acquiring lock "cinder-aeacf600-e46d-4235-b49f-124bc731ca40-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6a322bd6-91fb-4a1d-8d97-85bae8e116cb tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "cinder-aeacf600-e46d-4235-b49f-124bc731ca40-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:19 devstack sudo[115079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9cbdac75-a280-47cd-99aa-4bbb83f5f645 Aug 11 04:57:19 devstack sudo[115079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6a322bd6-91fb-4a1d-8d97-85bae8e116cb tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Acquiring lock "cinder-quobyte-aeacf600-e46d-4235-b49f-124bc731ca40" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6a322bd6-91fb-4a1d-8d97-85bae8e116cb tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "cinder-quobyte-aeacf600-e46d-4235-b49f-124bc731ca40" acquired by "delete_volume" :: waited 0.044s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:19 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ce6f42-1580-4c84-82d5-8766f5adaf92]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:57:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6a322bd6-91fb-4a1d-8d97-85bae8e116cb tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-aeacf600-e46d-4235-b49f-124bc731ca40 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:20 devstack sudo[115079]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a79bc6c9-40bd-490c-8262-1fc0cd8333cd tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9cbdac75-a280-47cd-99aa-4bbb83f5f645" returned: 0 in 0.846s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a79bc6c9-40bd-490c-8262-1fc0cd8333cd tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9cbdac75-a280-47cd-99aa-4bbb83f5f645 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:20 devstack sudo[115082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-aeacf600-e46d-4235-b49f-124bc731ca40 Aug 11 04:57:20 devstack sudo[115082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:20 devstack sudo[115086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9cbdac75-a280-47cd-99aa-4bbb83f5f645 Aug 11 04:57:20 devstack sudo[115086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:20 devstack sudo[115028]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4853c0be-ce64-4786-a0c9-6f477ab37206 tempest-VolumeDependencyTests-568526517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-248edb84-4873-4da4-9da5-423dd3c8b493" returned: 0 in 6.016s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:20 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-4853c0be-ce64-4786-a0c9-6f477ab37206 tempest-VolumeDependencyTests-568526517 None] Image conversion details: src /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8, size 1024.00 MB, duration 6.02 sec, destination /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-248edb84-4873-4da4-9da5-423dd3c8b493 {{(pid=94472) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 11 04:57:20 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-4853c0be-ce64-4786-a0c9-6f477ab37206 tempest-VolumeDependencyTests-568526517 None] Converted 1024.00 MB image at 170.14 MB/s Aug 11 04:57:20 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-4853c0be-ce64-4786-a0c9-6f477ab37206 tempest-VolumeDependencyTests-568526517 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-248edb84-4873-4da4-9da5-423dd3c8b493 is being set with open permissions: ugo+rw Aug 11 04:57:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4853c0be-ce64-4786-a0c9-6f477ab37206 tempest-VolumeDependencyTests-568526517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-248edb84-4873-4da4-9da5-423dd3c8b493 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:20 devstack sudo[115125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-248edb84-4873-4da4-9da5-423dd3c8b493 Aug 11 04:57:20 devstack sudo[115125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:20 devstack sudo[115086]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a79bc6c9-40bd-490c-8262-1fc0cd8333cd tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-9cbdac75-a280-47cd-99aa-4bbb83f5f645" returned: 0 in 0.547s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:20 devstack sudo[115082]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6a322bd6-91fb-4a1d-8d97-85bae8e116cb tempest-CreateVolumesFromSourceVolumeTest-986996286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-aeacf600-e46d-4235-b49f-124bc731ca40" returned: 0 in 0.955s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6a322bd6-91fb-4a1d-8d97-85bae8e116cb tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-aeacf600-e46d-4235-b49f-124bc731ca40 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a79bc6c9-40bd-490c-8262-1fc0cd8333cd tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Lock "cinder-quobyte-9cbdac75-a280-47cd-99aa-4bbb83f5f645" released by "delete_volume" :: held 1.521s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:20 devstack sudo[115129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-aeacf600-e46d-4235-b49f-124bc731ca40 Aug 11 04:57:20 devstack sudo[115129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:20 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-a79bc6c9-40bd-490c-8262-1fc0cd8333cd tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Created reservations ['07b21797-15d8-4821-b448-543ec85f6e5d', '844fb3b3-2b45-4b47-b4da-5bdd913563d5', 'c24e33af-54d3-4937-97fc-a677c6644b6a', '3bdce4fd-d467-46da-9cc1-3e59c36f9246'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:57:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a79bc6c9-40bd-490c-8262-1fc0cd8333cd tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a79bc6c9-40bd-490c-8262-1fc0cd8333cd tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a79bc6c9-40bd-490c-8262-1fc0cd8333cd tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:57:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a79bc6c9-40bd-490c-8262-1fc0cd8333cd tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:57:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a79bc6c9-40bd-490c-8262-1fc0cd8333cd tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a79bc6c9-40bd-490c-8262-1fc0cd8333cd tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:20 devstack sudo[115131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:57:20 devstack sudo[115131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:20 devstack sudo[115125]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4853c0be-ce64-4786-a0c9-6f477ab37206 tempest-VolumeDependencyTests-568526517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-248edb84-4873-4da4-9da5-423dd3c8b493" returned: 0 in 0.324s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4853c0be-ce64-4786-a0c9-6f477ab37206 tempest-VolumeDependencyTests-568526517 None] Lock "cinder-quobyte-248edb84-4873-4da4-9da5-423dd3c8b493" released by "_copy_volume_from_snapshot" :: held 7.582s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4853c0be-ce64-4786-a0c9-6f477ab37206 tempest-VolumeDependencyTests-568526517 None] Lock "cinder-quobyte-4ab295a0-8281-4d8f-9870-4c64a0d1e19d-248edb84-4873-4da4-9da5-423dd3c8b493" released by "_create_volume_from_snapshot" :: held 7.662s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4853c0be-ce64-4786-a0c9-6f477ab37206 tempest-VolumeDependencyTests-568526517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.690s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1cf191f1-bb0e-4eaf-a1d9-f8a7fb0bc4cd tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.081s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1cf191f1-bb0e-4eaf-a1d9-f8a7fb0bc4cd tempest-CreateVolumesFromSnapshotTest-363080733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1372403346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17832647-6d92-42bb-ae3c-327529a76c9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='374985e9117444e5ab2e2ae93f2e06e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:57:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:57:19Z,use_quota=True,user_id='482bf3ec5a074681ba2ff543f830c769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:57:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-1cf191f1-bb0e-4eaf-a1d9-f8a7fb0bc4cd tempest-CreateVolumesFromSnapshotTest-363080733 None] Creating volume 17832647-6d92-42bb-ae3c-327529a76c9d {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:57:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1cf191f1-bb0e-4eaf-a1d9-f8a7fb0bc4cd tempest-CreateVolumesFromSnapshotTest-363080733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1cf191f1-bb0e-4eaf-a1d9-f8a7fb0bc4cd tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1cf191f1-bb0e-4eaf-a1d9-f8a7fb0bc4cd tempest-CreateVolumesFromSnapshotTest-363080733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:57:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1cf191f1-bb0e-4eaf-a1d9-f8a7fb0bc4cd tempest-CreateVolumesFromSnapshotTest-363080733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:57:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1cf191f1-bb0e-4eaf-a1d9-f8a7fb0bc4cd tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1cf191f1-bb0e-4eaf-a1d9-f8a7fb0bc4cd tempest-CreateVolumesFromSnapshotTest-363080733 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:57:20 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-1cf191f1-bb0e-4eaf-a1d9-f8a7fb0bc4cd tempest-CreateVolumesFromSnapshotTest-363080733 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:57:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1cf191f1-bb0e-4eaf-a1d9-f8a7fb0bc4cd tempest-CreateVolumesFromSnapshotTest-363080733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17832647-6d92-42bb-ae3c-327529a76c9d 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:20 devstack sudo[115129]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6a322bd6-91fb-4a1d-8d97-85bae8e116cb tempest-CreateVolumesFromSourceVolumeTest-986996286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-aeacf600-e46d-4235-b49f-124bc731ca40" returned: 0 in 0.327s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:20 devstack sudo[115137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17832647-6d92-42bb-ae3c-327529a76c9d 1073741824 Aug 11 04:57:20 devstack sudo[115137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4853c0be-ce64-4786-a0c9-6f477ab37206 tempest-VolumeDependencyTests-568526517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5f260b0-5ba2-4809-8af9-a2049c10e7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-248edb84-4873-4da4-9da5-423dd3c8b493', 'volume_size': 1, 'snapshot_id': '4ab295a0-8281-4d8f-9870-4c64a0d1e19d'}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4853c0be-ce64-4786-a0c9-6f477ab37206 tempest-VolumeDependencyTests-568526517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (671271fa-57aa-4f06-8951-fed7801f0066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6a322bd6-91fb-4a1d-8d97-85bae8e116cb tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "cinder-quobyte-aeacf600-e46d-4235-b49f-124bc731ca40" released by "delete_volume" :: held 1.385s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:21 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-4853c0be-ce64-4786-a0c9-6f477ab37206 tempest-VolumeDependencyTests-568526517 None] Volume volume-248edb84-4873-4da4-9da5-423dd3c8b493 (248edb84-4873-4da4-9da5-423dd3c8b493): created successfully Aug 11 04:57:21 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4853c0be-ce64-4786-a0c9-6f477ab37206 tempest-VolumeDependencyTests-568526517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (671271fa-57aa-4f06-8951-fed7801f0066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:21 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4853c0be-ce64-4786-a0c9-6f477ab37206 tempest-VolumeDependencyTests-568526517 None] Flow 'volume_create_manager' (79beef54-3413-4b43-9209-63b013378c53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:57:21 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-4853c0be-ce64-4786-a0c9-6f477ab37206 tempest-VolumeDependencyTests-568526517 None] Created volume successfully. Aug 11 04:57:21 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-6a322bd6-91fb-4a1d-8d97-85bae8e116cb tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Created reservations ['089f05a5-8f8a-4f75-8581-3990cd8e2633', '9cbff206-b1b0-4a1e-b43c-1f4a9775d836', 'd277d06e-929f-4d81-98eb-b1f42328c18a', '89bf8fdc-26d7-4311-b4b5-f0d1279c7784'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:57:21 devstack sudo[115131]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a79bc6c9-40bd-490c-8262-1fc0cd8333cd tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.336s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:21 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-a79bc6c9-40bd-490c-8262-1fc0cd8333cd tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:57:21 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-a79bc6c9-40bd-490c-8262-1fc0cd8333cd tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Deleted volume successfully. Aug 11 04:57:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a79bc6c9-40bd-490c-8262-1fc0cd8333cd tempest-VolumeAndVolumeTypeFromImageTest-1940066089 None] Lock "cinder-9cbdac75-a280-47cd-99aa-4bbb83f5f645-delete_volume" released by "delete_volume" :: held 2.158s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6a322bd6-91fb-4a1d-8d97-85bae8e116cb tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6a322bd6-91fb-4a1d-8d97-85bae8e116cb tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:21 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6a322bd6-91fb-4a1d-8d97-85bae8e116cb tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:57:21 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6a322bd6-91fb-4a1d-8d97-85bae8e116cb tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:57:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6a322bd6-91fb-4a1d-8d97-85bae8e116cb tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6a322bd6-91fb-4a1d-8d97-85bae8e116cb tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:21 devstack sudo[115142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:57:21 devstack sudo[115142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:21 devstack sudo[115142]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6a322bd6-91fb-4a1d-8d97-85bae8e116cb tempest-CreateVolumesFromSourceVolumeTest-986996286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.279s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:21 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-6a322bd6-91fb-4a1d-8d97-85bae8e116cb tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:57:21 devstack sudo[115137]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1cf191f1-bb0e-4eaf-a1d9-f8a7fb0bc4cd tempest-CreateVolumesFromSnapshotTest-363080733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17832647-6d92-42bb-ae3c-327529a76c9d 1073741824" returned: 0 in 0.527s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c078e160-fb87-43bb-a985-f0b1d3125bb0 tempest-VolumeDependencyTests-568526517 None] Acquiring lock "cinder-4ab295a0-8281-4d8f-9870-4c64a0d1e19d-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:21 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-6a322bd6-91fb-4a1d-8d97-85bae8e116cb tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Deleted volume successfully. Aug 11 04:57:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c078e160-fb87-43bb-a985-f0b1d3125bb0 tempest-VolumeDependencyTests-568526517 None] Lock "cinder-4ab295a0-8281-4d8f-9870-4c64a0d1e19d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c078e160-fb87-43bb-a985-f0b1d3125bb0 tempest-VolumeDependencyTests-568526517 None] Acquiring lock "cinder-quobyte-e2ac593a-392e-4cfd-9b19-a0f453f56bd8" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6a322bd6-91fb-4a1d-8d97-85bae8e116cb tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "cinder-aeacf600-e46d-4235-b49f-124bc731ca40-delete_volume" released by "delete_volume" :: held 2.074s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c078e160-fb87-43bb-a985-f0b1d3125bb0 tempest-VolumeDependencyTests-568526517 None] Lock "cinder-quobyte-e2ac593a-392e-4cfd-9b19-a0f453f56bd8" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c078e160-fb87-43bb-a985-f0b1d3125bb0 tempest-VolumeDependencyTests-568526517 None] Acquiring lock "cinder-quobyte-4ab295a0-8281-4d8f-9870-4c64a0d1e19d" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1cf191f1-bb0e-4eaf-a1d9-f8a7fb0bc4cd tempest-CreateVolumesFromSnapshotTest-363080733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17832647-6d92-42bb-ae3c-327529a76c9d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c078e160-fb87-43bb-a985-f0b1d3125bb0 tempest-VolumeDependencyTests-568526517 None] Lock "cinder-quobyte-4ab295a0-8281-4d8f-9870-4c64a0d1e19d" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:21 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-c078e160-fb87-43bb-a985-f0b1d3125bb0 tempest-VolumeDependencyTests-568526517 None] Deleting offline snapshot 4ab295a0-8281-4d8f-9870-4c64a0d1e19d of volume e2ac593a-392e-4cfd-9b19-a0f453f56bd8 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 04:57:21 devstack sudo[115147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17832647-6d92-42bb-ae3c-327529a76c9d Aug 11 04:57:21 devstack sudo[115147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:21 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-c078e160-fb87-43bb-a985-f0b1d3125bb0 tempest-VolumeDependencyTests-568526517 None] snapshot_file for this snap is: volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8.4ab295a0-8281-4d8f-9870-4c64a0d1e19d {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 04:57:21 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[759444a4-5bba-4ca6-bbcc-ea65c2586dfd]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:57:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c078e160-fb87-43bb-a985-f0b1d3125bb0 tempest-VolumeDependencyTests-568526517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8.4ab295a0-8281-4d8f-9870-4c64a0d1e19d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-171eb82a-8213-485a-ba53-5ead9104683c tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Acquiring lock "cinder-75c00221-f835-4022-a026-eae82a4b0d12-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:21 devstack sudo[115149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8.4ab295a0-8281-4d8f-9870-4c64a0d1e19d Aug 11 04:57:21 devstack sudo[115149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-171eb82a-8213-485a-ba53-5ead9104683c tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "cinder-75c00221-f835-4022-a026-eae82a4b0d12-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-171eb82a-8213-485a-ba53-5ead9104683c tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Acquiring lock "cinder-quobyte-75c00221-f835-4022-a026-eae82a4b0d12" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-171eb82a-8213-485a-ba53-5ead9104683c tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "cinder-quobyte-75c00221-f835-4022-a026-eae82a4b0d12" acquired by "delete_volume" :: waited 0.026s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:21 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcffd6e-8765-4fc9-a0b2-8dbba0aad320]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:57:21 devstack sudo[115147]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-171eb82a-8213-485a-ba53-5ead9104683c tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-75c00221-f835-4022-a026-eae82a4b0d12 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1cf191f1-bb0e-4eaf-a1d9-f8a7fb0bc4cd tempest-CreateVolumesFromSnapshotTest-363080733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17832647-6d92-42bb-ae3c-327529a76c9d" returned: 0 in 0.349s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:21 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1cf191f1-bb0e-4eaf-a1d9-f8a7fb0bc4cd tempest-CreateVolumesFromSnapshotTest-363080733 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:57:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1cf191f1-bb0e-4eaf-a1d9-f8a7fb0bc4cd tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:21 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1cf191f1-bb0e-4eaf-a1d9-f8a7fb0bc4cd tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91c8ba5d-2c31-4d51-86c2-ca2260672391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17832647-6d92-42bb-ae3c-327529a76c9d', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:21 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1cf191f1-bb0e-4eaf-a1d9-f8a7fb0bc4cd tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (273e8168-1d67-4cbb-94d8-5ccc5250ab20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:21 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-1cf191f1-bb0e-4eaf-a1d9-f8a7fb0bc4cd tempest-CreateVolumesFromSnapshotTest-363080733 None] Volume volume-17832647-6d92-42bb-ae3c-327529a76c9d (17832647-6d92-42bb-ae3c-327529a76c9d): created successfully Aug 11 04:57:21 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1cf191f1-bb0e-4eaf-a1d9-f8a7fb0bc4cd tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (273e8168-1d67-4cbb-94d8-5ccc5250ab20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:21 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1cf191f1-bb0e-4eaf-a1d9-f8a7fb0bc4cd tempest-CreateVolumesFromSnapshotTest-363080733 None] Flow 'volume_create_manager' (0866511a-ad11-44c0-966c-afcf1860c539) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:57:21 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-1cf191f1-bb0e-4eaf-a1d9-f8a7fb0bc4cd tempest-CreateVolumesFromSnapshotTest-363080733 None] Created volume successfully. Aug 11 04:57:22 devstack sudo[115152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-75c00221-f835-4022-a026-eae82a4b0d12 Aug 11 04:57:22 devstack sudo[115152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:22 devstack sudo[115149]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c078e160-fb87-43bb-a985-f0b1d3125bb0 tempest-VolumeDependencyTests-568526517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8.4ab295a0-8281-4d8f-9870-4c64a0d1e19d" returned: 0 in 0.474s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-c078e160-fb87-43bb-a985-f0b1d3125bb0 tempest-VolumeDependencyTests-568526517 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:57:22 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0066fa-2ff8-453c-821b-cbf17e29160c]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:57:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c078e160-fb87-43bb-a985-f0b1d3125bb0 tempest-VolumeDependencyTests-568526517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:22 devstack sudo[115157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8 Aug 11 04:57:22 devstack sudo[115157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:22 devstack sudo[115152]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-171eb82a-8213-485a-ba53-5ead9104683c tempest-CreateVolumesFromSourceVolumeTest-986996286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-75c00221-f835-4022-a026-eae82a4b0d12" returned: 0 in 0.397s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-171eb82a-8213-485a-ba53-5ead9104683c tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-75c00221-f835-4022-a026-eae82a4b0d12 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:22 devstack sudo[115162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-75c00221-f835-4022-a026-eae82a4b0d12 Aug 11 04:57:22 devstack sudo[115162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:22 devstack sudo[115162]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-171eb82a-8213-485a-ba53-5ead9104683c tempest-CreateVolumesFromSourceVolumeTest-986996286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-75c00221-f835-4022-a026-eae82a4b0d12" returned: 0 in 0.279s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-171eb82a-8213-485a-ba53-5ead9104683c tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "cinder-quobyte-75c00221-f835-4022-a026-eae82a4b0d12" released by "delete_volume" :: held 0.727s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:22 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-171eb82a-8213-485a-ba53-5ead9104683c tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Created reservations ['a8a5823a-f215-4f13-b1fe-52ad909e23aa', '9dc3bbcc-73cd-417e-a9bd-85d65112b532', '1932e245-c465-4862-86d5-4c9d7b05edde', '6575fc87-fae2-4799-8005-9b706003ee9b'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:57:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-171eb82a-8213-485a-ba53-5ead9104683c tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:22 devstack sudo[115157]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-171eb82a-8213-485a-ba53-5ead9104683c tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-171eb82a-8213-485a-ba53-5ead9104683c tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:57:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-171eb82a-8213-485a-ba53-5ead9104683c tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:57:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-171eb82a-8213-485a-ba53-5ead9104683c tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-171eb82a-8213-485a-ba53-5ead9104683c tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c078e160-fb87-43bb-a985-f0b1d3125bb0 tempest-VolumeDependencyTests-568526517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8" returned: 0 in 0.651s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c078e160-fb87-43bb-a985-f0b1d3125bb0 tempest-VolumeDependencyTests-568526517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8.4ab295a0-8281-4d8f-9870-4c64a0d1e19d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:22 devstack sudo[115169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:57:22 devstack sudo[115169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:22 devstack sudo[115170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8.4ab295a0-8281-4d8f-9870-4c64a0d1e19d Aug 11 04:57:22 devstack sudo[115170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e0402f77-d5a7-4c59-a8ca-8167a7e4b9b9 tempest-CreateVolumesFromSnapshotTest-363080733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e0402f77-d5a7-4c59-a8ca-8167a7e4b9b9 tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-3b85d59b-0e59-4f06-abf9-39db7288c69e tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Acquiring lock "cinder-4b8e487f-a551-4c3d-b224-531407eff038-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:23 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-e0402f77-d5a7-4c59-a8ca-8167a7e4b9b9 tempest-CreateVolumesFromSnapshotTest-363080733 None] Creating offline snapshot 357401bf-81ab-4671-ad0d-2f25813df791 of volume 17832647-6d92-42bb-ae3c-327529a76c9d {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 04:57:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-3b85d59b-0e59-4f06-abf9-39db7288c69e tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "cinder-4b8e487f-a551-4c3d-b224-531407eff038-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:23 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ed21b4-42bc-4573-9673-dbfdeefb28a9]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:57:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e0402f77-d5a7-4c59-a8ca-8167a7e4b9b9 tempest-CreateVolumesFromSnapshotTest-363080733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17832647-6d92-42bb-ae3c-327529a76c9d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:23 devstack sudo[115169]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-171eb82a-8213-485a-ba53-5ead9104683c tempest-CreateVolumesFromSourceVolumeTest-986996286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.403s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:23 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-171eb82a-8213-485a-ba53-5ead9104683c tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:57:23 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-171eb82a-8213-485a-ba53-5ead9104683c tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Deleted volume successfully. Aug 11 04:57:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-3b85d59b-0e59-4f06-abf9-39db7288c69e tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Acquiring lock "cinder-quobyte-4b8e487f-a551-4c3d-b224-531407eff038" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-171eb82a-8213-485a-ba53-5ead9104683c tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "cinder-75c00221-f835-4022-a026-eae82a4b0d12-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-3b85d59b-0e59-4f06-abf9-39db7288c69e tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "cinder-quobyte-4b8e487f-a551-4c3d-b224-531407eff038" acquired by "delete_volume" :: waited 0.040s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:23 devstack sudo[115174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17832647-6d92-42bb-ae3c-327529a76c9d Aug 11 04:57:23 devstack sudo[115174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:23 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a377cca-1653-4aff-9aa2-68da1fca774b]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:57:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3b85d59b-0e59-4f06-abf9-39db7288c69e tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-4b8e487f-a551-4c3d-b224-531407eff038 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:23 devstack sudo[115170]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c078e160-fb87-43bb-a985-f0b1d3125bb0 tempest-VolumeDependencyTests-568526517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8.4ab295a0-8281-4d8f-9870-4c64a0d1e19d" returned: 0 in 0.560s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c078e160-fb87-43bb-a985-f0b1d3125bb0 tempest-VolumeDependencyTests-568526517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8.4ab295a0-8281-4d8f-9870-4c64a0d1e19d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:23 devstack sudo[115184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8.4ab295a0-8281-4d8f-9870-4c64a0d1e19d Aug 11 04:57:23 devstack sudo[115184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:23 devstack sudo[115183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-4b8e487f-a551-4c3d-b224-531407eff038 Aug 11 04:57:23 devstack sudo[115183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:23 devstack sudo[115174]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e0402f77-d5a7-4c59-a8ca-8167a7e4b9b9 tempest-CreateVolumesFromSnapshotTest-363080733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17832647-6d92-42bb-ae3c-327529a76c9d" returned: 0 in 0.453s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e0402f77-d5a7-4c59-a8ca-8167a7e4b9b9 tempest-CreateVolumesFromSnapshotTest-363080733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17832647-6d92-42bb-ae3c-327529a76c9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17832647-6d92-42bb-ae3c-327529a76c9d.357401bf-81ab-4671-ad0d-2f25813df791 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:23 devstack sudo[115191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17832647-6d92-42bb-ae3c-327529a76c9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17832647-6d92-42bb-ae3c-327529a76c9d.357401bf-81ab-4671-ad0d-2f25813df791 1G Aug 11 04:57:23 devstack sudo[115191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:23 devstack sudo[115184]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c078e160-fb87-43bb-a985-f0b1d3125bb0 tempest-VolumeDependencyTests-568526517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8.4ab295a0-8281-4d8f-9870-4c64a0d1e19d" returned: 0 in 0.313s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c078e160-fb87-43bb-a985-f0b1d3125bb0 tempest-VolumeDependencyTests-568526517 None] Lock "cinder-quobyte-4ab295a0-8281-4d8f-9870-4c64a0d1e19d" released by "_delete_snapshot" :: held 2.128s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c078e160-fb87-43bb-a985-f0b1d3125bb0 tempest-VolumeDependencyTests-568526517 None] Lock "cinder-quobyte-e2ac593a-392e-4cfd-9b19-a0f453f56bd8" released by "delete_snapshot" :: held 2.177s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:23 devstack sudo[115183]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3b85d59b-0e59-4f06-abf9-39db7288c69e tempest-CreateVolumesFromSourceVolumeTest-986996286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-4b8e487f-a551-4c3d-b224-531407eff038" returned: 0 in 0.501s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3b85d59b-0e59-4f06-abf9-39db7288c69e tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-4b8e487f-a551-4c3d-b224-531407eff038 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:23 devstack sudo[115197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-4b8e487f-a551-4c3d-b224-531407eff038 Aug 11 04:57:23 devstack sudo[115197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:23 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-c078e160-fb87-43bb-a985-f0b1d3125bb0 tempest-VolumeDependencyTests-568526517 None] Created reservations ['772e5369-affd-46c3-9e91-9a6bafcac37f', 'bb8a0438-444d-477e-aab8-fa3c596fd690', 'f4f39697-9463-4b6d-812c-133321415988', '0657d97b-5ed6-42e9-bfe7-266195bfb42d'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:57:23 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-c078e160-fb87-43bb-a985-f0b1d3125bb0 tempest-VolumeDependencyTests-568526517 None] Delete snapshot completed successfully. Aug 11 04:57:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c078e160-fb87-43bb-a985-f0b1d3125bb0 tempest-VolumeDependencyTests-568526517 None] Lock "cinder-4ab295a0-8281-4d8f-9870-4c64a0d1e19d-delete_snapshot" released by "delete_snapshot" :: held 2.383s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:24 devstack sudo[115197]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3b85d59b-0e59-4f06-abf9-39db7288c69e tempest-CreateVolumesFromSourceVolumeTest-986996286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-4b8e487f-a551-4c3d-b224-531407eff038" returned: 0 in 0.283s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:24 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-3b85d59b-0e59-4f06-abf9-39db7288c69e tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "cinder-quobyte-4b8e487f-a551-4c3d-b224-531407eff038" released by "delete_volume" :: held 0.835s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:24 devstack sudo[115191]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e0402f77-d5a7-4c59-a8ca-8167a7e4b9b9 tempest-CreateVolumesFromSnapshotTest-363080733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17832647-6d92-42bb-ae3c-327529a76c9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17832647-6d92-42bb-ae3c-327529a76c9d.357401bf-81ab-4671-ad0d-2f25813df791 1G" returned: 0 in 0.530s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e0402f77-d5a7-4c59-a8ca-8167a7e4b9b9 tempest-CreateVolumesFromSnapshotTest-363080733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17832647-6d92-42bb-ae3c-327529a76c9d -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17832647-6d92-42bb-ae3c-327529a76c9d.357401bf-81ab-4671-ad0d-2f25813df791 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:24 devstack sudo[115204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17832647-6d92-42bb-ae3c-327529a76c9d -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17832647-6d92-42bb-ae3c-327529a76c9d.357401bf-81ab-4671-ad0d-2f25813df791 Aug 11 04:57:24 devstack sudo[115204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:24 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-3b85d59b-0e59-4f06-abf9-39db7288c69e tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Created reservations ['5f4ab2a1-d659-4de3-bd52-518bb6306b3b', 'd111804a-470f-4998-849f-c53fd7e16fed', '941c1e4d-ee57-4efa-98a4-9451825e1014', '0d205e8b-7793-4571-b46e-5bffc4878f3c'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:57:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3b85d59b-0e59-4f06-abf9-39db7288c69e tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3b85d59b-0e59-4f06-abf9-39db7288c69e tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3b85d59b-0e59-4f06-abf9-39db7288c69e tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:57:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3b85d59b-0e59-4f06-abf9-39db7288c69e tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:57:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3b85d59b-0e59-4f06-abf9-39db7288c69e tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3b85d59b-0e59-4f06-abf9-39db7288c69e tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:24 devstack sudo[115206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:57:24 devstack sudo[115206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:24 devstack sudo[115204]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e0402f77-d5a7-4c59-a8ca-8167a7e4b9b9 tempest-CreateVolumesFromSnapshotTest-363080733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17832647-6d92-42bb-ae3c-327529a76c9d -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17832647-6d92-42bb-ae3c-327529a76c9d.357401bf-81ab-4671-ad0d-2f25813df791" returned: 0 in 0.400s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:24 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-e0402f77-d5a7-4c59-a8ca-8167a7e4b9b9 tempest-CreateVolumesFromSnapshotTest-363080733 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17832647-6d92-42bb-ae3c-327529a76c9d.357401bf-81ab-4671-ad0d-2f25813df791 is being set with open permissions: ugo+rw Aug 11 04:57:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e0402f77-d5a7-4c59-a8ca-8167a7e4b9b9 tempest-CreateVolumesFromSnapshotTest-363080733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17832647-6d92-42bb-ae3c-327529a76c9d.357401bf-81ab-4671-ad0d-2f25813df791 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:24 devstack sudo[115213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17832647-6d92-42bb-ae3c-327529a76c9d.357401bf-81ab-4671-ad0d-2f25813df791 Aug 11 04:57:24 devstack sudo[115213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:24 devstack sudo[115206]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3b85d59b-0e59-4f06-abf9-39db7288c69e tempest-CreateVolumesFromSourceVolumeTest-986996286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.310s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:24 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-3b85d59b-0e59-4f06-abf9-39db7288c69e tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:57:24 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-3b85d59b-0e59-4f06-abf9-39db7288c69e tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Deleted volume successfully. Aug 11 04:57:24 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-3b85d59b-0e59-4f06-abf9-39db7288c69e tempest-CreateVolumesFromSourceVolumeTest-986996286 None] Lock "cinder-4b8e487f-a551-4c3d-b224-531407eff038-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:24 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a8510263-cbfa-45cd-aad3-68cc5606a4fa tempest-VolumeDependencyTests-568526517 None] Acquiring lock "cinder-e2ac593a-392e-4cfd-9b19-a0f453f56bd8-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:24 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a8510263-cbfa-45cd-aad3-68cc5606a4fa tempest-VolumeDependencyTests-568526517 None] Lock "cinder-e2ac593a-392e-4cfd-9b19-a0f453f56bd8-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:24 devstack sudo[115213]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:24 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a8510263-cbfa-45cd-aad3-68cc5606a4fa tempest-VolumeDependencyTests-568526517 None] Acquiring lock "cinder-quobyte-e2ac593a-392e-4cfd-9b19-a0f453f56bd8" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e0402f77-d5a7-4c59-a8ca-8167a7e4b9b9 tempest-CreateVolumesFromSnapshotTest-363080733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17832647-6d92-42bb-ae3c-327529a76c9d.357401bf-81ab-4671-ad0d-2f25813df791" returned: 0 in 0.305s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:24 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a8510263-cbfa-45cd-aad3-68cc5606a4fa tempest-VolumeDependencyTests-568526517 None] Lock "cinder-quobyte-e2ac593a-392e-4cfd-9b19-a0f453f56bd8" acquired by "delete_volume" :: waited 0.023s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:24 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[55753bb9-f5cb-4e7f-a226-fbcc24a71068]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:57:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a8510263-cbfa-45cd-aad3-68cc5606a4fa tempest-VolumeDependencyTests-568526517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e0402f77-d5a7-4c59-a8ca-8167a7e4b9b9 tempest-CreateVolumesFromSnapshotTest-363080733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17832647-6d92-42bb-ae3c-327529a76c9d.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:24 devstack sudo[115217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17832647-6d92-42bb-ae3c-327529a76c9d.info Aug 11 04:57:24 devstack sudo[115217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:24 devstack sudo[115216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8 Aug 11 04:57:25 devstack sudo[115216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:25 devstack sudo[115217]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e0402f77-d5a7-4c59-a8ca-8167a7e4b9b9 tempest-CreateVolumesFromSnapshotTest-363080733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17832647-6d92-42bb-ae3c-327529a76c9d.info" returned: 0 in 0.358s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:25 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-e0402f77-d5a7-4c59-a8ca-8167a7e4b9b9 tempest-CreateVolumesFromSnapshotTest-363080733 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17832647-6d92-42bb-ae3c-327529a76c9d.info is being set with open permissions: ugo+rw Aug 11 04:57:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e0402f77-d5a7-4c59-a8ca-8167a7e4b9b9 tempest-CreateVolumesFromSnapshotTest-363080733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17832647-6d92-42bb-ae3c-327529a76c9d.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:25 devstack sudo[115227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17832647-6d92-42bb-ae3c-327529a76c9d.info Aug 11 04:57:25 devstack sudo[115227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:25 devstack sudo[115216]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a8510263-cbfa-45cd-aad3-68cc5606a4fa tempest-VolumeDependencyTests-568526517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8" returned: 0 in 0.522s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a8510263-cbfa-45cd-aad3-68cc5606a4fa tempest-VolumeDependencyTests-568526517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:25 devstack sudo[115233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8 Aug 11 04:57:25 devstack sudo[115233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:25 devstack sudo[115227]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e0402f77-d5a7-4c59-a8ca-8167a7e4b9b9 tempest-CreateVolumesFromSnapshotTest-363080733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17832647-6d92-42bb-ae3c-327529a76c9d.info" returned: 0 in 0.318s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e0402f77-d5a7-4c59-a8ca-8167a7e4b9b9 tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.595s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:25 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-e0402f77-d5a7-4c59-a8ca-8167a7e4b9b9 tempest-CreateVolumesFromSnapshotTest-363080733 None] Create snapshot completed successfully Aug 11 04:57:25 devstack sudo[115233]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a8510263-cbfa-45cd-aad3-68cc5606a4fa tempest-VolumeDependencyTests-568526517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e2ac593a-392e-4cfd-9b19-a0f453f56bd8" returned: 0 in 0.321s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a8510263-cbfa-45cd-aad3-68cc5606a4fa tempest-VolumeDependencyTests-568526517 None] Lock "cinder-quobyte-e2ac593a-392e-4cfd-9b19-a0f453f56bd8" released by "delete_volume" :: held 0.911s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:25 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-a8510263-cbfa-45cd-aad3-68cc5606a4fa tempest-VolumeDependencyTests-568526517 None] Created reservations ['c39df4f7-3dc0-42e4-92ae-424ec40feb49', 'f87571ad-a15a-456a-ab3c-e09d047dc32a', '19e9bc61-9b2b-4c2a-8afe-129f57b3e6ca', '200b7080-209e-45a5-9728-4b92242cf04f'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:57:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a8510263-cbfa-45cd-aad3-68cc5606a4fa tempest-VolumeDependencyTests-568526517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a8510263-cbfa-45cd-aad3-68cc5606a4fa tempest-VolumeDependencyTests-568526517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:25 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a8510263-cbfa-45cd-aad3-68cc5606a4fa tempest-VolumeDependencyTests-568526517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:57:25 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a8510263-cbfa-45cd-aad3-68cc5606a4fa tempest-VolumeDependencyTests-568526517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:57:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a8510263-cbfa-45cd-aad3-68cc5606a4fa tempest-VolumeDependencyTests-568526517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a8510263-cbfa-45cd-aad3-68cc5606a4fa tempest-VolumeDependencyTests-568526517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:25 devstack sudo[115237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:57:25 devstack sudo[115237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fc98edd1-6ce4-436d-b75e-7192bb1b0649 tempest-VolumeDependencyTests-568526517 None] Acquiring lock "cinder-248edb84-4873-4da4-9da5-423dd3c8b493-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:26 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fc98edd1-6ce4-436d-b75e-7192bb1b0649 tempest-VolumeDependencyTests-568526517 None] Lock "cinder-248edb84-4873-4da4-9da5-423dd3c8b493-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:26 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fc98edd1-6ce4-436d-b75e-7192bb1b0649 tempest-VolumeDependencyTests-568526517 None] Acquiring lock "cinder-quobyte-248edb84-4873-4da4-9da5-423dd3c8b493" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:26 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fc98edd1-6ce4-436d-b75e-7192bb1b0649 tempest-VolumeDependencyTests-568526517 None] Lock "cinder-quobyte-248edb84-4873-4da4-9da5-423dd3c8b493" acquired by "delete_volume" :: waited 0.027s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:26 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb4a0f3-3b9d-4217-a695-83b85c078c76]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:57:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fc98edd1-6ce4-436d-b75e-7192bb1b0649 tempest-VolumeDependencyTests-568526517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-248edb84-4873-4da4-9da5-423dd3c8b493 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:26 devstack sudo[115239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-248edb84-4873-4da4-9da5-423dd3c8b493 Aug 11 04:57:26 devstack sudo[115239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:26 devstack sudo[115237]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a8510263-cbfa-45cd-aad3-68cc5606a4fa tempest-VolumeDependencyTests-568526517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.439s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:26 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-a8510263-cbfa-45cd-aad3-68cc5606a4fa tempest-VolumeDependencyTests-568526517 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:57:26 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-a8510263-cbfa-45cd-aad3-68cc5606a4fa tempest-VolumeDependencyTests-568526517 None] Deleted volume successfully. Aug 11 04:57:26 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a8510263-cbfa-45cd-aad3-68cc5606a4fa tempest-VolumeDependencyTests-568526517 None] Lock "cinder-e2ac593a-392e-4cfd-9b19-a0f453f56bd8-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:26 devstack sudo[115239]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fc98edd1-6ce4-436d-b75e-7192bb1b0649 tempest-VolumeDependencyTests-568526517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-248edb84-4873-4da4-9da5-423dd3c8b493" returned: 0 in 0.539s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fc98edd1-6ce4-436d-b75e-7192bb1b0649 tempest-VolumeDependencyTests-568526517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-248edb84-4873-4da4-9da5-423dd3c8b493 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:26 devstack sudo[115245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-248edb84-4873-4da4-9da5-423dd3c8b493 Aug 11 04:57:26 devstack sudo[115245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:26 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ab66042-eee4-4472-a98c-d8f71f299259 tempest-CreateVolumesFromSnapshotTest-363080733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:57:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9ab66042-eee4-4472-a98c-d8f71f299259 tempest-CreateVolumesFromSnapshotTest-363080733 None] Flow 'volume_create_manager' (903e7796-20c5-4b2a-94ef-e94b29cf8495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:57:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9ab66042-eee4-4472-a98c-d8f71f299259 tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78427cc7-8604-470a-b093-aa9d9922c856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9ab66042-eee4-4472-a98c-d8f71f299259 tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78427cc7-8604-470a-b093-aa9d9922c856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1438182778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6501288a-70a5-438e-a55e-9c7ca3f85492,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='374985e9117444e5ab2e2ae93f2e06e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:57:27Z,use_quota=True,user_id='482bf3ec5a074681ba2ff543f830c769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9ab66042-eee4-4472-a98c-d8f71f299259 tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8884f86-f4eb-4863-a2a8-490d80c0d766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9ab66042-eee4-4472-a98c-d8f71f299259 tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8884f86-f4eb-4863-a2a8-490d80c0d766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9ab66042-eee4-4472-a98c-d8f71f299259 tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b06ffab9-e424-422f-81a1-652381f1c0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9ab66042-eee4-4472-a98c-d8f71f299259 tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b06ffab9-e424-422f-81a1-652381f1c0e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6501288a-70a5-438e-a55e-9c7ca3f85492', 'volume_name': 'volume-6501288a-70a5-438e-a55e-9c7ca3f85492', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9ab66042-eee4-4472-a98c-d8f71f299259 tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d28708d-0a51-4642-b0d7-1b1181bc4af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9ab66042-eee4-4472-a98c-d8f71f299259 tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d28708d-0a51-4642-b0d7-1b1181bc4af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9ab66042-eee4-4472-a98c-d8f71f299259 tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f4a674e-acf9-4d90-813b-0b1d2c8153ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:27 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-9ab66042-eee4-4472-a98c-d8f71f299259 tempest-CreateVolumesFromSnapshotTest-363080733 None] Volume 6501288a-70a5-438e-a55e-9c7ca3f85492: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6501288a-70a5-438e-a55e-9c7ca3f85492', 'volume_size': 1} Aug 11 04:57:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9ab66042-eee4-4472-a98c-d8f71f299259 tempest-CreateVolumesFromSnapshotTest-363080733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9ab66042-eee4-4472-a98c-d8f71f299259 tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9ab66042-eee4-4472-a98c-d8f71f299259 tempest-CreateVolumesFromSnapshotTest-363080733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1438182778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6501288a-70a5-438e-a55e-9c7ca3f85492,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='374985e9117444e5ab2e2ae93f2e06e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:57:27Z,use_quota=True,user_id='482bf3ec5a074681ba2ff543f830c769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:57:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-9ab66042-eee4-4472-a98c-d8f71f299259 tempest-CreateVolumesFromSnapshotTest-363080733 None] Creating volume 6501288a-70a5-438e-a55e-9c7ca3f85492 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:57:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9ab66042-eee4-4472-a98c-d8f71f299259 tempest-CreateVolumesFromSnapshotTest-363080733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9ab66042-eee4-4472-a98c-d8f71f299259 tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9ab66042-eee4-4472-a98c-d8f71f299259 tempest-CreateVolumesFromSnapshotTest-363080733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:57:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9ab66042-eee4-4472-a98c-d8f71f299259 tempest-CreateVolumesFromSnapshotTest-363080733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:57:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9ab66042-eee4-4472-a98c-d8f71f299259 tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9ab66042-eee4-4472-a98c-d8f71f299259 tempest-CreateVolumesFromSnapshotTest-363080733 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:57:27 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-9ab66042-eee4-4472-a98c-d8f71f299259 tempest-CreateVolumesFromSnapshotTest-363080733 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:57:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9ab66042-eee4-4472-a98c-d8f71f299259 tempest-CreateVolumesFromSnapshotTest-363080733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6501288a-70a5-438e-a55e-9c7ca3f85492 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:27 devstack sudo[115245]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fc98edd1-6ce4-436d-b75e-7192bb1b0649 tempest-VolumeDependencyTests-568526517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-248edb84-4873-4da4-9da5-423dd3c8b493" returned: 0 in 0.454s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:27 devstack sudo[115248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6501288a-70a5-438e-a55e-9c7ca3f85492 1073741824 Aug 11 04:57:27 devstack sudo[115248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:27 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fc98edd1-6ce4-436d-b75e-7192bb1b0649 tempest-VolumeDependencyTests-568526517 None] Lock "cinder-quobyte-248edb84-4873-4da4-9da5-423dd3c8b493" released by "delete_volume" :: held 1.064s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:27 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-fc98edd1-6ce4-436d-b75e-7192bb1b0649 tempest-VolumeDependencyTests-568526517 None] Created reservations ['6fb81494-913f-4711-8133-d6e4c13dc98a', '6aacfec4-75d7-480c-ba68-421f1f71ced2', 'eaa460f8-f8b1-47aa-9d58-e0cfef6a7212', 'e8dc38b1-7787-4aea-b1ad-55082155d8bd'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:57:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fc98edd1-6ce4-436d-b75e-7192bb1b0649 tempest-VolumeDependencyTests-568526517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fc98edd1-6ce4-436d-b75e-7192bb1b0649 tempest-VolumeDependencyTests-568526517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-fc98edd1-6ce4-436d-b75e-7192bb1b0649 tempest-VolumeDependencyTests-568526517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:57:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-fc98edd1-6ce4-436d-b75e-7192bb1b0649 tempest-VolumeDependencyTests-568526517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:57:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fc98edd1-6ce4-436d-b75e-7192bb1b0649 tempest-VolumeDependencyTests-568526517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fc98edd1-6ce4-436d-b75e-7192bb1b0649 tempest-VolumeDependencyTests-568526517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:27 devstack sudo[115250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:57:27 devstack sudo[115250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:27 devstack sudo[115248]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9ab66042-eee4-4472-a98c-d8f71f299259 tempest-CreateVolumesFromSnapshotTest-363080733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6501288a-70a5-438e-a55e-9c7ca3f85492 1073741824" returned: 0 in 0.669s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:27 devstack sudo[115250]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fc98edd1-6ce4-436d-b75e-7192bb1b0649 tempest-VolumeDependencyTests-568526517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.414s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:27 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-fc98edd1-6ce4-436d-b75e-7192bb1b0649 tempest-VolumeDependencyTests-568526517 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:57:27 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-fc98edd1-6ce4-436d-b75e-7192bb1b0649 tempest-VolumeDependencyTests-568526517 None] Deleted volume successfully. Aug 11 04:57:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9ab66042-eee4-4472-a98c-d8f71f299259 tempest-CreateVolumesFromSnapshotTest-363080733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6501288a-70a5-438e-a55e-9c7ca3f85492 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:27 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fc98edd1-6ce4-436d-b75e-7192bb1b0649 tempest-VolumeDependencyTests-568526517 None] Lock "cinder-248edb84-4873-4da4-9da5-423dd3c8b493-delete_volume" released by "delete_volume" :: held 1.815s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:27 devstack sudo[115258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6501288a-70a5-438e-a55e-9c7ca3f85492 Aug 11 04:57:27 devstack sudo[115258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:27 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-01b03c07-d2c9-4ac5-b2b8-2b6cce4972fe tempest-CinderUnicodeTest-216449796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:57:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-01b03c07-d2c9-4ac5-b2b8-2b6cce4972fe tempest-CinderUnicodeTest-216449796 None] Flow 'volume_create_manager' (6feae5d2-e18a-4e0d-b20f-20a983ea989d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:57:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-01b03c07-d2c9-4ac5-b2b8-2b6cce4972fe tempest-CinderUnicodeTest-216449796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43a9fd31-c28e-4764-b386-38d37922a5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-01b03c07-d2c9-4ac5-b2b8-2b6cce4972fe tempest-CinderUnicodeTest-216449796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43a9fd31-c28e-4764-b386-38d37922a5fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2c43edb-ef0b-4353-9c2d-15f4e1732667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b7161be0de643229706262970919f0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:57:28Z,use_quota=True,user_id='2ebed212c0c348aa86a07b56d2a8798f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-01b03c07-d2c9-4ac5-b2b8-2b6cce4972fe tempest-CinderUnicodeTest-216449796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afc87de2-cd41-4fab-9bdb-ddc2c422142b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-01b03c07-d2c9-4ac5-b2b8-2b6cce4972fe tempest-CinderUnicodeTest-216449796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afc87de2-cd41-4fab-9bdb-ddc2c422142b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-01b03c07-d2c9-4ac5-b2b8-2b6cce4972fe tempest-CinderUnicodeTest-216449796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e831f97c-144c-4b07-982a-5aa49c680c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-01b03c07-d2c9-4ac5-b2b8-2b6cce4972fe tempest-CinderUnicodeTest-216449796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e831f97c-144c-4b07-982a-5aa49c680c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2c43edb-ef0b-4353-9c2d-15f4e1732667', 'volume_name': 'volume-c2c43edb-ef0b-4353-9c2d-15f4e1732667', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-01b03c07-d2c9-4ac5-b2b8-2b6cce4972fe tempest-CinderUnicodeTest-216449796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (665a05cf-056a-4a8f-ad82-81a6d531a266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-01b03c07-d2c9-4ac5-b2b8-2b6cce4972fe tempest-CinderUnicodeTest-216449796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (665a05cf-056a-4a8f-ad82-81a6d531a266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-01b03c07-d2c9-4ac5-b2b8-2b6cce4972fe tempest-CinderUnicodeTest-216449796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c3ce91a-2edf-40dc-b5de-d308aec14a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:28 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-01b03c07-d2c9-4ac5-b2b8-2b6cce4972fe tempest-CinderUnicodeTest-216449796 None] Volume c2c43edb-ef0b-4353-9c2d-15f4e1732667: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2c43edb-ef0b-4353-9c2d-15f4e1732667', 'volume_size': 1} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-01b03c07-d2c9-4ac5-b2b8-2b6cce4972fe tempest-CinderUnicodeTest-216449796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-17fe07c9-6bad-4ea0-a1a6-954a75c39819 tempest-CreateVolumesFromSnapshotTest-363080733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:57:28 devstack sudo[115258]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-17fe07c9-6bad-4ea0-a1a6-954a75c39819 tempest-CreateVolumesFromSnapshotTest-363080733 None] Flow 'volume_create_manager' (f71982ad-9040-4d09-ac36-eb81bc87cf61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-17fe07c9-6bad-4ea0-a1a6-954a75c39819 tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee07f556-1c5a-4bc7-86f9-fed6638b4500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9ab66042-eee4-4472-a98c-d8f71f299259 tempest-CreateVolumesFromSnapshotTest-363080733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6501288a-70a5-438e-a55e-9c7ca3f85492" returned: 0 in 0.361s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9ab66042-eee4-4472-a98c-d8f71f299259 tempest-CreateVolumesFromSnapshotTest-363080733 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9ab66042-eee4-4472-a98c-d8f71f299259 tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-17fe07c9-6bad-4ea0-a1a6-954a75c39819 tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee07f556-1c5a-4bc7-86f9-fed6638b4500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1996386940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23df5ae1-f87d-4962-98ef-464d7a339d14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='374985e9117444e5ab2e2ae93f2e06e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:57:28Z,use_quota=True,user_id='482bf3ec5a074681ba2ff543f830c769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-17fe07c9-6bad-4ea0-a1a6-954a75c39819 tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d8f7834-d84d-4c57-ab45-1611f207de78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-17fe07c9-6bad-4ea0-a1a6-954a75c39819 tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d8f7834-d84d-4c57-ab45-1611f207de78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-17fe07c9-6bad-4ea0-a1a6-954a75c39819 tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8582bc55-4591-4ed3-930b-6e02526b5e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-17fe07c9-6bad-4ea0-a1a6-954a75c39819 tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8582bc55-4591-4ed3-930b-6e02526b5e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23df5ae1-f87d-4962-98ef-464d7a339d14', 'volume_name': 'volume-23df5ae1-f87d-4962-98ef-464d7a339d14', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-17fe07c9-6bad-4ea0-a1a6-954a75c39819 tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46077464-a56e-48c1-a44f-87c4068f9105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-17fe07c9-6bad-4ea0-a1a6-954a75c39819 tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46077464-a56e-48c1-a44f-87c4068f9105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-17fe07c9-6bad-4ea0-a1a6-954a75c39819 tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6a9936c-fa1d-4628-bd9d-4c1fd82b0704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:28 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-17fe07c9-6bad-4ea0-a1a6-954a75c39819 tempest-CreateVolumesFromSnapshotTest-363080733 None] Volume 23df5ae1-f87d-4962-98ef-464d7a339d14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23df5ae1-f87d-4962-98ef-464d7a339d14', 'volume_size': 1} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-17fe07c9-6bad-4ea0-a1a6-954a75c39819 tempest-CreateVolumesFromSnapshotTest-363080733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-17fe07c9-6bad-4ea0-a1a6-954a75c39819 tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-17fe07c9-6bad-4ea0-a1a6-954a75c39819 tempest-CreateVolumesFromSnapshotTest-363080733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1996386940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23df5ae1-f87d-4962-98ef-464d7a339d14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='374985e9117444e5ab2e2ae93f2e06e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:57:28Z,use_quota=True,user_id='482bf3ec5a074681ba2ff543f830c769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-17fe07c9-6bad-4ea0-a1a6-954a75c39819 tempest-CreateVolumesFromSnapshotTest-363080733 None] Creating volume 23df5ae1-f87d-4962-98ef-464d7a339d14 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-17fe07c9-6bad-4ea0-a1a6-954a75c39819 tempest-CreateVolumesFromSnapshotTest-363080733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-17fe07c9-6bad-4ea0-a1a6-954a75c39819 tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-17fe07c9-6bad-4ea0-a1a6-954a75c39819 tempest-CreateVolumesFromSnapshotTest-363080733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-17fe07c9-6bad-4ea0-a1a6-954a75c39819 tempest-CreateVolumesFromSnapshotTest-363080733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-17fe07c9-6bad-4ea0-a1a6-954a75c39819 tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-17fe07c9-6bad-4ea0-a1a6-954a75c39819 tempest-CreateVolumesFromSnapshotTest-363080733 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:57:28 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-17fe07c9-6bad-4ea0-a1a6-954a75c39819 tempest-CreateVolumesFromSnapshotTest-363080733 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-17fe07c9-6bad-4ea0-a1a6-954a75c39819 tempest-CreateVolumesFromSnapshotTest-363080733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23df5ae1-f87d-4962-98ef-464d7a339d14 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9ab66042-eee4-4472-a98c-d8f71f299259 tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f4a674e-acf9-4d90-813b-0b1d2c8153ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6501288a-70a5-438e-a55e-9c7ca3f85492', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:28 devstack sudo[115261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23df5ae1-f87d-4962-98ef-464d7a339d14 1073741824 Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9ab66042-eee4-4472-a98c-d8f71f299259 tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5be23fc1-e12e-409c-aef3-f3dff1ae50cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:28 devstack sudo[115261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-28b32f91-3e36-4edd-bd29-fffa3870765d tempest-CreateVolumesFromSnapshotTest-363080733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-28b32f91-3e36-4edd-bd29-fffa3870765d tempest-CreateVolumesFromSnapshotTest-363080733 None] Flow 'volume_create_manager' (07978c69-549d-4695-b044-24486afe65e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-28b32f91-3e36-4edd-bd29-fffa3870765d tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ecd9fc8-6256-480e-9e26-fcf9cd1d613e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-28b32f91-3e36-4edd-bd29-fffa3870765d tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ecd9fc8-6256-480e-9e26-fcf9cd1d613e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1696467394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=138c600b-39b7-45d8-9594-e8db9857ca96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='374985e9117444e5ab2e2ae93f2e06e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:57:28Z,use_quota=True,user_id='482bf3ec5a074681ba2ff543f830c769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-28b32f91-3e36-4edd-bd29-fffa3870765d tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5debeea5-0fe4-4446-85c3-9daad4e8f877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-28b32f91-3e36-4edd-bd29-fffa3870765d tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5debeea5-0fe4-4446-85c3-9daad4e8f877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-28b32f91-3e36-4edd-bd29-fffa3870765d tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7c05c11-8173-456e-aeb1-df4ffc91de18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-28b32f91-3e36-4edd-bd29-fffa3870765d tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7c05c11-8173-456e-aeb1-df4ffc91de18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '138c600b-39b7-45d8-9594-e8db9857ca96', 'volume_name': 'volume-138c600b-39b7-45d8-9594-e8db9857ca96', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-28b32f91-3e36-4edd-bd29-fffa3870765d tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec25653b-bbba-492f-b461-f54197868404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-28b32f91-3e36-4edd-bd29-fffa3870765d tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec25653b-bbba-492f-b461-f54197868404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-28b32f91-3e36-4edd-bd29-fffa3870765d tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fd2390f-094e-468e-b8d3-9a2e352657f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:28 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-28b32f91-3e36-4edd-bd29-fffa3870765d tempest-CreateVolumesFromSnapshotTest-363080733 None] Volume 138c600b-39b7-45d8-9594-e8db9857ca96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-138c600b-39b7-45d8-9594-e8db9857ca96', 'volume_size': 1} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-28b32f91-3e36-4edd-bd29-fffa3870765d tempest-CreateVolumesFromSnapshotTest-363080733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:28 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-9ab66042-eee4-4472-a98c-d8f71f299259 tempest-CreateVolumesFromSnapshotTest-363080733 None] Volume volume-6501288a-70a5-438e-a55e-9c7ca3f85492 (6501288a-70a5-438e-a55e-9c7ca3f85492): created successfully Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9ab66042-eee4-4472-a98c-d8f71f299259 tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5be23fc1-e12e-409c-aef3-f3dff1ae50cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9ab66042-eee4-4472-a98c-d8f71f299259 tempest-CreateVolumesFromSnapshotTest-363080733 None] Flow 'volume_create_manager' (903e7796-20c5-4b2a-94ef-e94b29cf8495) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:57:28 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-9ab66042-eee4-4472-a98c-d8f71f299259 tempest-CreateVolumesFromSnapshotTest-363080733 None] Created volume successfully. Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-85a4b766-acdd-41d9-a065-111ca05601be tempest-CreateVolumesFromSnapshotTest-363080733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-85a4b766-acdd-41d9-a065-111ca05601be tempest-CreateVolumesFromSnapshotTest-363080733 None] Flow 'volume_create_manager' (1c475f67-f982-4662-a55d-b55b98e86d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-85a4b766-acdd-41d9-a065-111ca05601be tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffed2c1f-1303-44c4-94e6-839c63abca0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-85a4b766-acdd-41d9-a065-111ca05601be tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffed2c1f-1303-44c4-94e6-839c63abca0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-990036208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a237e74-cd63-4db6-b36c-801899446f3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='374985e9117444e5ab2e2ae93f2e06e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:57:29Z,use_quota=True,user_id='482bf3ec5a074681ba2ff543f830c769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-85a4b766-acdd-41d9-a065-111ca05601be tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c407cfe-d7b5-4249-aa5e-85f02c713b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-85a4b766-acdd-41d9-a065-111ca05601be tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c407cfe-d7b5-4249-aa5e-85f02c713b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-85a4b766-acdd-41d9-a065-111ca05601be tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49bfea93-6449-41ef-a495-4d90c74538b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-85a4b766-acdd-41d9-a065-111ca05601be tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49bfea93-6449-41ef-a495-4d90c74538b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a237e74-cd63-4db6-b36c-801899446f3e', 'volume_name': 'volume-7a237e74-cd63-4db6-b36c-801899446f3e', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-85a4b766-acdd-41d9-a065-111ca05601be tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0470e428-fdb4-4b01-ad7d-132acfa29c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-85a4b766-acdd-41d9-a065-111ca05601be tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0470e428-fdb4-4b01-ad7d-132acfa29c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-85a4b766-acdd-41d9-a065-111ca05601be tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fec8d5b3-5fca-4d4b-a341-4c3b47ce22a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:28 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-85a4b766-acdd-41d9-a065-111ca05601be tempest-CreateVolumesFromSnapshotTest-363080733 None] Volume 7a237e74-cd63-4db6-b36c-801899446f3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a237e74-cd63-4db6-b36c-801899446f3e', 'volume_size': 1} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-85a4b766-acdd-41d9-a065-111ca05601be tempest-CreateVolumesFromSnapshotTest-363080733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:28 devstack sudo[115261]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-17fe07c9-6bad-4ea0-a1a6-954a75c39819 tempest-CreateVolumesFromSnapshotTest-363080733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23df5ae1-f87d-4962-98ef-464d7a339d14 1073741824" returned: 0 in 0.567s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-17fe07c9-6bad-4ea0-a1a6-954a75c39819 tempest-CreateVolumesFromSnapshotTest-363080733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23df5ae1-f87d-4962-98ef-464d7a339d14 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:28 devstack sudo[115267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23df5ae1-f87d-4962-98ef-464d7a339d14 Aug 11 04:57:28 devstack sudo[115267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:29 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-518f61b9-4ce5-413d-a339-24a0edc77997 tempest-CreateVolumesFromSnapshotTest-363080733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:57:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-518f61b9-4ce5-413d-a339-24a0edc77997 tempest-CreateVolumesFromSnapshotTest-363080733 None] Flow 'volume_create_manager' (5bddd8b0-cadd-4293-8fc9-2a0f096c0d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:57:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-518f61b9-4ce5-413d-a339-24a0edc77997 tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ce6226c-7353-4cdd-92e4-2c95b92fd465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-518f61b9-4ce5-413d-a339-24a0edc77997 tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ce6226c-7353-4cdd-92e4-2c95b92fd465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1127422213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f01d1e0c-b87f-4856-908f-6cdb68a8ffe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='374985e9117444e5ab2e2ae93f2e06e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:57:29Z,use_quota=True,user_id='482bf3ec5a074681ba2ff543f830c769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-518f61b9-4ce5-413d-a339-24a0edc77997 tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fecdf05a-0a03-45c3-a70d-50fbe51fd88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-518f61b9-4ce5-413d-a339-24a0edc77997 tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fecdf05a-0a03-45c3-a70d-50fbe51fd88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-518f61b9-4ce5-413d-a339-24a0edc77997 tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feb354a6-d6ff-4878-bc9a-eef569e0c30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-518f61b9-4ce5-413d-a339-24a0edc77997 tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feb354a6-d6ff-4878-bc9a-eef569e0c30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f01d1e0c-b87f-4856-908f-6cdb68a8ffe4', 'volume_name': 'volume-f01d1e0c-b87f-4856-908f-6cdb68a8ffe4', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-518f61b9-4ce5-413d-a339-24a0edc77997 tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfebf28a-80d3-4fd4-b8e7-96fa8cdc986d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-518f61b9-4ce5-413d-a339-24a0edc77997 tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfebf28a-80d3-4fd4-b8e7-96fa8cdc986d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-518f61b9-4ce5-413d-a339-24a0edc77997 tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0ac28ff-cf4f-4be0-b086-245e545419ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:29 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-518f61b9-4ce5-413d-a339-24a0edc77997 tempest-CreateVolumesFromSnapshotTest-363080733 None] Volume f01d1e0c-b87f-4856-908f-6cdb68a8ffe4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f01d1e0c-b87f-4856-908f-6cdb68a8ffe4', 'volume_size': 1} Aug 11 04:57:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-518f61b9-4ce5-413d-a339-24a0edc77997 tempest-CreateVolumesFromSnapshotTest-363080733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:29 devstack sudo[115267]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-17fe07c9-6bad-4ea0-a1a6-954a75c39819 tempest-CreateVolumesFromSnapshotTest-363080733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23df5ae1-f87d-4962-98ef-464d7a339d14" returned: 0 in 0.339s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:29 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-17fe07c9-6bad-4ea0-a1a6-954a75c39819 tempest-CreateVolumesFromSnapshotTest-363080733 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:57:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-17fe07c9-6bad-4ea0-a1a6-954a75c39819 tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-01b03c07-d2c9-4ac5-b2b8-2b6cce4972fe tempest-CinderUnicodeTest-216449796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.167s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:29 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-01b03c07-d2c9-4ac5-b2b8-2b6cce4972fe tempest-CinderUnicodeTest-216449796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2c43edb-ef0b-4353-9c2d-15f4e1732667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b7161be0de643229706262970919f0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:57:28Z,use_quota=True,user_id='2ebed212c0c348aa86a07b56d2a8798f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:57:29 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-01b03c07-d2c9-4ac5-b2b8-2b6cce4972fe tempest-CinderUnicodeTest-216449796 None] Creating volume c2c43edb-ef0b-4353-9c2d-15f4e1732667 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:57:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-01b03c07-d2c9-4ac5-b2b8-2b6cce4972fe tempest-CinderUnicodeTest-216449796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-01b03c07-d2c9-4ac5-b2b8-2b6cce4972fe tempest-CinderUnicodeTest-216449796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:29 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-01b03c07-d2c9-4ac5-b2b8-2b6cce4972fe tempest-CinderUnicodeTest-216449796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:57:29 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-01b03c07-d2c9-4ac5-b2b8-2b6cce4972fe tempest-CinderUnicodeTest-216449796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:57:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-01b03c07-d2c9-4ac5-b2b8-2b6cce4972fe tempest-CinderUnicodeTest-216449796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:29 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-01b03c07-d2c9-4ac5-b2b8-2b6cce4972fe tempest-CinderUnicodeTest-216449796 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:57:29 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-01b03c07-d2c9-4ac5-b2b8-2b6cce4972fe tempest-CinderUnicodeTest-216449796 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:57:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-01b03c07-d2c9-4ac5-b2b8-2b6cce4972fe tempest-CinderUnicodeTest-216449796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c2c43edb-ef0b-4353-9c2d-15f4e1732667 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-17fe07c9-6bad-4ea0-a1a6-954a75c39819 tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6a9936c-fa1d-4628-bd9d-4c1fd82b0704) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23df5ae1-f87d-4962-98ef-464d7a339d14', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:29 devstack sudo[115270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c2c43edb-ef0b-4353-9c2d-15f4e1732667 1073741824 Aug 11 04:57:29 devstack sudo[115270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-17fe07c9-6bad-4ea0-a1a6-954a75c39819 tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65c45228-c517-4513-930a-fbd80000d356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:29 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-17fe07c9-6bad-4ea0-a1a6-954a75c39819 tempest-CreateVolumesFromSnapshotTest-363080733 None] Volume volume-23df5ae1-f87d-4962-98ef-464d7a339d14 (23df5ae1-f87d-4962-98ef-464d7a339d14): created successfully Aug 11 04:57:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-17fe07c9-6bad-4ea0-a1a6-954a75c39819 tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65c45228-c517-4513-930a-fbd80000d356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-17fe07c9-6bad-4ea0-a1a6-954a75c39819 tempest-CreateVolumesFromSnapshotTest-363080733 None] Flow 'volume_create_manager' (f71982ad-9040-4d09-ac36-eb81bc87cf61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:57:29 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-d99a8eec-cd92-47aa-914d-1dabafd95857 tempest-ProjectMemberTests-792838276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:57:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d99a8eec-cd92-47aa-914d-1dabafd95857 tempest-ProjectMemberTests-792838276 None] Flow 'volume_create_manager' (3e6a86fd-a2b8-4f08-a48b-3d9c44d27294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:57:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d99a8eec-cd92-47aa-914d-1dabafd95857 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab60a484-0340-47c0-ab7d-abb54e4ba70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:29 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-17fe07c9-6bad-4ea0-a1a6-954a75c39819 tempest-CreateVolumesFromSnapshotTest-363080733 None] Created volume successfully. Aug 11 04:57:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d99a8eec-cd92-47aa-914d-1dabafd95857 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab60a484-0340-47c0-ab7d-abb54e4ba70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1209976460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adbb16f0-88da-4d7d-81ca-23a4a97dcf16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac225c2b69784eb6b9ec19178ed3af8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:57:29Z,use_quota=True,user_id='4ce57473867c427a94cf64a00303ce0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d99a8eec-cd92-47aa-914d-1dabafd95857 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f885d196-5511-4589-bb42-fc0366c58a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d99a8eec-cd92-47aa-914d-1dabafd95857 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f885d196-5511-4589-bb42-fc0366c58a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d99a8eec-cd92-47aa-914d-1dabafd95857 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f7f7ff6-d4be-4b6e-9597-8ec25b7515ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d99a8eec-cd92-47aa-914d-1dabafd95857 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f7f7ff6-d4be-4b6e-9597-8ec25b7515ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adbb16f0-88da-4d7d-81ca-23a4a97dcf16', 'volume_name': 'volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d99a8eec-cd92-47aa-914d-1dabafd95857 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37732c46-1d15-4d4e-bf68-904703fe40a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d99a8eec-cd92-47aa-914d-1dabafd95857 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37732c46-1d15-4d4e-bf68-904703fe40a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d99a8eec-cd92-47aa-914d-1dabafd95857 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdf38e5c-3ff1-4bfa-85fa-71e5ce84b16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:29 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-d99a8eec-cd92-47aa-914d-1dabafd95857 tempest-ProjectMemberTests-792838276 None] Volume adbb16f0-88da-4d7d-81ca-23a4a97dcf16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16', 'volume_size': 1} Aug 11 04:57:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d99a8eec-cd92-47aa-914d-1dabafd95857 tempest-ProjectMemberTests-792838276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:29 devstack sudo[115270]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-01b03c07-d2c9-4ac5-b2b8-2b6cce4972fe tempest-CinderUnicodeTest-216449796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c2c43edb-ef0b-4353-9c2d-15f4e1732667 1073741824" returned: 0 in 0.516s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-01b03c07-d2c9-4ac5-b2b8-2b6cce4972fe tempest-CinderUnicodeTest-216449796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c2c43edb-ef0b-4353-9c2d-15f4e1732667 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:29 devstack sudo[115275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c2c43edb-ef0b-4353-9c2d-15f4e1732667 Aug 11 04:57:29 devstack sudo[115275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:30 devstack sudo[115275]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-01b03c07-d2c9-4ac5-b2b8-2b6cce4972fe tempest-CinderUnicodeTest-216449796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c2c43edb-ef0b-4353-9c2d-15f4e1732667" returned: 0 in 0.253s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-01b03c07-d2c9-4ac5-b2b8-2b6cce4972fe tempest-CinderUnicodeTest-216449796 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:57:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-01b03c07-d2c9-4ac5-b2b8-2b6cce4972fe tempest-CinderUnicodeTest-216449796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-28b32f91-3e36-4edd-bd29-fffa3870765d tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.527s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-28b32f91-3e36-4edd-bd29-fffa3870765d tempest-CreateVolumesFromSnapshotTest-363080733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1696467394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=138c600b-39b7-45d8-9594-e8db9857ca96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='374985e9117444e5ab2e2ae93f2e06e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:57:28Z,use_quota=True,user_id='482bf3ec5a074681ba2ff543f830c769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:57:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-28b32f91-3e36-4edd-bd29-fffa3870765d tempest-CreateVolumesFromSnapshotTest-363080733 None] Creating volume 138c600b-39b7-45d8-9594-e8db9857ca96 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:57:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-28b32f91-3e36-4edd-bd29-fffa3870765d tempest-CreateVolumesFromSnapshotTest-363080733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-28b32f91-3e36-4edd-bd29-fffa3870765d tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-28b32f91-3e36-4edd-bd29-fffa3870765d tempest-CreateVolumesFromSnapshotTest-363080733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:57:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-28b32f91-3e36-4edd-bd29-fffa3870765d tempest-CreateVolumesFromSnapshotTest-363080733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:57:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-28b32f91-3e36-4edd-bd29-fffa3870765d tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-28b32f91-3e36-4edd-bd29-fffa3870765d tempest-CreateVolumesFromSnapshotTest-363080733 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:57:30 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-28b32f91-3e36-4edd-bd29-fffa3870765d tempest-CreateVolumesFromSnapshotTest-363080733 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:57:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-28b32f91-3e36-4edd-bd29-fffa3870765d tempest-CreateVolumesFromSnapshotTest-363080733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-138c600b-39b7-45d8-9594-e8db9857ca96 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-01b03c07-d2c9-4ac5-b2b8-2b6cce4972fe tempest-CinderUnicodeTest-216449796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c3ce91a-2edf-40dc-b5de-d308aec14a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2c43edb-ef0b-4353-9c2d-15f4e1732667', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-01b03c07-d2c9-4ac5-b2b8-2b6cce4972fe tempest-CinderUnicodeTest-216449796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ac6809d-8f7f-475a-9730-e70b4fd4f36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:30 devstack sudo[115278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-138c600b-39b7-45d8-9594-e8db9857ca96 1073741824 Aug 11 04:57:30 devstack sudo[115278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:30 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-01b03c07-d2c9-4ac5-b2b8-2b6cce4972fe tempest-CinderUnicodeTest-216449796 None] Volume volume-c2c43edb-ef0b-4353-9c2d-15f4e1732667 (c2c43edb-ef0b-4353-9c2d-15f4e1732667): created successfully Aug 11 04:57:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-01b03c07-d2c9-4ac5-b2b8-2b6cce4972fe tempest-CinderUnicodeTest-216449796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ac6809d-8f7f-475a-9730-e70b4fd4f36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-01b03c07-d2c9-4ac5-b2b8-2b6cce4972fe tempest-CinderUnicodeTest-216449796 None] Flow 'volume_create_manager' (6feae5d2-e18a-4e0d-b20f-20a983ea989d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:57:30 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-01b03c07-d2c9-4ac5-b2b8-2b6cce4972fe tempest-CinderUnicodeTest-216449796 None] Created volume successfully. Aug 11 04:57:30 devstack sudo[115278]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-28b32f91-3e36-4edd-bd29-fffa3870765d tempest-CreateVolumesFromSnapshotTest-363080733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-138c600b-39b7-45d8-9594-e8db9857ca96 1073741824" returned: 0 in 0.475s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-28b32f91-3e36-4edd-bd29-fffa3870765d tempest-CreateVolumesFromSnapshotTest-363080733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-138c600b-39b7-45d8-9594-e8db9857ca96 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:30 devstack sudo[115284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-138c600b-39b7-45d8-9594-e8db9857ca96 Aug 11 04:57:30 devstack sudo[115284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:30 devstack sudo[115284]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-28b32f91-3e36-4edd-bd29-fffa3870765d tempest-CreateVolumesFromSnapshotTest-363080733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-138c600b-39b7-45d8-9594-e8db9857ca96" returned: 0 in 0.298s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-28b32f91-3e36-4edd-bd29-fffa3870765d tempest-CreateVolumesFromSnapshotTest-363080733 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:57:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-28b32f91-3e36-4edd-bd29-fffa3870765d tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-85a4b766-acdd-41d9-a065-111ca05601be tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.201s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-85a4b766-acdd-41d9-a065-111ca05601be tempest-CreateVolumesFromSnapshotTest-363080733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-990036208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a237e74-cd63-4db6-b36c-801899446f3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='374985e9117444e5ab2e2ae93f2e06e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:57:29Z,use_quota=True,user_id='482bf3ec5a074681ba2ff543f830c769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:57:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-85a4b766-acdd-41d9-a065-111ca05601be tempest-CreateVolumesFromSnapshotTest-363080733 None] Creating volume 7a237e74-cd63-4db6-b36c-801899446f3e {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:57:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-85a4b766-acdd-41d9-a065-111ca05601be tempest-CreateVolumesFromSnapshotTest-363080733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-85a4b766-acdd-41d9-a065-111ca05601be tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-85a4b766-acdd-41d9-a065-111ca05601be tempest-CreateVolumesFromSnapshotTest-363080733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:57:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-85a4b766-acdd-41d9-a065-111ca05601be tempest-CreateVolumesFromSnapshotTest-363080733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:57:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-85a4b766-acdd-41d9-a065-111ca05601be tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-85a4b766-acdd-41d9-a065-111ca05601be tempest-CreateVolumesFromSnapshotTest-363080733 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:57:30 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-85a4b766-acdd-41d9-a065-111ca05601be tempest-CreateVolumesFromSnapshotTest-363080733 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:57:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-85a4b766-acdd-41d9-a065-111ca05601be tempest-CreateVolumesFromSnapshotTest-363080733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7a237e74-cd63-4db6-b36c-801899446f3e 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-28b32f91-3e36-4edd-bd29-fffa3870765d tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fd2390f-094e-468e-b8d3-9a2e352657f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-138c600b-39b7-45d8-9594-e8db9857ca96', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-28b32f91-3e36-4edd-bd29-fffa3870765d tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0ab93c2-6554-4af7-9663-d541d7970776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:30 devstack sudo[115287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7a237e74-cd63-4db6-b36c-801899446f3e 1073741824 Aug 11 04:57:30 devstack sudo[115287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:30 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-28b32f91-3e36-4edd-bd29-fffa3870765d tempest-CreateVolumesFromSnapshotTest-363080733 None] Volume volume-138c600b-39b7-45d8-9594-e8db9857ca96 (138c600b-39b7-45d8-9594-e8db9857ca96): created successfully Aug 11 04:57:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-28b32f91-3e36-4edd-bd29-fffa3870765d tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0ab93c2-6554-4af7-9663-d541d7970776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-28b32f91-3e36-4edd-bd29-fffa3870765d tempest-CreateVolumesFromSnapshotTest-363080733 None] Flow 'volume_create_manager' (07978c69-549d-4695-b044-24486afe65e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:57:31 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-28b32f91-3e36-4edd-bd29-fffa3870765d tempest-CreateVolumesFromSnapshotTest-363080733 None] Created volume successfully. Aug 11 04:57:31 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-729064a6-1f71-4489-b02b-63fa49cb99ef tempest-CinderUnicodeTest-216449796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:57:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-729064a6-1f71-4489-b02b-63fa49cb99ef tempest-CinderUnicodeTest-216449796 None] Flow 'volume_create_manager' (736405c1-e860-4638-b840-994de5e15905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:57:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-729064a6-1f71-4489-b02b-63fa49cb99ef tempest-CinderUnicodeTest-216449796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c51d024a-31d7-43f1-b2a7-118826440833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-729064a6-1f71-4489-b02b-63fa49cb99ef tempest-CinderUnicodeTest-216449796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c51d024a-31d7-43f1-b2a7-118826440833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:57:31Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-487593378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cac0b964-645a-4673-b69d-843aa1ec0cff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b7161be0de643229706262970919f0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:57:31Z,use_quota=True,user_id='2ebed212c0c348aa86a07b56d2a8798f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-729064a6-1f71-4489-b02b-63fa49cb99ef tempest-CinderUnicodeTest-216449796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba22ec05-d8b5-4fe8-88cb-3e345ab59c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-729064a6-1f71-4489-b02b-63fa49cb99ef tempest-CinderUnicodeTest-216449796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba22ec05-d8b5-4fe8-88cb-3e345ab59c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-729064a6-1f71-4489-b02b-63fa49cb99ef tempest-CinderUnicodeTest-216449796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c16683e-4bd9-4391-a633-00be8853d535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-729064a6-1f71-4489-b02b-63fa49cb99ef tempest-CinderUnicodeTest-216449796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c16683e-4bd9-4391-a633-00be8853d535) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cac0b964-645a-4673-b69d-843aa1ec0cff', 'volume_name': 'volume-cac0b964-645a-4673-b69d-843aa1ec0cff', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-729064a6-1f71-4489-b02b-63fa49cb99ef tempest-CinderUnicodeTest-216449796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (324d4d39-e155-4520-bfb9-69a9fdfb4c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-729064a6-1f71-4489-b02b-63fa49cb99ef tempest-CinderUnicodeTest-216449796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (324d4d39-e155-4520-bfb9-69a9fdfb4c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-729064a6-1f71-4489-b02b-63fa49cb99ef tempest-CinderUnicodeTest-216449796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (927389b9-5827-4e06-afd9-f2578995b6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:31 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-729064a6-1f71-4489-b02b-63fa49cb99ef tempest-CinderUnicodeTest-216449796 None] Volume cac0b964-645a-4673-b69d-843aa1ec0cff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cac0b964-645a-4673-b69d-843aa1ec0cff', 'volume_size': 1} Aug 11 04:57:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-729064a6-1f71-4489-b02b-63fa49cb99ef tempest-CinderUnicodeTest-216449796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:31 devstack sudo[115287]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-85a4b766-acdd-41d9-a065-111ca05601be tempest-CreateVolumesFromSnapshotTest-363080733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7a237e74-cd63-4db6-b36c-801899446f3e 1073741824" returned: 0 in 0.511s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-85a4b766-acdd-41d9-a065-111ca05601be tempest-CreateVolumesFromSnapshotTest-363080733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7a237e74-cd63-4db6-b36c-801899446f3e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:31 devstack sudo[115294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7a237e74-cd63-4db6-b36c-801899446f3e Aug 11 04:57:31 devstack sudo[115294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:31 devstack sudo[115294]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-85a4b766-acdd-41d9-a065-111ca05601be tempest-CreateVolumesFromSnapshotTest-363080733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7a237e74-cd63-4db6-b36c-801899446f3e" returned: 0 in 0.244s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:31 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-85a4b766-acdd-41d9-a065-111ca05601be tempest-CreateVolumesFromSnapshotTest-363080733 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:57:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-85a4b766-acdd-41d9-a065-111ca05601be tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-518f61b9-4ce5-413d-a339-24a0edc77997 tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.597s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:31 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-518f61b9-4ce5-413d-a339-24a0edc77997 tempest-CreateVolumesFromSnapshotTest-363080733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1127422213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f01d1e0c-b87f-4856-908f-6cdb68a8ffe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='374985e9117444e5ab2e2ae93f2e06e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:57:29Z,use_quota=True,user_id='482bf3ec5a074681ba2ff543f830c769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:57:31 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-518f61b9-4ce5-413d-a339-24a0edc77997 tempest-CreateVolumesFromSnapshotTest-363080733 None] Creating volume f01d1e0c-b87f-4856-908f-6cdb68a8ffe4 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:57:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-518f61b9-4ce5-413d-a339-24a0edc77997 tempest-CreateVolumesFromSnapshotTest-363080733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-518f61b9-4ce5-413d-a339-24a0edc77997 tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:31 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-518f61b9-4ce5-413d-a339-24a0edc77997 tempest-CreateVolumesFromSnapshotTest-363080733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:57:31 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-518f61b9-4ce5-413d-a339-24a0edc77997 tempest-CreateVolumesFromSnapshotTest-363080733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:57:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-518f61b9-4ce5-413d-a339-24a0edc77997 tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:31 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-518f61b9-4ce5-413d-a339-24a0edc77997 tempest-CreateVolumesFromSnapshotTest-363080733 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:57:31 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-518f61b9-4ce5-413d-a339-24a0edc77997 tempest-CreateVolumesFromSnapshotTest-363080733 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:57:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-518f61b9-4ce5-413d-a339-24a0edc77997 tempest-CreateVolumesFromSnapshotTest-363080733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f01d1e0c-b87f-4856-908f-6cdb68a8ffe4 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-85a4b766-acdd-41d9-a065-111ca05601be tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fec8d5b3-5fca-4d4b-a341-4c3b47ce22a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a237e74-cd63-4db6-b36c-801899446f3e', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:31 devstack sudo[115297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f01d1e0c-b87f-4856-908f-6cdb68a8ffe4 1073741824 Aug 11 04:57:31 devstack sudo[115297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-85a4b766-acdd-41d9-a065-111ca05601be tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18914c99-8b4a-461d-803c-7f72bf2a7afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:31 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-85a4b766-acdd-41d9-a065-111ca05601be tempest-CreateVolumesFromSnapshotTest-363080733 None] Volume volume-7a237e74-cd63-4db6-b36c-801899446f3e (7a237e74-cd63-4db6-b36c-801899446f3e): created successfully Aug 11 04:57:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-85a4b766-acdd-41d9-a065-111ca05601be tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18914c99-8b4a-461d-803c-7f72bf2a7afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-85a4b766-acdd-41d9-a065-111ca05601be tempest-CreateVolumesFromSnapshotTest-363080733 None] Flow 'volume_create_manager' (1c475f67-f982-4662-a55d-b55b98e86d34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:57:31 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-85a4b766-acdd-41d9-a065-111ca05601be tempest-CreateVolumesFromSnapshotTest-363080733 None] Created volume successfully. Aug 11 04:57:32 devstack sudo[115297]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-518f61b9-4ce5-413d-a339-24a0edc77997 tempest-CreateVolumesFromSnapshotTest-363080733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f01d1e0c-b87f-4856-908f-6cdb68a8ffe4 1073741824" returned: 0 in 0.466s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-518f61b9-4ce5-413d-a339-24a0edc77997 tempest-CreateVolumesFromSnapshotTest-363080733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f01d1e0c-b87f-4856-908f-6cdb68a8ffe4 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:32 devstack sudo[115303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f01d1e0c-b87f-4856-908f-6cdb68a8ffe4 Aug 11 04:57:32 devstack sudo[115303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:32 devstack sudo[115303]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-518f61b9-4ce5-413d-a339-24a0edc77997 tempest-CreateVolumesFromSnapshotTest-363080733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f01d1e0c-b87f-4856-908f-6cdb68a8ffe4" returned: 0 in 0.262s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-518f61b9-4ce5-413d-a339-24a0edc77997 tempest-CreateVolumesFromSnapshotTest-363080733 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:57:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-518f61b9-4ce5-413d-a339-24a0edc77997 tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d99a8eec-cd92-47aa-914d-1dabafd95857 tempest-ProjectMemberTests-792838276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.047s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d99a8eec-cd92-47aa-914d-1dabafd95857 tempest-ProjectMemberTests-792838276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1209976460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adbb16f0-88da-4d7d-81ca-23a4a97dcf16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac225c2b69784eb6b9ec19178ed3af8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:57:29Z,use_quota=True,user_id='4ce57473867c427a94cf64a00303ce0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:57:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-d99a8eec-cd92-47aa-914d-1dabafd95857 tempest-ProjectMemberTests-792838276 None] Creating volume adbb16f0-88da-4d7d-81ca-23a4a97dcf16 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:57:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d99a8eec-cd92-47aa-914d-1dabafd95857 tempest-ProjectMemberTests-792838276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d99a8eec-cd92-47aa-914d-1dabafd95857 tempest-ProjectMemberTests-792838276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d99a8eec-cd92-47aa-914d-1dabafd95857 tempest-ProjectMemberTests-792838276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:57:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d99a8eec-cd92-47aa-914d-1dabafd95857 tempest-ProjectMemberTests-792838276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:57:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d99a8eec-cd92-47aa-914d-1dabafd95857 tempest-ProjectMemberTests-792838276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d99a8eec-cd92-47aa-914d-1dabafd95857 tempest-ProjectMemberTests-792838276 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:57:32 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-d99a8eec-cd92-47aa-914d-1dabafd95857 tempest-ProjectMemberTests-792838276 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:57:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d99a8eec-cd92-47aa-914d-1dabafd95857 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-518f61b9-4ce5-413d-a339-24a0edc77997 tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0ac28ff-cf4f-4be0-b086-245e545419ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f01d1e0c-b87f-4856-908f-6cdb68a8ffe4', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:32 devstack sudo[115306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16 1073741824 Aug 11 04:57:32 devstack sudo[115306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-518f61b9-4ce5-413d-a339-24a0edc77997 tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6151f6d-1f19-44d5-a91c-1b81f41d7c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:32 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-518f61b9-4ce5-413d-a339-24a0edc77997 tempest-CreateVolumesFromSnapshotTest-363080733 None] Volume volume-f01d1e0c-b87f-4856-908f-6cdb68a8ffe4 (f01d1e0c-b87f-4856-908f-6cdb68a8ffe4): created successfully Aug 11 04:57:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-518f61b9-4ce5-413d-a339-24a0edc77997 tempest-CreateVolumesFromSnapshotTest-363080733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6151f6d-1f19-44d5-a91c-1b81f41d7c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-518f61b9-4ce5-413d-a339-24a0edc77997 tempest-CreateVolumesFromSnapshotTest-363080733 None] Flow 'volume_create_manager' (5bddd8b0-cadd-4293-8fc9-2a0f096c0d50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:57:32 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-518f61b9-4ce5-413d-a339-24a0edc77997 tempest-CreateVolumesFromSnapshotTest-363080733 None] Created volume successfully. Aug 11 04:57:32 devstack sudo[115306]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d99a8eec-cd92-47aa-914d-1dabafd95857 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16 1073741824" returned: 0 in 0.450s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d99a8eec-cd92-47aa-914d-1dabafd95857 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:33 devstack sudo[115312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16 Aug 11 04:57:33 devstack sudo[115312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:33 devstack sudo[115312]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d99a8eec-cd92-47aa-914d-1dabafd95857 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16" returned: 0 in 0.259s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:33 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d99a8eec-cd92-47aa-914d-1dabafd95857 tempest-ProjectMemberTests-792838276 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:57:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d99a8eec-cd92-47aa-914d-1dabafd95857 tempest-ProjectMemberTests-792838276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-729064a6-1f71-4489-b02b-63fa49cb99ef tempest-CinderUnicodeTest-216449796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.883s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:33 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-729064a6-1f71-4489-b02b-63fa49cb99ef tempest-CinderUnicodeTest-216449796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:57:31Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-487593378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cac0b964-645a-4673-b69d-843aa1ec0cff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b7161be0de643229706262970919f0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:57:31Z,use_quota=True,user_id='2ebed212c0c348aa86a07b56d2a8798f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:57:33 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-729064a6-1f71-4489-b02b-63fa49cb99ef tempest-CinderUnicodeTest-216449796 None] Creating volume cac0b964-645a-4673-b69d-843aa1ec0cff {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:57:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-729064a6-1f71-4489-b02b-63fa49cb99ef tempest-CinderUnicodeTest-216449796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-729064a6-1f71-4489-b02b-63fa49cb99ef tempest-CinderUnicodeTest-216449796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:33 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-729064a6-1f71-4489-b02b-63fa49cb99ef tempest-CinderUnicodeTest-216449796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:57:33 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-729064a6-1f71-4489-b02b-63fa49cb99ef tempest-CinderUnicodeTest-216449796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:57:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-729064a6-1f71-4489-b02b-63fa49cb99ef tempest-CinderUnicodeTest-216449796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:33 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-729064a6-1f71-4489-b02b-63fa49cb99ef tempest-CinderUnicodeTest-216449796 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:57:33 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-729064a6-1f71-4489-b02b-63fa49cb99ef tempest-CinderUnicodeTest-216449796 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:57:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-729064a6-1f71-4489-b02b-63fa49cb99ef tempest-CinderUnicodeTest-216449796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cac0b964-645a-4673-b69d-843aa1ec0cff 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d99a8eec-cd92-47aa-914d-1dabafd95857 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdf38e5c-3ff1-4bfa-85fa-71e5ce84b16f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:33 devstack sudo[115315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cac0b964-645a-4673-b69d-843aa1ec0cff 1073741824 Aug 11 04:57:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d99a8eec-cd92-47aa-914d-1dabafd95857 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b386bd7-80a9-451c-a907-f499c810bb65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:33 devstack sudo[115315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:33 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-d99a8eec-cd92-47aa-914d-1dabafd95857 tempest-ProjectMemberTests-792838276 None] Volume volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16 (adbb16f0-88da-4d7d-81ca-23a4a97dcf16): created successfully Aug 11 04:57:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d99a8eec-cd92-47aa-914d-1dabafd95857 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b386bd7-80a9-451c-a907-f499c810bb65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d99a8eec-cd92-47aa-914d-1dabafd95857 tempest-ProjectMemberTests-792838276 None] Flow 'volume_create_manager' (3e6a86fd-a2b8-4f08-a48b-3d9c44d27294) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:57:33 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-d99a8eec-cd92-47aa-914d-1dabafd95857 tempest-ProjectMemberTests-792838276 None] Created volume successfully. Aug 11 04:57:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b887c1ea-69cc-46af-a487-13312a1e9a5c tempest-CreateVolumesFromSnapshotTest-363080733 None] Acquiring lock "cinder-f01d1e0c-b87f-4856-908f-6cdb68a8ffe4-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b887c1ea-69cc-46af-a487-13312a1e9a5c tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "cinder-f01d1e0c-b87f-4856-908f-6cdb68a8ffe4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b887c1ea-69cc-46af-a487-13312a1e9a5c tempest-CreateVolumesFromSnapshotTest-363080733 None] Acquiring lock "cinder-quobyte-f01d1e0c-b87f-4856-908f-6cdb68a8ffe4" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b887c1ea-69cc-46af-a487-13312a1e9a5c tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "cinder-quobyte-f01d1e0c-b87f-4856-908f-6cdb68a8ffe4" acquired by "delete_volume" :: waited 0.016s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:33 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[793ab58b-bcce-4a55-8a1e-6c6b4b502b50]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:57:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b887c1ea-69cc-46af-a487-13312a1e9a5c tempest-CreateVolumesFromSnapshotTest-363080733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f01d1e0c-b87f-4856-908f-6cdb68a8ffe4 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:33 devstack sudo[115321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f01d1e0c-b87f-4856-908f-6cdb68a8ffe4 Aug 11 04:57:33 devstack sudo[115321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:33 devstack sudo[115315]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-729064a6-1f71-4489-b02b-63fa49cb99ef tempest-CinderUnicodeTest-216449796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cac0b964-645a-4673-b69d-843aa1ec0cff 1073741824" returned: 0 in 0.633s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-729064a6-1f71-4489-b02b-63fa49cb99ef tempest-CinderUnicodeTest-216449796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cac0b964-645a-4673-b69d-843aa1ec0cff {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:33 devstack sudo[115326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cac0b964-645a-4673-b69d-843aa1ec0cff Aug 11 04:57:33 devstack sudo[115326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:34 devstack sudo[115321]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b887c1ea-69cc-46af-a487-13312a1e9a5c tempest-CreateVolumesFromSnapshotTest-363080733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f01d1e0c-b87f-4856-908f-6cdb68a8ffe4" returned: 0 in 0.469s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b887c1ea-69cc-46af-a487-13312a1e9a5c tempest-CreateVolumesFromSnapshotTest-363080733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f01d1e0c-b87f-4856-908f-6cdb68a8ffe4 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:34 devstack sudo[115329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f01d1e0c-b87f-4856-908f-6cdb68a8ffe4 Aug 11 04:57:34 devstack sudo[115329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fc7c9a43-b526-454f-89b9-1faea66e873b tempest-ProjectMemberTests-792838276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:34 devstack sudo[115326]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-729064a6-1f71-4489-b02b-63fa49cb99ef tempest-CinderUnicodeTest-216449796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cac0b964-645a-4673-b69d-843aa1ec0cff" returned: 0 in 0.316s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-729064a6-1f71-4489-b02b-63fa49cb99ef tempest-CinderUnicodeTest-216449796 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:57:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-729064a6-1f71-4489-b02b-63fa49cb99ef tempest-CinderUnicodeTest-216449796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fc7c9a43-b526-454f-89b9-1faea66e873b tempest-ProjectMemberTests-792838276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.149s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-729064a6-1f71-4489-b02b-63fa49cb99ef tempest-CinderUnicodeTest-216449796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (927389b9-5827-4e06-afd9-f2578995b6c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cac0b964-645a-4673-b69d-843aa1ec0cff', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-729064a6-1f71-4489-b02b-63fa49cb99ef tempest-CinderUnicodeTest-216449796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52553bf1-a070-4bd8-adb9-314531e0afab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-fc7c9a43-b526-454f-89b9-1faea66e873b tempest-ProjectMemberTests-792838276 None] Creating offline snapshot 35a925c8-75cb-4c4b-83a9-135d88a8f98f of volume adbb16f0-88da-4d7d-81ca-23a4a97dcf16 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 04:57:34 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-729064a6-1f71-4489-b02b-63fa49cb99ef tempest-CinderUnicodeTest-216449796 None] Volume volume-cac0b964-645a-4673-b69d-843aa1ec0cff (cac0b964-645a-4673-b69d-843aa1ec0cff): created successfully Aug 11 04:57:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-729064a6-1f71-4489-b02b-63fa49cb99ef tempest-CinderUnicodeTest-216449796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52553bf1-a070-4bd8-adb9-314531e0afab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-729064a6-1f71-4489-b02b-63fa49cb99ef tempest-CinderUnicodeTest-216449796 None] Flow 'volume_create_manager' (736405c1-e860-4638-b840-994de5e15905) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:57:34 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[d165a4b3-532e-4907-90cc-164af292e9cf]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:57:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fc7c9a43-b526-454f-89b9-1faea66e873b tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:34 devstack sudo[115329]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:34 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-729064a6-1f71-4489-b02b-63fa49cb99ef tempest-CinderUnicodeTest-216449796 None] Created volume successfully. Aug 11 04:57:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b887c1ea-69cc-46af-a487-13312a1e9a5c tempest-CreateVolumesFromSnapshotTest-363080733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f01d1e0c-b87f-4856-908f-6cdb68a8ffe4" returned: 0 in 0.297s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:34 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b887c1ea-69cc-46af-a487-13312a1e9a5c tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "cinder-quobyte-f01d1e0c-b87f-4856-908f-6cdb68a8ffe4" released by "delete_volume" :: held 0.834s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:34 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-b887c1ea-69cc-46af-a487-13312a1e9a5c tempest-CreateVolumesFromSnapshotTest-363080733 None] Created reservations ['9991bc74-2786-4dd8-8a68-5b4eb650d504', 'd1062786-bbae-4c98-9be2-c6613fca8e96', '2255a8de-f77c-4e3e-bbd4-ff10819ff542', 'b35a44f1-b85b-40c2-943b-35220517ba44'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:57:34 devstack sudo[115333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16 Aug 11 04:57:34 devstack sudo[115333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b887c1ea-69cc-46af-a487-13312a1e9a5c tempest-CreateVolumesFromSnapshotTest-363080733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b887c1ea-69cc-46af-a487-13312a1e9a5c tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b887c1ea-69cc-46af-a487-13312a1e9a5c tempest-CreateVolumesFromSnapshotTest-363080733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:57:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b887c1ea-69cc-46af-a487-13312a1e9a5c tempest-CreateVolumesFromSnapshotTest-363080733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:57:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b887c1ea-69cc-46af-a487-13312a1e9a5c tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b887c1ea-69cc-46af-a487-13312a1e9a5c tempest-CreateVolumesFromSnapshotTest-363080733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:34 devstack sudo[115335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:57:34 devstack sudo[115335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:34 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-97938c34-f4ec-434a-932f-b820487c9417 tempest-CreateVolumesFromSnapshotTest-363080733 None] Acquiring lock "cinder-7a237e74-cd63-4db6-b36c-801899446f3e-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:34 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-97938c34-f4ec-434a-932f-b820487c9417 tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "cinder-7a237e74-cd63-4db6-b36c-801899446f3e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:34 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-97938c34-f4ec-434a-932f-b820487c9417 tempest-CreateVolumesFromSnapshotTest-363080733 None] Acquiring lock "cinder-quobyte-7a237e74-cd63-4db6-b36c-801899446f3e" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:34 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-97938c34-f4ec-434a-932f-b820487c9417 tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "cinder-quobyte-7a237e74-cd63-4db6-b36c-801899446f3e" acquired by "delete_volume" :: waited 0.021s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:34 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[57fd6227-b9e8-4b59-b62a-e9fdd8657014]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:57:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-97938c34-f4ec-434a-932f-b820487c9417 tempest-CreateVolumesFromSnapshotTest-363080733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7a237e74-cd63-4db6-b36c-801899446f3e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:34 devstack sudo[115333]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fc7c9a43-b526-454f-89b9-1faea66e873b tempest-ProjectMemberTests-792838276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16" returned: 0 in 0.515s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fc7c9a43-b526-454f-89b9-1faea66e873b tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16.35a925c8-75cb-4c4b-83a9-135d88a8f98f 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:34 devstack sudo[115335]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b887c1ea-69cc-46af-a487-13312a1e9a5c tempest-CreateVolumesFromSnapshotTest-363080733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.332s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:34 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-b887c1ea-69cc-46af-a487-13312a1e9a5c tempest-CreateVolumesFromSnapshotTest-363080733 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:57:34 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-b887c1ea-69cc-46af-a487-13312a1e9a5c tempest-CreateVolumesFromSnapshotTest-363080733 None] Deleted volume successfully. Aug 11 04:57:34 devstack sudo[115342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16.35a925c8-75cb-4c4b-83a9-135d88a8f98f 1G Aug 11 04:57:34 devstack sudo[115342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:34 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b887c1ea-69cc-46af-a487-13312a1e9a5c tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "cinder-f01d1e0c-b87f-4856-908f-6cdb68a8ffe4-delete_volume" released by "delete_volume" :: held 1.417s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:34 devstack sudo[115341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7a237e74-cd63-4db6-b36c-801899446f3e Aug 11 04:57:34 devstack sudo[115341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:35 devstack sudo[115341]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-97938c34-f4ec-434a-932f-b820487c9417 tempest-CreateVolumesFromSnapshotTest-363080733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7a237e74-cd63-4db6-b36c-801899446f3e" returned: 0 in 0.448s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-97938c34-f4ec-434a-932f-b820487c9417 tempest-CreateVolumesFromSnapshotTest-363080733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7a237e74-cd63-4db6-b36c-801899446f3e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:35 devstack sudo[115352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7a237e74-cd63-4db6-b36c-801899446f3e Aug 11 04:57:35 devstack sudo[115352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:35 devstack sudo[115342]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fc7c9a43-b526-454f-89b9-1faea66e873b tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16.35a925c8-75cb-4c4b-83a9-135d88a8f98f 1G" returned: 0 in 0.490s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fc7c9a43-b526-454f-89b9-1faea66e873b tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16.35a925c8-75cb-4c4b-83a9-135d88a8f98f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:35 devstack sudo[115354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16.35a925c8-75cb-4c4b-83a9-135d88a8f98f Aug 11 04:57:35 devstack sudo[115354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:35 devstack sudo[115352]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-97938c34-f4ec-434a-932f-b820487c9417 tempest-CreateVolumesFromSnapshotTest-363080733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-7a237e74-cd63-4db6-b36c-801899446f3e" returned: 0 in 0.276s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:35 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-97938c34-f4ec-434a-932f-b820487c9417 tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "cinder-quobyte-7a237e74-cd63-4db6-b36c-801899446f3e" released by "delete_volume" :: held 0.773s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:35 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-97938c34-f4ec-434a-932f-b820487c9417 tempest-CreateVolumesFromSnapshotTest-363080733 None] Created reservations ['c0356941-df1c-498b-bd84-435ca6d8f347', '3866593f-1dd5-4f0d-8fcc-f0131cf5d020', '669cc8e6-00bf-430f-9c6a-271244857d1f', '07097d3b-bd37-48b6-bba3-a2ef8e2de4d2'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:57:35 devstack sudo[115354]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fc7c9a43-b526-454f-89b9-1faea66e873b tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16.35a925c8-75cb-4c4b-83a9-135d88a8f98f" returned: 0 in 0.385s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:35 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-fc7c9a43-b526-454f-89b9-1faea66e873b tempest-ProjectMemberTests-792838276 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16.35a925c8-75cb-4c4b-83a9-135d88a8f98f is being set with open permissions: ugo+rw Aug 11 04:57:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fc7c9a43-b526-454f-89b9-1faea66e873b tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16.35a925c8-75cb-4c4b-83a9-135d88a8f98f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:35 devstack sudo[115361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16.35a925c8-75cb-4c4b-83a9-135d88a8f98f Aug 11 04:57:35 devstack sudo[115361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-832252f0-d2e8-406f-866d-c33ab188bc08 tempest-CinderUnicodeTest-216449796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-97938c34-f4ec-434a-932f-b820487c9417 tempest-CreateVolumesFromSnapshotTest-363080733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-97938c34-f4ec-434a-932f-b820487c9417 tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:35 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-97938c34-f4ec-434a-932f-b820487c9417 tempest-CreateVolumesFromSnapshotTest-363080733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:57:35 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-97938c34-f4ec-434a-932f-b820487c9417 tempest-CreateVolumesFromSnapshotTest-363080733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:57:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-97938c34-f4ec-434a-932f-b820487c9417 tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-97938c34-f4ec-434a-932f-b820487c9417 tempest-CreateVolumesFromSnapshotTest-363080733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:35 devstack sudo[115363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:57:35 devstack sudo[115363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:36 devstack sudo[115361]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fc7c9a43-b526-454f-89b9-1faea66e873b tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16.35a925c8-75cb-4c4b-83a9-135d88a8f98f" returned: 0 in 0.312s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fc7c9a43-b526-454f-89b9-1faea66e873b tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:36 devstack sudo[115366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16.info Aug 11 04:57:36 devstack sudo[115366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:36 devstack sudo[115363]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-97938c34-f4ec-434a-932f-b820487c9417 tempest-CreateVolumesFromSnapshotTest-363080733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.288s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:36 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-97938c34-f4ec-434a-932f-b820487c9417 tempest-CreateVolumesFromSnapshotTest-363080733 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:57:36 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-97938c34-f4ec-434a-932f-b820487c9417 tempest-CreateVolumesFromSnapshotTest-363080733 None] Deleted volume successfully. Aug 11 04:57:36 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-97938c34-f4ec-434a-932f-b820487c9417 tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "cinder-7a237e74-cd63-4db6-b36c-801899446f3e-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:36 devstack sudo[115366]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fc7c9a43-b526-454f-89b9-1faea66e873b tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16.info" returned: 0 in 0.280s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:36 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-fc7c9a43-b526-454f-89b9-1faea66e873b tempest-ProjectMemberTests-792838276 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16.info is being set with open permissions: ugo+rw Aug 11 04:57:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fc7c9a43-b526-454f-89b9-1faea66e873b tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:36 devstack sudo[115370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16.info Aug 11 04:57:36 devstack sudo[115370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:36 devstack sudo[115370]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fc7c9a43-b526-454f-89b9-1faea66e873b tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16.info" returned: 0 in 0.259s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fc7c9a43-b526-454f-89b9-1faea66e873b tempest-ProjectMemberTests-792838276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.370s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-832252f0-d2e8-406f-866d-c33ab188bc08 tempest-CinderUnicodeTest-216449796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.809s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:36 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-832252f0-d2e8-406f-866d-c33ab188bc08 tempest-CinderUnicodeTest-216449796 None] Creating offline snapshot 16bf8a63-5e58-4046-9215-f5d377f40d71 of volume cac0b964-645a-4673-b69d-843aa1ec0cff {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 04:57:36 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-fc7c9a43-b526-454f-89b9-1faea66e873b tempest-ProjectMemberTests-792838276 None] Create snapshot completed successfully Aug 11 04:57:36 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7bddb0c-c92d-44cd-ae79-eeb9be3650a0]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:57:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-832252f0-d2e8-406f-866d-c33ab188bc08 tempest-CinderUnicodeTest-216449796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cac0b964-645a-4673-b69d-843aa1ec0cff {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:36 devstack sudo[115373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cac0b964-645a-4673-b69d-843aa1ec0cff Aug 11 04:57:36 devstack sudo[115373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:36 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-3f8164f3-ebb1-4b1c-bfcb-5e5a68dc1b85 tempest-CreateVolumesFromSnapshotTest-363080733 None] Acquiring lock "cinder-138c600b-39b7-45d8-9594-e8db9857ca96-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:36 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-3f8164f3-ebb1-4b1c-bfcb-5e5a68dc1b85 tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "cinder-138c600b-39b7-45d8-9594-e8db9857ca96-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-3f8164f3-ebb1-4b1c-bfcb-5e5a68dc1b85 tempest-CreateVolumesFromSnapshotTest-363080733 None] Acquiring lock "cinder-quobyte-138c600b-39b7-45d8-9594-e8db9857ca96" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-3f8164f3-ebb1-4b1c-bfcb-5e5a68dc1b85 tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "cinder-quobyte-138c600b-39b7-45d8-9594-e8db9857ca96" acquired by "delete_volume" :: waited 0.018s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:37 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0bd68e-85ca-44ea-a88b-4013850fae74]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:57:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3f8164f3-ebb1-4b1c-bfcb-5e5a68dc1b85 tempest-CreateVolumesFromSnapshotTest-363080733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-138c600b-39b7-45d8-9594-e8db9857ca96 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:37 devstack sudo[115373]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-832252f0-d2e8-406f-866d-c33ab188bc08 tempest-CinderUnicodeTest-216449796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cac0b964-645a-4673-b69d-843aa1ec0cff" returned: 0 in 0.399s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-832252f0-d2e8-406f-866d-c33ab188bc08 tempest-CinderUnicodeTest-216449796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cac0b964-645a-4673-b69d-843aa1ec0cff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cac0b964-645a-4673-b69d-843aa1ec0cff.16bf8a63-5e58-4046-9215-f5d377f40d71 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:37 devstack sudo[115379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cac0b964-645a-4673-b69d-843aa1ec0cff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cac0b964-645a-4673-b69d-843aa1ec0cff.16bf8a63-5e58-4046-9215-f5d377f40d71 1G Aug 11 04:57:37 devstack sudo[115379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:37 devstack sudo[115378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-138c600b-39b7-45d8-9594-e8db9857ca96 Aug 11 04:57:37 devstack sudo[115378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5e3d51e3-d763-4d76-8691-e721e76a677b tempest-ProjectMemberTests-792838276 None] Acquiring lock "cinder-35a925c8-75cb-4c4b-83a9-135d88a8f98f-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5e3d51e3-d763-4d76-8691-e721e76a677b tempest-ProjectMemberTests-792838276 None] Lock "cinder-35a925c8-75cb-4c4b-83a9-135d88a8f98f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5e3d51e3-d763-4d76-8691-e721e76a677b tempest-ProjectMemberTests-792838276 None] Acquiring lock "cinder-quobyte-adbb16f0-88da-4d7d-81ca-23a4a97dcf16" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5e3d51e3-d763-4d76-8691-e721e76a677b tempest-ProjectMemberTests-792838276 None] Lock "cinder-quobyte-adbb16f0-88da-4d7d-81ca-23a4a97dcf16" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5e3d51e3-d763-4d76-8691-e721e76a677b tempest-ProjectMemberTests-792838276 None] Acquiring lock "cinder-quobyte-35a925c8-75cb-4c4b-83a9-135d88a8f98f" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5e3d51e3-d763-4d76-8691-e721e76a677b tempest-ProjectMemberTests-792838276 None] Lock "cinder-quobyte-35a925c8-75cb-4c4b-83a9-135d88a8f98f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:37 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-5e3d51e3-d763-4d76-8691-e721e76a677b tempest-ProjectMemberTests-792838276 None] Deleting offline snapshot 35a925c8-75cb-4c4b-83a9-135d88a8f98f of volume adbb16f0-88da-4d7d-81ca-23a4a97dcf16 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 04:57:37 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-5e3d51e3-d763-4d76-8691-e721e76a677b tempest-ProjectMemberTests-792838276 None] snapshot_file for this snap is: volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16.35a925c8-75cb-4c4b-83a9-135d88a8f98f {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 04:57:37 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebcc4fdb-db8b-48a6-94a7-3b03553a4696]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:57:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5e3d51e3-d763-4d76-8691-e721e76a677b tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16.35a925c8-75cb-4c4b-83a9-135d88a8f98f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:37 devstack sudo[115385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16.35a925c8-75cb-4c4b-83a9-135d88a8f98f Aug 11 04:57:37 devstack sudo[115385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:37 devstack sudo[115378]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3f8164f3-ebb1-4b1c-bfcb-5e5a68dc1b85 tempest-CreateVolumesFromSnapshotTest-363080733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-138c600b-39b7-45d8-9594-e8db9857ca96" returned: 0 in 0.464s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3f8164f3-ebb1-4b1c-bfcb-5e5a68dc1b85 tempest-CreateVolumesFromSnapshotTest-363080733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-138c600b-39b7-45d8-9594-e8db9857ca96 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:37 devstack sudo[115379]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-832252f0-d2e8-406f-866d-c33ab188bc08 tempest-CinderUnicodeTest-216449796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cac0b964-645a-4673-b69d-843aa1ec0cff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cac0b964-645a-4673-b69d-843aa1ec0cff.16bf8a63-5e58-4046-9215-f5d377f40d71 1G" returned: 0 in 0.483s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-832252f0-d2e8-406f-866d-c33ab188bc08 tempest-CinderUnicodeTest-216449796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cac0b964-645a-4673-b69d-843aa1ec0cff -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cac0b964-645a-4673-b69d-843aa1ec0cff.16bf8a63-5e58-4046-9215-f5d377f40d71 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:37 devstack sudo[115392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-138c600b-39b7-45d8-9594-e8db9857ca96 Aug 11 04:57:37 devstack sudo[115392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:37 devstack sudo[115394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cac0b964-645a-4673-b69d-843aa1ec0cff -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cac0b964-645a-4673-b69d-843aa1ec0cff.16bf8a63-5e58-4046-9215-f5d377f40d71 Aug 11 04:57:37 devstack sudo[115394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:37 devstack sudo[115385]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5e3d51e3-d763-4d76-8691-e721e76a677b tempest-ProjectMemberTests-792838276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16.35a925c8-75cb-4c4b-83a9-135d88a8f98f" returned: 0 in 0.483s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:37 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-5e3d51e3-d763-4d76-8691-e721e76a677b tempest-ProjectMemberTests-792838276 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:57:37 devstack sudo[115392]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3f8164f3-ebb1-4b1c-bfcb-5e5a68dc1b85 tempest-CreateVolumesFromSnapshotTest-363080733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-138c600b-39b7-45d8-9594-e8db9857ca96" returned: 0 in 0.350s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:37 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75ab5f1-6877-4ddd-9524-876ea83c225d]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:57:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5e3d51e3-d763-4d76-8691-e721e76a677b tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-3f8164f3-ebb1-4b1c-bfcb-5e5a68dc1b85 tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "cinder-quobyte-138c600b-39b7-45d8-9594-e8db9857ca96" released by "delete_volume" :: held 0.869s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:37 devstack sudo[115394]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-832252f0-d2e8-406f-866d-c33ab188bc08 tempest-CinderUnicodeTest-216449796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cac0b964-645a-4673-b69d-843aa1ec0cff -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cac0b964-645a-4673-b69d-843aa1ec0cff.16bf8a63-5e58-4046-9215-f5d377f40d71" returned: 0 in 0.375s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:37 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-832252f0-d2e8-406f-866d-c33ab188bc08 tempest-CinderUnicodeTest-216449796 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cac0b964-645a-4673-b69d-843aa1ec0cff.16bf8a63-5e58-4046-9215-f5d377f40d71 is being set with open permissions: ugo+rw Aug 11 04:57:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-832252f0-d2e8-406f-866d-c33ab188bc08 tempest-CinderUnicodeTest-216449796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cac0b964-645a-4673-b69d-843aa1ec0cff.16bf8a63-5e58-4046-9215-f5d377f40d71 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:37 devstack sudo[115405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cac0b964-645a-4673-b69d-843aa1ec0cff.16bf8a63-5e58-4046-9215-f5d377f40d71 Aug 11 04:57:37 devstack sudo[115405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:38 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-3f8164f3-ebb1-4b1c-bfcb-5e5a68dc1b85 tempest-CreateVolumesFromSnapshotTest-363080733 None] Created reservations ['68bc9358-917c-4a1a-93b4-6e0c7a9b41b3', 'c6534551-8099-48ab-98c8-6e97f4eeb24f', '20591866-0796-4e40-adbe-5130592a95fe', '8f01b8d4-0f0f-4a1c-93c2-f9c460a90c94'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:57:38 devstack sudo[115404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16 Aug 11 04:57:38 devstack sudo[115404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3f8164f3-ebb1-4b1c-bfcb-5e5a68dc1b85 tempest-CreateVolumesFromSnapshotTest-363080733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3f8164f3-ebb1-4b1c-bfcb-5e5a68dc1b85 tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:38 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3f8164f3-ebb1-4b1c-bfcb-5e5a68dc1b85 tempest-CreateVolumesFromSnapshotTest-363080733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:57:38 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3f8164f3-ebb1-4b1c-bfcb-5e5a68dc1b85 tempest-CreateVolumesFromSnapshotTest-363080733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:57:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3f8164f3-ebb1-4b1c-bfcb-5e5a68dc1b85 tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3f8164f3-ebb1-4b1c-bfcb-5e5a68dc1b85 tempest-CreateVolumesFromSnapshotTest-363080733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:38 devstack sudo[115408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:57:38 devstack sudo[115408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:38 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2c3f3396-5a58-49ec-babc-fc0c9c2bc68a tempest-CreateVolumesFromSnapshotTest-363080733 None] Acquiring lock "cinder-23df5ae1-f87d-4962-98ef-464d7a339d14-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:38 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2c3f3396-5a58-49ec-babc-fc0c9c2bc68a tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "cinder-23df5ae1-f87d-4962-98ef-464d7a339d14-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:38 devstack sudo[115405]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:38 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2c3f3396-5a58-49ec-babc-fc0c9c2bc68a tempest-CreateVolumesFromSnapshotTest-363080733 None] Acquiring lock "cinder-quobyte-23df5ae1-f87d-4962-98ef-464d7a339d14" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-832252f0-d2e8-406f-866d-c33ab188bc08 tempest-CinderUnicodeTest-216449796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cac0b964-645a-4673-b69d-843aa1ec0cff.16bf8a63-5e58-4046-9215-f5d377f40d71" returned: 0 in 0.319s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:38 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2c3f3396-5a58-49ec-babc-fc0c9c2bc68a tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "cinder-quobyte-23df5ae1-f87d-4962-98ef-464d7a339d14" acquired by "delete_volume" :: waited 0.021s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:38 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[28293b08-267b-40ea-aeea-c8d6b95c0cee]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:57:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2c3f3396-5a58-49ec-babc-fc0c9c2bc68a tempest-CreateVolumesFromSnapshotTest-363080733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23df5ae1-f87d-4962-98ef-464d7a339d14 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:38 devstack sudo[115404]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-832252f0-d2e8-406f-866d-c33ab188bc08 tempest-CinderUnicodeTest-216449796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cac0b964-645a-4673-b69d-843aa1ec0cff.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5e3d51e3-d763-4d76-8691-e721e76a677b tempest-ProjectMemberTests-792838276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16" returned: 0 in 0.460s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5e3d51e3-d763-4d76-8691-e721e76a677b tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16.35a925c8-75cb-4c4b-83a9-135d88a8f98f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:38 devstack sudo[115415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cac0b964-645a-4673-b69d-843aa1ec0cff.info Aug 11 04:57:38 devstack sudo[115415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:38 devstack sudo[115416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16.35a925c8-75cb-4c4b-83a9-135d88a8f98f Aug 11 04:57:38 devstack sudo[115416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:38 devstack sudo[115408]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3f8164f3-ebb1-4b1c-bfcb-5e5a68dc1b85 tempest-CreateVolumesFromSnapshotTest-363080733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.370s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:38 devstack sudo[115414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23df5ae1-f87d-4962-98ef-464d7a339d14 Aug 11 04:57:38 devstack sudo[115414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:38 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-3f8164f3-ebb1-4b1c-bfcb-5e5a68dc1b85 tempest-CreateVolumesFromSnapshotTest-363080733 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:57:38 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-3f8164f3-ebb1-4b1c-bfcb-5e5a68dc1b85 tempest-CreateVolumesFromSnapshotTest-363080733 None] Deleted volume successfully. Aug 11 04:57:38 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-3f8164f3-ebb1-4b1c-bfcb-5e5a68dc1b85 tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "cinder-138c600b-39b7-45d8-9594-e8db9857ca96-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:38 devstack sudo[115415]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-832252f0-d2e8-406f-866d-c33ab188bc08 tempest-CinderUnicodeTest-216449796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cac0b964-645a-4673-b69d-843aa1ec0cff.info" returned: 0 in 0.305s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:38 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-832252f0-d2e8-406f-866d-c33ab188bc08 tempest-CinderUnicodeTest-216449796 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cac0b964-645a-4673-b69d-843aa1ec0cff.info is being set with open permissions: ugo+rw Aug 11 04:57:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-832252f0-d2e8-406f-866d-c33ab188bc08 tempest-CinderUnicodeTest-216449796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cac0b964-645a-4673-b69d-843aa1ec0cff.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:38 devstack sudo[115427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cac0b964-645a-4673-b69d-843aa1ec0cff.info Aug 11 04:57:38 devstack sudo[115427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:38 devstack sudo[115414]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2c3f3396-5a58-49ec-babc-fc0c9c2bc68a tempest-CreateVolumesFromSnapshotTest-363080733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23df5ae1-f87d-4962-98ef-464d7a339d14" returned: 0 in 0.402s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2c3f3396-5a58-49ec-babc-fc0c9c2bc68a tempest-CreateVolumesFromSnapshotTest-363080733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23df5ae1-f87d-4962-98ef-464d7a339d14 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:38 devstack sudo[115416]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5e3d51e3-d763-4d76-8691-e721e76a677b tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16.35a925c8-75cb-4c4b-83a9-135d88a8f98f" returned: 0 in 0.375s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5e3d51e3-d763-4d76-8691-e721e76a677b tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16.35a925c8-75cb-4c4b-83a9-135d88a8f98f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:38 devstack sudo[115430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23df5ae1-f87d-4962-98ef-464d7a339d14 Aug 11 04:57:38 devstack sudo[115430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:38 devstack sudo[115431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16.35a925c8-75cb-4c4b-83a9-135d88a8f98f Aug 11 04:57:38 devstack sudo[115431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:38 devstack sudo[115427]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-832252f0-d2e8-406f-866d-c33ab188bc08 tempest-CinderUnicodeTest-216449796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cac0b964-645a-4673-b69d-843aa1ec0cff.info" returned: 0 in 0.326s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-832252f0-d2e8-406f-866d-c33ab188bc08 tempest-CinderUnicodeTest-216449796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.349s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:39 devstack sudo[115430]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:39 devstack sudo[115431]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2c3f3396-5a58-49ec-babc-fc0c9c2bc68a tempest-CreateVolumesFromSnapshotTest-363080733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23df5ae1-f87d-4962-98ef-464d7a339d14" returned: 0 in 0.308s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5e3d51e3-d763-4d76-8691-e721e76a677b tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16.35a925c8-75cb-4c4b-83a9-135d88a8f98f" returned: 0 in 0.298s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2c3f3396-5a58-49ec-babc-fc0c9c2bc68a tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "cinder-quobyte-23df5ae1-f87d-4962-98ef-464d7a339d14" released by "delete_volume" :: held 0.759s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:39 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-832252f0-d2e8-406f-866d-c33ab188bc08 tempest-CinderUnicodeTest-216449796 None] Create snapshot completed successfully Aug 11 04:57:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5e3d51e3-d763-4d76-8691-e721e76a677b tempest-ProjectMemberTests-792838276 None] Lock "cinder-quobyte-35a925c8-75cb-4c4b-83a9-135d88a8f98f" released by "_delete_snapshot" :: held 1.754s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5e3d51e3-d763-4d76-8691-e721e76a677b tempest-ProjectMemberTests-792838276 None] Lock "cinder-quobyte-adbb16f0-88da-4d7d-81ca-23a4a97dcf16" released by "delete_snapshot" :: held 1.784s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:39 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-2c3f3396-5a58-49ec-babc-fc0c9c2bc68a tempest-CreateVolumesFromSnapshotTest-363080733 None] Created reservations ['95cc69a8-a778-4d38-ab5a-8e713540715d', 'f31618c8-492f-420f-bd87-2f5baf2b75fc', '2c793253-1ef8-4c70-92bb-677247784fc1', '676a414f-2da8-48b0-9307-b325b5c4a9e3'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:57:39 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-5e3d51e3-d763-4d76-8691-e721e76a677b tempest-ProjectMemberTests-792838276 None] Created reservations ['743b86c6-b36c-47ad-ad1e-008de7ef62b8', 'c6968621-44a2-4f00-85dd-e530446162f4', 'faf12ae3-5114-47d7-ae1a-61d703e01e8d', '720d0391-dcd0-4a16-8668-1dbf01f114f7'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:57:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2c3f3396-5a58-49ec-babc-fc0c9c2bc68a tempest-CreateVolumesFromSnapshotTest-363080733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2c3f3396-5a58-49ec-babc-fc0c9c2bc68a tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2c3f3396-5a58-49ec-babc-fc0c9c2bc68a tempest-CreateVolumesFromSnapshotTest-363080733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:57:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2c3f3396-5a58-49ec-babc-fc0c9c2bc68a tempest-CreateVolumesFromSnapshotTest-363080733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:57:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2c3f3396-5a58-49ec-babc-fc0c9c2bc68a tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2c3f3396-5a58-49ec-babc-fc0c9c2bc68a tempest-CreateVolumesFromSnapshotTest-363080733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:39 devstack sudo[115437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:57:39 devstack sudo[115437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:39 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-5e3d51e3-d763-4d76-8691-e721e76a677b tempest-ProjectMemberTests-792838276 None] Delete snapshot completed successfully. Aug 11 04:57:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5e3d51e3-d763-4d76-8691-e721e76a677b tempest-ProjectMemberTests-792838276 None] Lock "cinder-35a925c8-75cb-4c4b-83a9-135d88a8f98f-delete_snapshot" released by "delete_snapshot" :: held 2.020s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ea6532aa-8fe2-4f6e-a6f1-ac9973d43f12 tempest-CreateVolumesFromSnapshotTest-363080733 None] Acquiring lock "cinder-6501288a-70a5-438e-a55e-9c7ca3f85492-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ea6532aa-8fe2-4f6e-a6f1-ac9973d43f12 tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "cinder-6501288a-70a5-438e-a55e-9c7ca3f85492-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ea6532aa-8fe2-4f6e-a6f1-ac9973d43f12 tempest-CreateVolumesFromSnapshotTest-363080733 None] Acquiring lock "cinder-quobyte-6501288a-70a5-438e-a55e-9c7ca3f85492" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ea6532aa-8fe2-4f6e-a6f1-ac9973d43f12 tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "cinder-quobyte-6501288a-70a5-438e-a55e-9c7ca3f85492" acquired by "delete_volume" :: waited 0.020s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:39 devstack sudo[115437]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c15d5823-704a-419e-a09a-7de18fcc38f5 tempest-ProjectMemberTests-792838276 None] Acquiring lock "cinder-adbb16f0-88da-4d7d-81ca-23a4a97dcf16-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2c3f3396-5a58-49ec-babc-fc0c9c2bc68a tempest-CreateVolumesFromSnapshotTest-363080733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.304s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:39 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-2c3f3396-5a58-49ec-babc-fc0c9c2bc68a tempest-CreateVolumesFromSnapshotTest-363080733 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:57:39 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7f6a6c-e6ff-4a03-8275-35614562ee94]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:57:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ea6532aa-8fe2-4f6e-a6f1-ac9973d43f12 tempest-CreateVolumesFromSnapshotTest-363080733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6501288a-70a5-438e-a55e-9c7ca3f85492 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:39 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-2c3f3396-5a58-49ec-babc-fc0c9c2bc68a tempest-CreateVolumesFromSnapshotTest-363080733 None] Deleted volume successfully. Aug 11 04:57:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c15d5823-704a-419e-a09a-7de18fcc38f5 tempest-ProjectMemberTests-792838276 None] Lock "cinder-adbb16f0-88da-4d7d-81ca-23a4a97dcf16-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2c3f3396-5a58-49ec-babc-fc0c9c2bc68a tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "cinder-23df5ae1-f87d-4962-98ef-464d7a339d14-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c15d5823-704a-419e-a09a-7de18fcc38f5 tempest-ProjectMemberTests-792838276 None] Acquiring lock "cinder-quobyte-adbb16f0-88da-4d7d-81ca-23a4a97dcf16" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c15d5823-704a-419e-a09a-7de18fcc38f5 tempest-ProjectMemberTests-792838276 None] Lock "cinder-quobyte-adbb16f0-88da-4d7d-81ca-23a4a97dcf16" acquired by "delete_volume" :: waited 0.018s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:39 devstack sudo[115441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6501288a-70a5-438e-a55e-9c7ca3f85492 Aug 11 04:57:39 devstack sudo[115441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:39 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb7bb4d-3ef3-451f-998f-afd3dfb322c6]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:57:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c15d5823-704a-419e-a09a-7de18fcc38f5 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:39 devstack sudo[115443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16 Aug 11 04:57:39 devstack sudo[115443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:40 devstack sudo[115441]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ea6532aa-8fe2-4f6e-a6f1-ac9973d43f12 tempest-CreateVolumesFromSnapshotTest-363080733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6501288a-70a5-438e-a55e-9c7ca3f85492" returned: 0 in 0.461s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ea6532aa-8fe2-4f6e-a6f1-ac9973d43f12 tempest-CreateVolumesFromSnapshotTest-363080733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6501288a-70a5-438e-a55e-9c7ca3f85492 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e1e5f882-fcef-44c0-b428-7804ec2c2754 tempest-CinderUnicodeTest-216449796 None] Acquiring lock "cinder-16bf8a63-5e58-4046-9215-f5d377f40d71-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:40 devstack sudo[115450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6501288a-70a5-438e-a55e-9c7ca3f85492 Aug 11 04:57:40 devstack sudo[115450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e1e5f882-fcef-44c0-b428-7804ec2c2754 tempest-CinderUnicodeTest-216449796 None] Lock "cinder-16bf8a63-5e58-4046-9215-f5d377f40d71-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e1e5f882-fcef-44c0-b428-7804ec2c2754 tempest-CinderUnicodeTest-216449796 None] Acquiring lock "cinder-quobyte-cac0b964-645a-4673-b69d-843aa1ec0cff" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:40 devstack sudo[115443]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c15d5823-704a-419e-a09a-7de18fcc38f5 tempest-ProjectMemberTests-792838276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16" returned: 0 in 0.427s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c15d5823-704a-419e-a09a-7de18fcc38f5 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e1e5f882-fcef-44c0-b428-7804ec2c2754 tempest-CinderUnicodeTest-216449796 None] Lock "cinder-quobyte-cac0b964-645a-4673-b69d-843aa1ec0cff" acquired by "delete_snapshot" :: waited 0.050s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e1e5f882-fcef-44c0-b428-7804ec2c2754 tempest-CinderUnicodeTest-216449796 None] Acquiring lock "cinder-quobyte-16bf8a63-5e58-4046-9215-f5d377f40d71" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e1e5f882-fcef-44c0-b428-7804ec2c2754 tempest-CinderUnicodeTest-216449796 None] Lock "cinder-quobyte-16bf8a63-5e58-4046-9215-f5d377f40d71" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:40 devstack sudo[115453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16 Aug 11 04:57:40 devstack sudo[115453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:40 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-e1e5f882-fcef-44c0-b428-7804ec2c2754 tempest-CinderUnicodeTest-216449796 None] Deleting offline snapshot 16bf8a63-5e58-4046-9215-f5d377f40d71 of volume cac0b964-645a-4673-b69d-843aa1ec0cff {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 04:57:40 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-e1e5f882-fcef-44c0-b428-7804ec2c2754 tempest-CinderUnicodeTest-216449796 None] snapshot_file for this snap is: volume-cac0b964-645a-4673-b69d-843aa1ec0cff.16bf8a63-5e58-4046-9215-f5d377f40d71 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 04:57:40 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d004e7-1439-4477-8ef6-29cb0be15f28]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:57:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e1e5f882-fcef-44c0-b428-7804ec2c2754 tempest-CinderUnicodeTest-216449796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cac0b964-645a-4673-b69d-843aa1ec0cff.16bf8a63-5e58-4046-9215-f5d377f40d71 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:40 devstack sudo[115455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cac0b964-645a-4673-b69d-843aa1ec0cff.16bf8a63-5e58-4046-9215-f5d377f40d71 Aug 11 04:57:40 devstack sudo[115455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:40 devstack sudo[115450]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ea6532aa-8fe2-4f6e-a6f1-ac9973d43f12 tempest-CreateVolumesFromSnapshotTest-363080733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-6501288a-70a5-438e-a55e-9c7ca3f85492" returned: 0 in 0.333s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ea6532aa-8fe2-4f6e-a6f1-ac9973d43f12 tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "cinder-quobyte-6501288a-70a5-438e-a55e-9c7ca3f85492" released by "delete_volume" :: held 0.865s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:40 devstack sudo[115453]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c15d5823-704a-419e-a09a-7de18fcc38f5 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-adbb16f0-88da-4d7d-81ca-23a4a97dcf16" returned: 0 in 0.298s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:40 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-ea6532aa-8fe2-4f6e-a6f1-ac9973d43f12 tempest-CreateVolumesFromSnapshotTest-363080733 None] Created reservations ['3abec53d-2191-4a22-af05-433f8b94fb47', '4d4a6b6a-ecc5-4161-8846-7c27ce7c534d', '72a56404-e16d-415d-8070-4743abf23c2a', '92c95e05-d5bc-46d5-a7ca-47804bd108e2'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:57:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c15d5823-704a-419e-a09a-7de18fcc38f5 tempest-ProjectMemberTests-792838276 None] Lock "cinder-quobyte-adbb16f0-88da-4d7d-81ca-23a4a97dcf16" released by "delete_volume" :: held 0.797s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:40 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-c15d5823-704a-419e-a09a-7de18fcc38f5 tempest-ProjectMemberTests-792838276 None] Created reservations ['507c112e-8828-4e0a-aea9-0ef485bbef1e', '994910d0-7664-4d13-8c5a-5d7e104e0162', 'a74a9649-7f1c-4c1e-996a-7a1e70ca6753', 'e371b3d7-134b-45f2-aab2-131e0ad89e8b'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:57:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ea6532aa-8fe2-4f6e-a6f1-ac9973d43f12 tempest-CreateVolumesFromSnapshotTest-363080733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ea6532aa-8fe2-4f6e-a6f1-ac9973d43f12 tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:40 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ea6532aa-8fe2-4f6e-a6f1-ac9973d43f12 tempest-CreateVolumesFromSnapshotTest-363080733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:57:40 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ea6532aa-8fe2-4f6e-a6f1-ac9973d43f12 tempest-CreateVolumesFromSnapshotTest-363080733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:57:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ea6532aa-8fe2-4f6e-a6f1-ac9973d43f12 tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ea6532aa-8fe2-4f6e-a6f1-ac9973d43f12 tempest-CreateVolumesFromSnapshotTest-363080733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:40 devstack sudo[115455]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c1519e8a-e236-47bc-b520-bbb596feb124 tempest-CreateVolumesFromSnapshotTest-363080733 None] Acquiring lock "cinder-357401bf-81ab-4671-ad0d-2f25813df791-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e1e5f882-fcef-44c0-b428-7804ec2c2754 tempest-CinderUnicodeTest-216449796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cac0b964-645a-4673-b69d-843aa1ec0cff.16bf8a63-5e58-4046-9215-f5d377f40d71" returned: 0 in 0.418s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:40 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-e1e5f882-fcef-44c0-b428-7804ec2c2754 tempest-CinderUnicodeTest-216449796 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cac0b964-645a-4673-b69d-843aa1ec0cff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:57:40 devstack sudo[115462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:57:40 devstack sudo[115462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c1519e8a-e236-47bc-b520-bbb596feb124 tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "cinder-357401bf-81ab-4671-ad0d-2f25813df791-delete_snapshot" acquired by "delete_snapshot" :: waited 0.069s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c1519e8a-e236-47bc-b520-bbb596feb124 tempest-CreateVolumesFromSnapshotTest-363080733 None] Acquiring lock "cinder-quobyte-17832647-6d92-42bb-ae3c-327529a76c9d" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:40 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0ffed4-108c-4759-818c-cf7ee6ac7e12]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:57:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e1e5f882-fcef-44c0-b428-7804ec2c2754 tempest-CinderUnicodeTest-216449796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cac0b964-645a-4673-b69d-843aa1ec0cff {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c1519e8a-e236-47bc-b520-bbb596feb124 tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "cinder-quobyte-17832647-6d92-42bb-ae3c-327529a76c9d" acquired by "delete_snapshot" :: waited 0.051s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c1519e8a-e236-47bc-b520-bbb596feb124 tempest-CreateVolumesFromSnapshotTest-363080733 None] Acquiring lock "cinder-quobyte-357401bf-81ab-4671-ad0d-2f25813df791" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c1519e8a-e236-47bc-b520-bbb596feb124 tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "cinder-quobyte-357401bf-81ab-4671-ad0d-2f25813df791" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:40 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-c1519e8a-e236-47bc-b520-bbb596feb124 tempest-CreateVolumesFromSnapshotTest-363080733 None] Deleting offline snapshot 357401bf-81ab-4671-ad0d-2f25813df791 of volume 17832647-6d92-42bb-ae3c-327529a76c9d {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 04:57:40 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-c1519e8a-e236-47bc-b520-bbb596feb124 tempest-CreateVolumesFromSnapshotTest-363080733 None] snapshot_file for this snap is: volume-17832647-6d92-42bb-ae3c-327529a76c9d.357401bf-81ab-4671-ad0d-2f25813df791 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 04:57:40 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbdae9fe-7145-41c6-97d1-40e71decbe0a]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:57:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c1519e8a-e236-47bc-b520-bbb596feb124 tempest-CreateVolumesFromSnapshotTest-363080733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17832647-6d92-42bb-ae3c-327529a76c9d.357401bf-81ab-4671-ad0d-2f25813df791 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c15d5823-704a-419e-a09a-7de18fcc38f5 tempest-ProjectMemberTests-792838276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c15d5823-704a-419e-a09a-7de18fcc38f5 tempest-ProjectMemberTests-792838276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:40 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c15d5823-704a-419e-a09a-7de18fcc38f5 tempest-ProjectMemberTests-792838276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:57:40 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c15d5823-704a-419e-a09a-7de18fcc38f5 tempest-ProjectMemberTests-792838276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:57:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c15d5823-704a-419e-a09a-7de18fcc38f5 tempest-ProjectMemberTests-792838276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c15d5823-704a-419e-a09a-7de18fcc38f5 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:40 devstack sudo[115464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cac0b964-645a-4673-b69d-843aa1ec0cff Aug 11 04:57:40 devstack sudo[115464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:40 devstack sudo[115467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:57:40 devstack sudo[115467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:40 devstack sudo[115462]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ea6532aa-8fe2-4f6e-a6f1-ac9973d43f12 tempest-CreateVolumesFromSnapshotTest-363080733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.324s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:40 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-ea6532aa-8fe2-4f6e-a6f1-ac9973d43f12 tempest-CreateVolumesFromSnapshotTest-363080733 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:57:40 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-ea6532aa-8fe2-4f6e-a6f1-ac9973d43f12 tempest-CreateVolumesFromSnapshotTest-363080733 None] Deleted volume successfully. Aug 11 04:57:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ea6532aa-8fe2-4f6e-a6f1-ac9973d43f12 tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "cinder-6501288a-70a5-438e-a55e-9c7ca3f85492-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:41 devstack sudo[115465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17832647-6d92-42bb-ae3c-327529a76c9d.357401bf-81ab-4671-ad0d-2f25813df791 Aug 11 04:57:41 devstack sudo[115465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:41 devstack sudo[115467]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c15d5823-704a-419e-a09a-7de18fcc38f5 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.385s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:41 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-c15d5823-704a-419e-a09a-7de18fcc38f5 tempest-ProjectMemberTests-792838276 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:57:41 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-c15d5823-704a-419e-a09a-7de18fcc38f5 tempest-ProjectMemberTests-792838276 None] Deleted volume successfully. Aug 11 04:57:41 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c15d5823-704a-419e-a09a-7de18fcc38f5 tempest-ProjectMemberTests-792838276 None] Lock "cinder-adbb16f0-88da-4d7d-81ca-23a4a97dcf16-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:41 devstack sudo[115464]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e1e5f882-fcef-44c0-b428-7804ec2c2754 tempest-CinderUnicodeTest-216449796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cac0b964-645a-4673-b69d-843aa1ec0cff" returned: 0 in 0.621s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e1e5f882-fcef-44c0-b428-7804ec2c2754 tempest-CinderUnicodeTest-216449796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cac0b964-645a-4673-b69d-843aa1ec0cff.16bf8a63-5e58-4046-9215-f5d377f40d71 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:41 devstack sudo[115475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cac0b964-645a-4673-b69d-843aa1ec0cff.16bf8a63-5e58-4046-9215-f5d377f40d71 Aug 11 04:57:41 devstack sudo[115475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:41 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2860817-08b1-492a-b2f2-20279186278a tempest-ProjectMemberTests-792838276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:57:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b2860817-08b1-492a-b2f2-20279186278a tempest-ProjectMemberTests-792838276 None] Flow 'volume_create_manager' (1677b7fe-90f5-47ed-874a-77459b60b145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:57:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b2860817-08b1-492a-b2f2-20279186278a tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac9a3ef7-7bc0-4a92-901b-2f09a6675840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b2860817-08b1-492a-b2f2-20279186278a tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac9a3ef7-7bc0-4a92-901b-2f09a6675840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1528053755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34539ee3-d0a6-40f2-a264-c0a00bdb1863,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac225c2b69784eb6b9ec19178ed3af8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:57:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:57:41Z,use_quota=True,user_id='4ce57473867c427a94cf64a00303ce0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b2860817-08b1-492a-b2f2-20279186278a tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb3f7587-3766-481a-8bfa-4335714ddcbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:41 devstack sudo[115465]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b2860817-08b1-492a-b2f2-20279186278a tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb3f7587-3766-481a-8bfa-4335714ddcbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b2860817-08b1-492a-b2f2-20279186278a tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (696592ea-8f1a-4ced-a6a7-0f59e3074e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b2860817-08b1-492a-b2f2-20279186278a tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (696592ea-8f1a-4ced-a6a7-0f59e3074e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34539ee3-d0a6-40f2-a264-c0a00bdb1863', 'volume_name': 'volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b2860817-08b1-492a-b2f2-20279186278a tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e94befc-e81a-4ff4-8ffb-8a35362c7d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b2860817-08b1-492a-b2f2-20279186278a tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e94befc-e81a-4ff4-8ffb-8a35362c7d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b2860817-08b1-492a-b2f2-20279186278a tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2760d2ab-fcf0-44d2-a63d-b7fbd12eb77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:41 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-b2860817-08b1-492a-b2f2-20279186278a tempest-ProjectMemberTests-792838276 None] Volume 34539ee3-d0a6-40f2-a264-c0a00bdb1863: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863', 'volume_size': 1} Aug 11 04:57:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b2860817-08b1-492a-b2f2-20279186278a tempest-ProjectMemberTests-792838276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b2860817-08b1-492a-b2f2-20279186278a tempest-ProjectMemberTests-792838276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b2860817-08b1-492a-b2f2-20279186278a tempest-ProjectMemberTests-792838276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1528053755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34539ee3-d0a6-40f2-a264-c0a00bdb1863,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac225c2b69784eb6b9ec19178ed3af8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:57:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:57:41Z,use_quota=True,user_id='4ce57473867c427a94cf64a00303ce0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:57:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-b2860817-08b1-492a-b2f2-20279186278a tempest-ProjectMemberTests-792838276 None] Creating volume 34539ee3-d0a6-40f2-a264-c0a00bdb1863 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:57:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b2860817-08b1-492a-b2f2-20279186278a tempest-ProjectMemberTests-792838276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b2860817-08b1-492a-b2f2-20279186278a tempest-ProjectMemberTests-792838276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b2860817-08b1-492a-b2f2-20279186278a tempest-ProjectMemberTests-792838276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:57:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b2860817-08b1-492a-b2f2-20279186278a tempest-ProjectMemberTests-792838276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:57:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b2860817-08b1-492a-b2f2-20279186278a tempest-ProjectMemberTests-792838276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b2860817-08b1-492a-b2f2-20279186278a tempest-ProjectMemberTests-792838276 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:57:41 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-b2860817-08b1-492a-b2f2-20279186278a tempest-ProjectMemberTests-792838276 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:57:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b2860817-08b1-492a-b2f2-20279186278a tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c1519e8a-e236-47bc-b520-bbb596feb124 tempest-CreateVolumesFromSnapshotTest-363080733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17832647-6d92-42bb-ae3c-327529a76c9d.357401bf-81ab-4671-ad0d-2f25813df791" returned: 0 in 0.722s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-c1519e8a-e236-47bc-b520-bbb596feb124 tempest-CreateVolumesFromSnapshotTest-363080733 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17832647-6d92-42bb-ae3c-327529a76c9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:57:41 devstack sudo[115481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863 1073741824 Aug 11 04:57:41 devstack sudo[115481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:41 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab4362d-e8d6-4a57-99ae-35893001d636]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:57:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c1519e8a-e236-47bc-b520-bbb596feb124 tempest-CreateVolumesFromSnapshotTest-363080733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17832647-6d92-42bb-ae3c-327529a76c9d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:41 devstack sudo[115485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17832647-6d92-42bb-ae3c-327529a76c9d Aug 11 04:57:41 devstack sudo[115485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:41 devstack sudo[115475]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e1e5f882-fcef-44c0-b428-7804ec2c2754 tempest-CinderUnicodeTest-216449796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cac0b964-645a-4673-b69d-843aa1ec0cff.16bf8a63-5e58-4046-9215-f5d377f40d71" returned: 0 in 0.501s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e1e5f882-fcef-44c0-b428-7804ec2c2754 tempest-CinderUnicodeTest-216449796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cac0b964-645a-4673-b69d-843aa1ec0cff.16bf8a63-5e58-4046-9215-f5d377f40d71 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:41 devstack sudo[115489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cac0b964-645a-4673-b69d-843aa1ec0cff.16bf8a63-5e58-4046-9215-f5d377f40d71 Aug 11 04:57:41 devstack sudo[115489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:42 devstack sudo[115485]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c1519e8a-e236-47bc-b520-bbb596feb124 tempest-CreateVolumesFromSnapshotTest-363080733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17832647-6d92-42bb-ae3c-327529a76c9d" returned: 0 in 0.465s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c1519e8a-e236-47bc-b520-bbb596feb124 tempest-CreateVolumesFromSnapshotTest-363080733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17832647-6d92-42bb-ae3c-327529a76c9d.357401bf-81ab-4671-ad0d-2f25813df791 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:42 devstack sudo[115497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17832647-6d92-42bb-ae3c-327529a76c9d.357401bf-81ab-4671-ad0d-2f25813df791 Aug 11 04:57:42 devstack sudo[115497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:42 devstack sudo[115481]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b2860817-08b1-492a-b2f2-20279186278a tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863 1073741824" returned: 0 in 0.596s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:42 devstack sudo[115489]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e1e5f882-fcef-44c0-b428-7804ec2c2754 tempest-CinderUnicodeTest-216449796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cac0b964-645a-4673-b69d-843aa1ec0cff.16bf8a63-5e58-4046-9215-f5d377f40d71" returned: 0 in 0.339s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:42 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e1e5f882-fcef-44c0-b428-7804ec2c2754 tempest-CinderUnicodeTest-216449796 None] Lock "cinder-quobyte-16bf8a63-5e58-4046-9215-f5d377f40d71" released by "_delete_snapshot" :: held 2.035s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b2860817-08b1-492a-b2f2-20279186278a tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:42 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e1e5f882-fcef-44c0-b428-7804ec2c2754 tempest-CinderUnicodeTest-216449796 None] Lock "cinder-quobyte-cac0b964-645a-4673-b69d-843aa1ec0cff" released by "delete_snapshot" :: held 2.069s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:42 devstack sudo[115500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863 Aug 11 04:57:42 devstack sudo[115500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:42 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-e1e5f882-fcef-44c0-b428-7804ec2c2754 tempest-CinderUnicodeTest-216449796 None] Created reservations ['995c8a6d-43dc-453c-9d90-80c347e42ec3', 'd94c6f7b-1841-4bbd-9ea9-425758c840eb', '302f0b3b-2332-483e-bbb3-9c2d2f405a86', '3134d6d0-8e56-4b42-a578-721ddd0ae5fe'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:57:42 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-e1e5f882-fcef-44c0-b428-7804ec2c2754 tempest-CinderUnicodeTest-216449796 None] Delete snapshot completed successfully. Aug 11 04:57:42 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e1e5f882-fcef-44c0-b428-7804ec2c2754 tempest-CinderUnicodeTest-216449796 None] Lock "cinder-16bf8a63-5e58-4046-9215-f5d377f40d71-delete_snapshot" released by "delete_snapshot" :: held 2.265s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:42 devstack sudo[115497]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c1519e8a-e236-47bc-b520-bbb596feb124 tempest-CreateVolumesFromSnapshotTest-363080733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17832647-6d92-42bb-ae3c-327529a76c9d.357401bf-81ab-4671-ad0d-2f25813df791" returned: 0 in 0.401s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c1519e8a-e236-47bc-b520-bbb596feb124 tempest-CreateVolumesFromSnapshotTest-363080733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17832647-6d92-42bb-ae3c-327529a76c9d.357401bf-81ab-4671-ad0d-2f25813df791 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:42 devstack sudo[115500]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:42 devstack sudo[115508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17832647-6d92-42bb-ae3c-327529a76c9d.357401bf-81ab-4671-ad0d-2f25813df791 Aug 11 04:57:42 devstack sudo[115508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b2860817-08b1-492a-b2f2-20279186278a tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863" returned: 0 in 0.288s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:42 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b2860817-08b1-492a-b2f2-20279186278a tempest-ProjectMemberTests-792838276 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:57:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b2860817-08b1-492a-b2f2-20279186278a tempest-ProjectMemberTests-792838276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:42 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b2860817-08b1-492a-b2f2-20279186278a tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2760d2ab-fcf0-44d2-a63d-b7fbd12eb77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:42 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b2860817-08b1-492a-b2f2-20279186278a tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b066c612-dc32-4be8-8eef-a5d8ec0fb2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:42 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-b2860817-08b1-492a-b2f2-20279186278a tempest-ProjectMemberTests-792838276 None] Volume volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863 (34539ee3-d0a6-40f2-a264-c0a00bdb1863): created successfully Aug 11 04:57:42 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b2860817-08b1-492a-b2f2-20279186278a tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b066c612-dc32-4be8-8eef-a5d8ec0fb2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:42 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b2860817-08b1-492a-b2f2-20279186278a tempest-ProjectMemberTests-792838276 None] Flow 'volume_create_manager' (1677b7fe-90f5-47ed-874a-77459b60b145) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:57:42 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-b2860817-08b1-492a-b2f2-20279186278a tempest-ProjectMemberTests-792838276 None] Created volume successfully. Aug 11 04:57:42 devstack sudo[115508]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c1519e8a-e236-47bc-b520-bbb596feb124 tempest-CreateVolumesFromSnapshotTest-363080733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17832647-6d92-42bb-ae3c-327529a76c9d.357401bf-81ab-4671-ad0d-2f25813df791" returned: 0 in 0.253s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:42 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c1519e8a-e236-47bc-b520-bbb596feb124 tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "cinder-quobyte-357401bf-81ab-4671-ad0d-2f25813df791" released by "_delete_snapshot" :: held 1.977s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:42 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c1519e8a-e236-47bc-b520-bbb596feb124 tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "cinder-quobyte-17832647-6d92-42bb-ae3c-327529a76c9d" released by "delete_snapshot" :: held 2.030s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:42 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-c1519e8a-e236-47bc-b520-bbb596feb124 tempest-CreateVolumesFromSnapshotTest-363080733 None] Created reservations ['1c321231-348f-4b27-b7a5-b14db561b2b2', '3b6d19c9-ed27-4a46-a39e-192d1c8da16d', 'a39118a7-9a27-4827-91d2-14927c48d270', 'b15f69a8-b9aa-45e7-9618-458d1af69435'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:57:42 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-c1519e8a-e236-47bc-b520-bbb596feb124 tempest-CreateVolumesFromSnapshotTest-363080733 None] Delete snapshot completed successfully. Aug 11 04:57:42 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c1519e8a-e236-47bc-b520-bbb596feb124 tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "cinder-357401bf-81ab-4671-ad0d-2f25813df791-delete_snapshot" released by "delete_snapshot" :: held 2.188s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a83c6f6f-4564-47e4-b251-7963b314056b tempest-CinderUnicodeTest-216449796 None] Acquiring lock "cinder-cac0b964-645a-4673-b69d-843aa1ec0cff-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a83c6f6f-4564-47e4-b251-7963b314056b tempest-CinderUnicodeTest-216449796 None] Lock "cinder-cac0b964-645a-4673-b69d-843aa1ec0cff-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a83c6f6f-4564-47e4-b251-7963b314056b tempest-CinderUnicodeTest-216449796 None] Acquiring lock "cinder-quobyte-cac0b964-645a-4673-b69d-843aa1ec0cff" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a83c6f6f-4564-47e4-b251-7963b314056b tempest-CinderUnicodeTest-216449796 None] Lock "cinder-quobyte-cac0b964-645a-4673-b69d-843aa1ec0cff" acquired by "delete_volume" :: waited 0.023s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:43 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[20515ef5-7621-4bfa-b7d8-525c25f214dd]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:57:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a83c6f6f-4564-47e4-b251-7963b314056b tempest-CinderUnicodeTest-216449796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cac0b964-645a-4673-b69d-843aa1ec0cff {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:43 devstack sudo[115511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cac0b964-645a-4673-b69d-843aa1ec0cff Aug 11 04:57:43 devstack sudo[115511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ec41285c-1d05-4df8-9e0c-4dbf052e0097 tempest-ProjectMemberTests-792838276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ec41285c-1d05-4df8-9e0c-4dbf052e0097 tempest-ProjectMemberTests-792838276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:43 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-ec41285c-1d05-4df8-9e0c-4dbf052e0097 tempest-ProjectMemberTests-792838276 None] Creating offline snapshot f1b63f8c-bef7-44f1-88d9-62f856a65cd1 of volume 34539ee3-d0a6-40f2-a264-c0a00bdb1863 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 04:57:43 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f78d71-6d8e-49b1-b4b2-bdcdcde7ea5a]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:57:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ec41285c-1d05-4df8-9e0c-4dbf052e0097 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:43 devstack sudo[115514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863 Aug 11 04:57:43 devstack sudo[115514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f4ad9348-a1e7-4143-906a-88018cc5e8ff tempest-CreateVolumesFromSnapshotTest-363080733 None] Acquiring lock "cinder-17832647-6d92-42bb-ae3c-327529a76c9d-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f4ad9348-a1e7-4143-906a-88018cc5e8ff tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "cinder-17832647-6d92-42bb-ae3c-327529a76c9d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f4ad9348-a1e7-4143-906a-88018cc5e8ff tempest-CreateVolumesFromSnapshotTest-363080733 None] Acquiring lock "cinder-quobyte-17832647-6d92-42bb-ae3c-327529a76c9d" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f4ad9348-a1e7-4143-906a-88018cc5e8ff tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "cinder-quobyte-17832647-6d92-42bb-ae3c-327529a76c9d" acquired by "delete_volume" :: waited 0.027s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:43 devstack sudo[115511]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a83c6f6f-4564-47e4-b251-7963b314056b tempest-CinderUnicodeTest-216449796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cac0b964-645a-4673-b69d-843aa1ec0cff" returned: 0 in 0.517s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a83c6f6f-4564-47e4-b251-7963b314056b tempest-CinderUnicodeTest-216449796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cac0b964-645a-4673-b69d-843aa1ec0cff {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:43 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[5925d583-5945-417b-8a86-308f57b499bd]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:57:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f4ad9348-a1e7-4143-906a-88018cc5e8ff tempest-CreateVolumesFromSnapshotTest-363080733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17832647-6d92-42bb-ae3c-327529a76c9d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:44 devstack sudo[115519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cac0b964-645a-4673-b69d-843aa1ec0cff Aug 11 04:57:44 devstack sudo[115519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:44 devstack sudo[115520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17832647-6d92-42bb-ae3c-327529a76c9d Aug 11 04:57:44 devstack sudo[115520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:44 devstack sudo[115514]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ec41285c-1d05-4df8-9e0c-4dbf052e0097 tempest-ProjectMemberTests-792838276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863" returned: 0 in 0.523s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ec41285c-1d05-4df8-9e0c-4dbf052e0097 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863.f1b63f8c-bef7-44f1-88d9-62f856a65cd1 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:44 devstack sudo[115527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863.f1b63f8c-bef7-44f1-88d9-62f856a65cd1 1G Aug 11 04:57:44 devstack sudo[115527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:44 devstack sudo[115519]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a83c6f6f-4564-47e4-b251-7963b314056b tempest-CinderUnicodeTest-216449796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-cac0b964-645a-4673-b69d-843aa1ec0cff" returned: 0 in 0.315s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:44 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a83c6f6f-4564-47e4-b251-7963b314056b tempest-CinderUnicodeTest-216449796 None] Lock "cinder-quobyte-cac0b964-645a-4673-b69d-843aa1ec0cff" released by "delete_volume" :: held 0.911s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:44 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-a83c6f6f-4564-47e4-b251-7963b314056b tempest-CinderUnicodeTest-216449796 None] Created reservations ['3f511ea2-e837-49a9-9d65-f534959539ed', '87fd0ca9-ca34-4efb-a1ca-27e805017f5d', '36ddfa06-8266-49e2-bc93-e68d64139fab', '1637873a-7a44-4d3e-8ffc-07686a3313b4'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:57:44 devstack sudo[115520]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f4ad9348-a1e7-4143-906a-88018cc5e8ff tempest-CreateVolumesFromSnapshotTest-363080733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17832647-6d92-42bb-ae3c-327529a76c9d" returned: 0 in 0.476s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f4ad9348-a1e7-4143-906a-88018cc5e8ff tempest-CreateVolumesFromSnapshotTest-363080733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17832647-6d92-42bb-ae3c-327529a76c9d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:44 devstack sudo[115533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17832647-6d92-42bb-ae3c-327529a76c9d Aug 11 04:57:44 devstack sudo[115533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a83c6f6f-4564-47e4-b251-7963b314056b tempest-CinderUnicodeTest-216449796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a83c6f6f-4564-47e4-b251-7963b314056b tempest-CinderUnicodeTest-216449796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:44 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a83c6f6f-4564-47e4-b251-7963b314056b tempest-CinderUnicodeTest-216449796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:57:44 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a83c6f6f-4564-47e4-b251-7963b314056b tempest-CinderUnicodeTest-216449796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:57:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a83c6f6f-4564-47e4-b251-7963b314056b tempest-CinderUnicodeTest-216449796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a83c6f6f-4564-47e4-b251-7963b314056b tempest-CinderUnicodeTest-216449796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:44 devstack sudo[115537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:57:44 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c4274be9-26db-4b89-a2dd-22db597182d0 tempest-CinderUnicodeTest-216449796 None] Acquiring lock "cinder-c2c43edb-ef0b-4353-9c2d-15f4e1732667-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:44 devstack sudo[115537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:44 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c4274be9-26db-4b89-a2dd-22db597182d0 tempest-CinderUnicodeTest-216449796 None] Lock "cinder-c2c43edb-ef0b-4353-9c2d-15f4e1732667-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:44 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c4274be9-26db-4b89-a2dd-22db597182d0 tempest-CinderUnicodeTest-216449796 None] Acquiring lock "cinder-quobyte-c2c43edb-ef0b-4353-9c2d-15f4e1732667" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:44 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c4274be9-26db-4b89-a2dd-22db597182d0 tempest-CinderUnicodeTest-216449796 None] Lock "cinder-quobyte-c2c43edb-ef0b-4353-9c2d-15f4e1732667" acquired by "delete_volume" :: waited 0.022s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:44 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57ddaa8-2542-4b5f-9bf8-c82a6ea7422a]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:57:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c4274be9-26db-4b89-a2dd-22db597182d0 tempest-CinderUnicodeTest-216449796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c2c43edb-ef0b-4353-9c2d-15f4e1732667 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:44 devstack sudo[115533]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f4ad9348-a1e7-4143-906a-88018cc5e8ff tempest-CreateVolumesFromSnapshotTest-363080733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-17832647-6d92-42bb-ae3c-327529a76c9d" returned: 0 in 0.420s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:44 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f4ad9348-a1e7-4143-906a-88018cc5e8ff tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "cinder-quobyte-17832647-6d92-42bb-ae3c-327529a76c9d" released by "delete_volume" :: held 0.984s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:44 devstack sudo[115527]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:44 devstack sudo[115541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c2c43edb-ef0b-4353-9c2d-15f4e1732667 Aug 11 04:57:44 devstack sudo[115541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ec41285c-1d05-4df8-9e0c-4dbf052e0097 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863.f1b63f8c-bef7-44f1-88d9-62f856a65cd1 1G" returned: 0 in 0.744s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ec41285c-1d05-4df8-9e0c-4dbf052e0097 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863.f1b63f8c-bef7-44f1-88d9-62f856a65cd1 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:44 devstack sudo[115537]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a83c6f6f-4564-47e4-b251-7963b314056b tempest-CinderUnicodeTest-216449796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.443s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:44 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-a83c6f6f-4564-47e4-b251-7963b314056b tempest-CinderUnicodeTest-216449796 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:57:45 devstack sudo[115545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863.f1b63f8c-bef7-44f1-88d9-62f856a65cd1 Aug 11 04:57:45 devstack sudo[115545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:45 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-a83c6f6f-4564-47e4-b251-7963b314056b tempest-CinderUnicodeTest-216449796 None] Deleted volume successfully. Aug 11 04:57:45 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a83c6f6f-4564-47e4-b251-7963b314056b tempest-CinderUnicodeTest-216449796 None] Lock "cinder-cac0b964-645a-4673-b69d-843aa1ec0cff-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:45 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-f4ad9348-a1e7-4143-906a-88018cc5e8ff tempest-CreateVolumesFromSnapshotTest-363080733 None] Created reservations ['29d6ca2c-3f2f-4506-a8ba-2ca1206c10ed', '38da4bbc-231e-411c-9c63-2173bb1caa61', 'd4002eee-ee8f-4a20-94dc-555f3cb83fb8', 'f4446a20-82ea-45ae-8062-5be5f99daf9a'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:57:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f4ad9348-a1e7-4143-906a-88018cc5e8ff tempest-CreateVolumesFromSnapshotTest-363080733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f4ad9348-a1e7-4143-906a-88018cc5e8ff tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:45 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f4ad9348-a1e7-4143-906a-88018cc5e8ff tempest-CreateVolumesFromSnapshotTest-363080733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:57:45 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f4ad9348-a1e7-4143-906a-88018cc5e8ff tempest-CreateVolumesFromSnapshotTest-363080733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:57:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f4ad9348-a1e7-4143-906a-88018cc5e8ff tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f4ad9348-a1e7-4143-906a-88018cc5e8ff tempest-CreateVolumesFromSnapshotTest-363080733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:45 devstack sudo[115550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:57:45 devstack sudo[115550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:45 devstack sudo[115541]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c4274be9-26db-4b89-a2dd-22db597182d0 tempest-CinderUnicodeTest-216449796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c2c43edb-ef0b-4353-9c2d-15f4e1732667" returned: 0 in 0.487s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c4274be9-26db-4b89-a2dd-22db597182d0 tempest-CinderUnicodeTest-216449796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c2c43edb-ef0b-4353-9c2d-15f4e1732667 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:45 devstack sudo[115553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c2c43edb-ef0b-4353-9c2d-15f4e1732667 Aug 11 04:57:45 devstack sudo[115553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:45 devstack sudo[115545]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ec41285c-1d05-4df8-9e0c-4dbf052e0097 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863.f1b63f8c-bef7-44f1-88d9-62f856a65cd1" returned: 0 in 0.478s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:45 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-ec41285c-1d05-4df8-9e0c-4dbf052e0097 tempest-ProjectMemberTests-792838276 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863.f1b63f8c-bef7-44f1-88d9-62f856a65cd1 is being set with open permissions: ugo+rw Aug 11 04:57:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ec41285c-1d05-4df8-9e0c-4dbf052e0097 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863.f1b63f8c-bef7-44f1-88d9-62f856a65cd1 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:45 devstack sudo[115559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863.f1b63f8c-bef7-44f1-88d9-62f856a65cd1 Aug 11 04:57:45 devstack sudo[115559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:45 devstack sudo[115550]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f4ad9348-a1e7-4143-906a-88018cc5e8ff tempest-CreateVolumesFromSnapshotTest-363080733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.304s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:45 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-f4ad9348-a1e7-4143-906a-88018cc5e8ff tempest-CreateVolumesFromSnapshotTest-363080733 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:57:45 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-f4ad9348-a1e7-4143-906a-88018cc5e8ff tempest-CreateVolumesFromSnapshotTest-363080733 None] Deleted volume successfully. Aug 11 04:57:45 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f4ad9348-a1e7-4143-906a-88018cc5e8ff tempest-CreateVolumesFromSnapshotTest-363080733 None] Lock "cinder-17832647-6d92-42bb-ae3c-327529a76c9d-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:45 devstack sudo[115553]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c4274be9-26db-4b89-a2dd-22db597182d0 tempest-CinderUnicodeTest-216449796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c2c43edb-ef0b-4353-9c2d-15f4e1732667" returned: 0 in 0.303s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:45 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c4274be9-26db-4b89-a2dd-22db597182d0 tempest-CinderUnicodeTest-216449796 None] Lock "cinder-quobyte-c2c43edb-ef0b-4353-9c2d-15f4e1732667" released by "delete_volume" :: held 0.837s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:45 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-c4274be9-26db-4b89-a2dd-22db597182d0 tempest-CinderUnicodeTest-216449796 None] Created reservations ['d5ec19f0-4b34-42ff-9891-915257925295', '539e8fdb-ea46-446a-97ff-162d8709a810', 'bc41e354-48c6-4ded-91ff-c1545d10fa3e', '3b63e115-7bf0-4b5a-a2b2-99603bddc049'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:57:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c4274be9-26db-4b89-a2dd-22db597182d0 tempest-CinderUnicodeTest-216449796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c4274be9-26db-4b89-a2dd-22db597182d0 tempest-CinderUnicodeTest-216449796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:45 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c4274be9-26db-4b89-a2dd-22db597182d0 tempest-CinderUnicodeTest-216449796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:57:45 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c4274be9-26db-4b89-a2dd-22db597182d0 tempest-CinderUnicodeTest-216449796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:57:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c4274be9-26db-4b89-a2dd-22db597182d0 tempest-CinderUnicodeTest-216449796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c4274be9-26db-4b89-a2dd-22db597182d0 tempest-CinderUnicodeTest-216449796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:45 devstack sudo[115559]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ec41285c-1d05-4df8-9e0c-4dbf052e0097 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863.f1b63f8c-bef7-44f1-88d9-62f856a65cd1" returned: 0 in 0.376s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:45 devstack sudo[115563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:57:45 devstack sudo[115563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ec41285c-1d05-4df8-9e0c-4dbf052e0097 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:45 devstack sudo[115565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863.info Aug 11 04:57:45 devstack sudo[115565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:46 devstack sudo[115563]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c4274be9-26db-4b89-a2dd-22db597182d0 tempest-CinderUnicodeTest-216449796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.299s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:46 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-c4274be9-26db-4b89-a2dd-22db597182d0 tempest-CinderUnicodeTest-216449796 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:57:46 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-c4274be9-26db-4b89-a2dd-22db597182d0 tempest-CinderUnicodeTest-216449796 None] Deleted volume successfully. Aug 11 04:57:46 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c4274be9-26db-4b89-a2dd-22db597182d0 tempest-CinderUnicodeTest-216449796 None] Lock "cinder-c2c43edb-ef0b-4353-9c2d-15f4e1732667-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:46 devstack sudo[115565]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ec41285c-1d05-4df8-9e0c-4dbf052e0097 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863.info" returned: 0 in 0.348s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:46 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-ec41285c-1d05-4df8-9e0c-4dbf052e0097 tempest-ProjectMemberTests-792838276 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863.info is being set with open permissions: ugo+rw Aug 11 04:57:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ec41285c-1d05-4df8-9e0c-4dbf052e0097 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:46 devstack sudo[115569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863.info Aug 11 04:57:46 devstack sudo[115569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:46 devstack sudo[115569]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ec41285c-1d05-4df8-9e0c-4dbf052e0097 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863.info" returned: 0 in 0.280s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ec41285c-1d05-4df8-9e0c-4dbf052e0097 tempest-ProjectMemberTests-792838276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.870s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:46 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-ec41285c-1d05-4df8-9e0c-4dbf052e0097 tempest-ProjectMemberTests-792838276 None] Create snapshot completed successfully Aug 11 04:57:46 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b5d91232-1688-401c-bbe1-b497c6ed0408 tempest-ProjectMemberTests-792838276 None] Acquiring lock "cinder-f1b63f8c-bef7-44f1-88d9-62f856a65cd1-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:46 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b5d91232-1688-401c-bbe1-b497c6ed0408 tempest-ProjectMemberTests-792838276 None] Lock "cinder-f1b63f8c-bef7-44f1-88d9-62f856a65cd1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:46 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b5d91232-1688-401c-bbe1-b497c6ed0408 tempest-ProjectMemberTests-792838276 None] Acquiring lock "cinder-quobyte-34539ee3-d0a6-40f2-a264-c0a00bdb1863" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:46 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b5d91232-1688-401c-bbe1-b497c6ed0408 tempest-ProjectMemberTests-792838276 None] Lock "cinder-quobyte-34539ee3-d0a6-40f2-a264-c0a00bdb1863" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:46 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b5d91232-1688-401c-bbe1-b497c6ed0408 tempest-ProjectMemberTests-792838276 None] Acquiring lock "cinder-quobyte-f1b63f8c-bef7-44f1-88d9-62f856a65cd1" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:47 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b5d91232-1688-401c-bbe1-b497c6ed0408 tempest-ProjectMemberTests-792838276 None] Lock "cinder-quobyte-f1b63f8c-bef7-44f1-88d9-62f856a65cd1" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:47 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-b5d91232-1688-401c-bbe1-b497c6ed0408 tempest-ProjectMemberTests-792838276 None] Deleting offline snapshot f1b63f8c-bef7-44f1-88d9-62f856a65cd1 of volume 34539ee3-d0a6-40f2-a264-c0a00bdb1863 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 04:57:47 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-b5d91232-1688-401c-bbe1-b497c6ed0408 tempest-ProjectMemberTests-792838276 None] snapshot_file for this snap is: volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863.f1b63f8c-bef7-44f1-88d9-62f856a65cd1 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 04:57:47 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8398262-1740-4210-9bad-bbde10f5a20a]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:57:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b5d91232-1688-401c-bbe1-b497c6ed0408 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863.f1b63f8c-bef7-44f1-88d9-62f856a65cd1 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:47 devstack sudo[115572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863.f1b63f8c-bef7-44f1-88d9-62f856a65cd1 Aug 11 04:57:47 devstack sudo[115572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:47 devstack sudo[115572]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b5d91232-1688-401c-bbe1-b497c6ed0408 tempest-ProjectMemberTests-792838276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863.f1b63f8c-bef7-44f1-88d9-62f856a65cd1" returned: 0 in 0.501s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:47 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-b5d91232-1688-401c-bbe1-b497c6ed0408 tempest-ProjectMemberTests-792838276 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:57:47 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b07a024-53a3-4ae4-b16b-77028ee55fbe]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:57:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b5d91232-1688-401c-bbe1-b497c6ed0408 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:47 devstack sudo[115577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863 Aug 11 04:57:47 devstack sudo[115577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:48 devstack sudo[115577]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b5d91232-1688-401c-bbe1-b497c6ed0408 tempest-ProjectMemberTests-792838276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863" returned: 0 in 0.474s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b5d91232-1688-401c-bbe1-b497c6ed0408 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863.f1b63f8c-bef7-44f1-88d9-62f856a65cd1 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:48 devstack sudo[115582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863.f1b63f8c-bef7-44f1-88d9-62f856a65cd1 Aug 11 04:57:48 devstack sudo[115582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:48 devstack sudo[115582]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b5d91232-1688-401c-bbe1-b497c6ed0408 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863.f1b63f8c-bef7-44f1-88d9-62f856a65cd1" returned: 0 in 0.401s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b5d91232-1688-401c-bbe1-b497c6ed0408 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863.f1b63f8c-bef7-44f1-88d9-62f856a65cd1 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:48 devstack sudo[115588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863.f1b63f8c-bef7-44f1-88d9-62f856a65cd1 Aug 11 04:57:48 devstack sudo[115588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:48 devstack sudo[115588]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b5d91232-1688-401c-bbe1-b497c6ed0408 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863.f1b63f8c-bef7-44f1-88d9-62f856a65cd1" returned: 0 in 0.292s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:48 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b5d91232-1688-401c-bbe1-b497c6ed0408 tempest-ProjectMemberTests-792838276 None] Lock "cinder-quobyte-f1b63f8c-bef7-44f1-88d9-62f856a65cd1" released by "_delete_snapshot" :: held 1.848s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:48 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b5d91232-1688-401c-bbe1-b497c6ed0408 tempest-ProjectMemberTests-792838276 None] Lock "cinder-quobyte-34539ee3-d0a6-40f2-a264-c0a00bdb1863" released by "delete_snapshot" :: held 1.895s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:48 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-b5d91232-1688-401c-bbe1-b497c6ed0408 tempest-ProjectMemberTests-792838276 None] Created reservations ['d414959a-6f49-4450-be0f-c873de752ac2', '063ce7fb-3156-4ae4-a0da-5648322e07bf', '9b713aa2-8196-433d-b1ae-782831a1a2c6', '5631736d-422e-498a-80ab-7cbf1df34518'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:57:49 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-b5d91232-1688-401c-bbe1-b497c6ed0408 tempest-ProjectMemberTests-792838276 None] Delete snapshot completed successfully. Aug 11 04:57:49 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b5d91232-1688-401c-bbe1-b497c6ed0408 tempest-ProjectMemberTests-792838276 None] Lock "cinder-f1b63f8c-bef7-44f1-88d9-62f856a65cd1-delete_snapshot" released by "delete_snapshot" :: held 2.148s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:49 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-08ad4810-e492-4d76-8927-da2bb147621e tempest-ProjectMemberTests-792838276 None] Acquiring lock "cinder-34539ee3-d0a6-40f2-a264-c0a00bdb1863-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:49 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa7e6155-0ea6-4d29-abb4-e013386cdc8d tempest-ProjectReaderTests-1471275840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:57:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fa7e6155-0ea6-4d29-abb4-e013386cdc8d tempest-ProjectReaderTests-1471275840 None] Flow 'volume_create_manager' (02dfc012-878a-4f81-a991-58b047ed595c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:57:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fa7e6155-0ea6-4d29-abb4-e013386cdc8d tempest-ProjectReaderTests-1471275840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0670859c-5872-483a-b88c-64c44457882f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:49 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-08ad4810-e492-4d76-8927-da2bb147621e tempest-ProjectMemberTests-792838276 None] Lock "cinder-34539ee3-d0a6-40f2-a264-c0a00bdb1863-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fa7e6155-0ea6-4d29-abb4-e013386cdc8d tempest-ProjectReaderTests-1471275840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0670859c-5872-483a-b88c-64c44457882f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:57:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1148901939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77e759ee-6092-4bf0-8ae7-e2abdefe44e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eac2d1b29af40569ab4c329774a247d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:57:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:57:49Z,use_quota=True,user_id='7e07e4dd536f4eadaa1800377499c248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fa7e6155-0ea6-4d29-abb4-e013386cdc8d tempest-ProjectReaderTests-1471275840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b6cb900-97f5-4546-a876-8559f5841c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fa7e6155-0ea6-4d29-abb4-e013386cdc8d tempest-ProjectReaderTests-1471275840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b6cb900-97f5-4546-a876-8559f5841c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fa7e6155-0ea6-4d29-abb4-e013386cdc8d tempest-ProjectReaderTests-1471275840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ea7b799-d837-441c-902d-4f65fc87fcc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fa7e6155-0ea6-4d29-abb4-e013386cdc8d tempest-ProjectReaderTests-1471275840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ea7b799-d837-441c-902d-4f65fc87fcc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77e759ee-6092-4bf0-8ae7-e2abdefe44e1', 'volume_name': 'volume-77e759ee-6092-4bf0-8ae7-e2abdefe44e1', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fa7e6155-0ea6-4d29-abb4-e013386cdc8d tempest-ProjectReaderTests-1471275840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6ab0cc3-d457-4c16-9bba-65f748f57167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fa7e6155-0ea6-4d29-abb4-e013386cdc8d tempest-ProjectReaderTests-1471275840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6ab0cc3-d457-4c16-9bba-65f748f57167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fa7e6155-0ea6-4d29-abb4-e013386cdc8d tempest-ProjectReaderTests-1471275840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e709df3-e844-4dc5-9703-1fdf9ffa0ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:49 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-fa7e6155-0ea6-4d29-abb4-e013386cdc8d tempest-ProjectReaderTests-1471275840 None] Volume 77e759ee-6092-4bf0-8ae7-e2abdefe44e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77e759ee-6092-4bf0-8ae7-e2abdefe44e1', 'volume_size': 1} Aug 11 04:57:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fa7e6155-0ea6-4d29-abb4-e013386cdc8d tempest-ProjectReaderTests-1471275840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fa7e6155-0ea6-4d29-abb4-e013386cdc8d tempest-ProjectReaderTests-1471275840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:49 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-fa7e6155-0ea6-4d29-abb4-e013386cdc8d tempest-ProjectReaderTests-1471275840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:57:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1148901939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77e759ee-6092-4bf0-8ae7-e2abdefe44e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eac2d1b29af40569ab4c329774a247d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:57:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:57:49Z,use_quota=True,user_id='7e07e4dd536f4eadaa1800377499c248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:57:49 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-fa7e6155-0ea6-4d29-abb4-e013386cdc8d tempest-ProjectReaderTests-1471275840 None] Creating volume 77e759ee-6092-4bf0-8ae7-e2abdefe44e1 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:57:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fa7e6155-0ea6-4d29-abb4-e013386cdc8d tempest-ProjectReaderTests-1471275840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fa7e6155-0ea6-4d29-abb4-e013386cdc8d tempest-ProjectReaderTests-1471275840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:49 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-fa7e6155-0ea6-4d29-abb4-e013386cdc8d tempest-ProjectReaderTests-1471275840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:57:49 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-fa7e6155-0ea6-4d29-abb4-e013386cdc8d tempest-ProjectReaderTests-1471275840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:57:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fa7e6155-0ea6-4d29-abb4-e013386cdc8d tempest-ProjectReaderTests-1471275840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:49 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-fa7e6155-0ea6-4d29-abb4-e013386cdc8d tempest-ProjectReaderTests-1471275840 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:57:49 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-fa7e6155-0ea6-4d29-abb4-e013386cdc8d tempest-ProjectReaderTests-1471275840 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:57:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fa7e6155-0ea6-4d29-abb4-e013386cdc8d tempest-ProjectReaderTests-1471275840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-77e759ee-6092-4bf0-8ae7-e2abdefe44e1 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:49 devstack sudo[115591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-77e759ee-6092-4bf0-8ae7-e2abdefe44e1 1073741824 Aug 11 04:57:49 devstack sudo[115591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:49 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-08ad4810-e492-4d76-8927-da2bb147621e tempest-ProjectMemberTests-792838276 None] Acquiring lock "cinder-quobyte-34539ee3-d0a6-40f2-a264-c0a00bdb1863" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:49 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-08ad4810-e492-4d76-8927-da2bb147621e tempest-ProjectMemberTests-792838276 None] Lock "cinder-quobyte-34539ee3-d0a6-40f2-a264-c0a00bdb1863" acquired by "delete_volume" :: waited 0.024s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:49 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[5660e872-5962-421c-ac9a-9d89df2ecc52]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:57:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-08ad4810-e492-4d76-8927-da2bb147621e tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:49 devstack sudo[115593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863 Aug 11 04:57:49 devstack sudo[115593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:49 devstack sudo[115591]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fa7e6155-0ea6-4d29-abb4-e013386cdc8d tempest-ProjectReaderTests-1471275840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-77e759ee-6092-4bf0-8ae7-e2abdefe44e1 1073741824" returned: 0 in 0.601s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:49 devstack sudo[115593]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-08ad4810-e492-4d76-8927-da2bb147621e tempest-ProjectMemberTests-792838276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863" returned: 0 in 0.481s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-08ad4810-e492-4d76-8927-da2bb147621e tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:50 devstack sudo[115602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863 Aug 11 04:57:50 devstack sudo[115602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fa7e6155-0ea6-4d29-abb4-e013386cdc8d tempest-ProjectReaderTests-1471275840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-77e759ee-6092-4bf0-8ae7-e2abdefe44e1 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:50 devstack sudo[115604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-77e759ee-6092-4bf0-8ae7-e2abdefe44e1 Aug 11 04:57:50 devstack sudo[115604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:50 devstack sudo[115602]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-08ad4810-e492-4d76-8927-da2bb147621e tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-34539ee3-d0a6-40f2-a264-c0a00bdb1863" returned: 0 in 0.353s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:50 devstack sudo[115604]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fa7e6155-0ea6-4d29-abb4-e013386cdc8d tempest-ProjectReaderTests-1471275840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-77e759ee-6092-4bf0-8ae7-e2abdefe44e1" returned: 0 in 0.335s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:50 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-fa7e6155-0ea6-4d29-abb4-e013386cdc8d tempest-ProjectReaderTests-1471275840 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:57:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fa7e6155-0ea6-4d29-abb4-e013386cdc8d tempest-ProjectReaderTests-1471275840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:50 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-08ad4810-e492-4d76-8927-da2bb147621e tempest-ProjectMemberTests-792838276 None] Lock "cinder-quobyte-34539ee3-d0a6-40f2-a264-c0a00bdb1863" released by "delete_volume" :: held 0.933s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:50 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fa7e6155-0ea6-4d29-abb4-e013386cdc8d tempest-ProjectReaderTests-1471275840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e709df3-e844-4dc5-9703-1fdf9ffa0ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77e759ee-6092-4bf0-8ae7-e2abdefe44e1', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:50 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fa7e6155-0ea6-4d29-abb4-e013386cdc8d tempest-ProjectReaderTests-1471275840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cac3285-f93b-4349-9101-d765a13ccda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:50 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-fa7e6155-0ea6-4d29-abb4-e013386cdc8d tempest-ProjectReaderTests-1471275840 None] Volume volume-77e759ee-6092-4bf0-8ae7-e2abdefe44e1 (77e759ee-6092-4bf0-8ae7-e2abdefe44e1): created successfully Aug 11 04:57:50 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fa7e6155-0ea6-4d29-abb4-e013386cdc8d tempest-ProjectReaderTests-1471275840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cac3285-f93b-4349-9101-d765a13ccda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:50 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fa7e6155-0ea6-4d29-abb4-e013386cdc8d tempest-ProjectReaderTests-1471275840 None] Flow 'volume_create_manager' (02dfc012-878a-4f81-a991-58b047ed595c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:57:50 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-fa7e6155-0ea6-4d29-abb4-e013386cdc8d tempest-ProjectReaderTests-1471275840 None] Created volume successfully. Aug 11 04:57:50 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-08ad4810-e492-4d76-8927-da2bb147621e tempest-ProjectMemberTests-792838276 None] Created reservations ['c5c695f5-4902-454f-b4d9-c3986e6aa1d2', 'cd7467ca-0e3e-4f32-bda1-88c5b290727c', '1b42042e-bd14-4cee-be1f-fb8b20efe628', '4b102ce0-2166-4886-a0cb-76e5ce444500'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:57:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-08ad4810-e492-4d76-8927-da2bb147621e tempest-ProjectMemberTests-792838276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-08ad4810-e492-4d76-8927-da2bb147621e tempest-ProjectMemberTests-792838276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:50 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-08ad4810-e492-4d76-8927-da2bb147621e tempest-ProjectMemberTests-792838276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:57:50 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-08ad4810-e492-4d76-8927-da2bb147621e tempest-ProjectMemberTests-792838276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:57:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-08ad4810-e492-4d76-8927-da2bb147621e tempest-ProjectMemberTests-792838276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-08ad4810-e492-4d76-8927-da2bb147621e tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:50 devstack sudo[115608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:57:50 devstack sudo[115608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:50 devstack sudo[115608]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-08ad4810-e492-4d76-8927-da2bb147621e tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.274s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:50 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-08ad4810-e492-4d76-8927-da2bb147621e tempest-ProjectMemberTests-792838276 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:57:50 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-08ad4810-e492-4d76-8927-da2bb147621e tempest-ProjectMemberTests-792838276 None] Deleted volume successfully. Aug 11 04:57:50 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-08ad4810-e492-4d76-8927-da2bb147621e tempest-ProjectMemberTests-792838276 None] Lock "cinder-34539ee3-d0a6-40f2-a264-c0a00bdb1863-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:51 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-3dcc9a80-02eb-44f5-96c5-28e3ba037ce0 tempest-ProjectReaderTests-1471275840 None] Acquiring lock "cinder-77e759ee-6092-4bf0-8ae7-e2abdefe44e1-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:51 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-3dcc9a80-02eb-44f5-96c5-28e3ba037ce0 tempest-ProjectReaderTests-1471275840 None] Lock "cinder-77e759ee-6092-4bf0-8ae7-e2abdefe44e1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:51 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-3dcc9a80-02eb-44f5-96c5-28e3ba037ce0 tempest-ProjectReaderTests-1471275840 None] Acquiring lock "cinder-quobyte-77e759ee-6092-4bf0-8ae7-e2abdefe44e1" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:51 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-3dcc9a80-02eb-44f5-96c5-28e3ba037ce0 tempest-ProjectReaderTests-1471275840 None] Lock "cinder-quobyte-77e759ee-6092-4bf0-8ae7-e2abdefe44e1" acquired by "delete_volume" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:51 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e849b3-73ab-4800-882d-af1717864627]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:57:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3dcc9a80-02eb-44f5-96c5-28e3ba037ce0 tempest-ProjectReaderTests-1471275840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-77e759ee-6092-4bf0-8ae7-e2abdefe44e1 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:52 devstack sudo[115611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-77e759ee-6092-4bf0-8ae7-e2abdefe44e1 Aug 11 04:57:52 devstack sudo[115611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:52 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-cac9b7ba-9fbb-450f-ace3-476366056acc tempest-ProjectMemberTests-792838276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:57:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cac9b7ba-9fbb-450f-ace3-476366056acc tempest-ProjectMemberTests-792838276 None] Flow 'volume_create_manager' (0680531d-c3ca-43f0-a9fe-b43db0ec6d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:57:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cac9b7ba-9fbb-450f-ace3-476366056acc tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f433c28-c889-493a-9c72-2b2611878853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cac9b7ba-9fbb-450f-ace3-476366056acc tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f433c28-c889-493a-9c72-2b2611878853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-457544208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06cafec8-4133-4a86-b384-bb17a388700f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac225c2b69784eb6b9ec19178ed3af8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:57:52Z,use_quota=True,user_id='4ce57473867c427a94cf64a00303ce0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cac9b7ba-9fbb-450f-ace3-476366056acc tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (134e5c09-6b85-4577-bcef-95e02cc55b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cac9b7ba-9fbb-450f-ace3-476366056acc tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (134e5c09-6b85-4577-bcef-95e02cc55b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cac9b7ba-9fbb-450f-ace3-476366056acc tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cd4320d-b3c4-4a88-ba9c-0e925cf58de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cac9b7ba-9fbb-450f-ace3-476366056acc tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cd4320d-b3c4-4a88-ba9c-0e925cf58de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06cafec8-4133-4a86-b384-bb17a388700f', 'volume_name': 'volume-06cafec8-4133-4a86-b384-bb17a388700f', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cac9b7ba-9fbb-450f-ace3-476366056acc tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee9c61bd-c4ec-442e-b028-9a247ce08315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cac9b7ba-9fbb-450f-ace3-476366056acc tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee9c61bd-c4ec-442e-b028-9a247ce08315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cac9b7ba-9fbb-450f-ace3-476366056acc tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6255353-3728-4a97-b4c6-6bebb71ed651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:52 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-cac9b7ba-9fbb-450f-ace3-476366056acc tempest-ProjectMemberTests-792838276 None] Volume 06cafec8-4133-4a86-b384-bb17a388700f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06cafec8-4133-4a86-b384-bb17a388700f', 'volume_size': 1} Aug 11 04:57:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-cac9b7ba-9fbb-450f-ace3-476366056acc tempest-ProjectMemberTests-792838276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-cac9b7ba-9fbb-450f-ace3-476366056acc tempest-ProjectMemberTests-792838276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-cac9b7ba-9fbb-450f-ace3-476366056acc tempest-ProjectMemberTests-792838276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-457544208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06cafec8-4133-4a86-b384-bb17a388700f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac225c2b69784eb6b9ec19178ed3af8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:57:52Z,use_quota=True,user_id='4ce57473867c427a94cf64a00303ce0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:57:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-cac9b7ba-9fbb-450f-ace3-476366056acc tempest-ProjectMemberTests-792838276 None] Creating volume 06cafec8-4133-4a86-b384-bb17a388700f {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:57:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-cac9b7ba-9fbb-450f-ace3-476366056acc tempest-ProjectMemberTests-792838276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-cac9b7ba-9fbb-450f-ace3-476366056acc tempest-ProjectMemberTests-792838276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-cac9b7ba-9fbb-450f-ace3-476366056acc tempest-ProjectMemberTests-792838276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:57:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-cac9b7ba-9fbb-450f-ace3-476366056acc tempest-ProjectMemberTests-792838276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:57:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-cac9b7ba-9fbb-450f-ace3-476366056acc tempest-ProjectMemberTests-792838276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-cac9b7ba-9fbb-450f-ace3-476366056acc tempest-ProjectMemberTests-792838276 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:57:52 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-cac9b7ba-9fbb-450f-ace3-476366056acc tempest-ProjectMemberTests-792838276 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:57:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cac9b7ba-9fbb-450f-ace3-476366056acc tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-06cafec8-4133-4a86-b384-bb17a388700f 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:52 devstack sudo[115613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-06cafec8-4133-4a86-b384-bb17a388700f 1073741824 Aug 11 04:57:52 devstack sudo[115613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:52 devstack sudo[115611]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3dcc9a80-02eb-44f5-96c5-28e3ba037ce0 tempest-ProjectReaderTests-1471275840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-77e759ee-6092-4bf0-8ae7-e2abdefe44e1" returned: 0 in 0.493s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3dcc9a80-02eb-44f5-96c5-28e3ba037ce0 tempest-ProjectReaderTests-1471275840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-77e759ee-6092-4bf0-8ae7-e2abdefe44e1 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:52 devstack sudo[115619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-77e759ee-6092-4bf0-8ae7-e2abdefe44e1 Aug 11 04:57:52 devstack sudo[115619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:52 devstack sudo[115619]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3dcc9a80-02eb-44f5-96c5-28e3ba037ce0 tempest-ProjectReaderTests-1471275840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-77e759ee-6092-4bf0-8ae7-e2abdefe44e1" returned: 0 in 0.330s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:52 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-3dcc9a80-02eb-44f5-96c5-28e3ba037ce0 tempest-ProjectReaderTests-1471275840 None] Lock "cinder-quobyte-77e759ee-6092-4bf0-8ae7-e2abdefe44e1" released by "delete_volume" :: held 0.913s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:52 devstack sudo[115613]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cac9b7ba-9fbb-450f-ace3-476366056acc tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-06cafec8-4133-4a86-b384-bb17a388700f 1073741824" returned: 0 in 0.574s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:52 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-3dcc9a80-02eb-44f5-96c5-28e3ba037ce0 tempest-ProjectReaderTests-1471275840 None] Created reservations ['4edbe607-5f05-4351-808e-95cbaadb5a18', '1f424f89-15fb-4e40-835e-fe3d945630ae', 'fbe1af4c-a708-42c5-8cc6-64622ccdf08f', '9776bdd2-0863-4005-b25f-dbc823299bc8'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:57:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cac9b7ba-9fbb-450f-ace3-476366056acc tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-06cafec8-4133-4a86-b384-bb17a388700f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:52 devstack sudo[115626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-06cafec8-4133-4a86-b384-bb17a388700f Aug 11 04:57:52 devstack sudo[115626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3dcc9a80-02eb-44f5-96c5-28e3ba037ce0 tempest-ProjectReaderTests-1471275840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3dcc9a80-02eb-44f5-96c5-28e3ba037ce0 tempest-ProjectReaderTests-1471275840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3dcc9a80-02eb-44f5-96c5-28e3ba037ce0 tempest-ProjectReaderTests-1471275840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:57:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3dcc9a80-02eb-44f5-96c5-28e3ba037ce0 tempest-ProjectReaderTests-1471275840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:57:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3dcc9a80-02eb-44f5-96c5-28e3ba037ce0 tempest-ProjectReaderTests-1471275840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3dcc9a80-02eb-44f5-96c5-28e3ba037ce0 tempest-ProjectReaderTests-1471275840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:52 devstack sudo[115628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:57:52 devstack sudo[115628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:53 devstack sudo[115626]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cac9b7ba-9fbb-450f-ace3-476366056acc tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-06cafec8-4133-4a86-b384-bb17a388700f" returned: 0 in 0.337s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:53 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-cac9b7ba-9fbb-450f-ace3-476366056acc tempest-ProjectMemberTests-792838276 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:57:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-cac9b7ba-9fbb-450f-ace3-476366056acc tempest-ProjectMemberTests-792838276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cac9b7ba-9fbb-450f-ace3-476366056acc tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6255353-3728-4a97-b4c6-6bebb71ed651) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06cafec8-4133-4a86-b384-bb17a388700f', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cac9b7ba-9fbb-450f-ace3-476366056acc tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b89b764a-bd55-4bcd-8459-1835b6420b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:53 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-cac9b7ba-9fbb-450f-ace3-476366056acc tempest-ProjectMemberTests-792838276 None] Volume volume-06cafec8-4133-4a86-b384-bb17a388700f (06cafec8-4133-4a86-b384-bb17a388700f): created successfully Aug 11 04:57:53 devstack sudo[115628]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cac9b7ba-9fbb-450f-ace3-476366056acc tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b89b764a-bd55-4bcd-8459-1835b6420b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cac9b7ba-9fbb-450f-ace3-476366056acc tempest-ProjectMemberTests-792838276 None] Flow 'volume_create_manager' (0680531d-c3ca-43f0-a9fe-b43db0ec6d66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:57:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3dcc9a80-02eb-44f5-96c5-28e3ba037ce0 tempest-ProjectReaderTests-1471275840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.334s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:53 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-3dcc9a80-02eb-44f5-96c5-28e3ba037ce0 tempest-ProjectReaderTests-1471275840 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:57:53 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-3dcc9a80-02eb-44f5-96c5-28e3ba037ce0 tempest-ProjectReaderTests-1471275840 None] Deleted volume successfully. Aug 11 04:57:53 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-cac9b7ba-9fbb-450f-ace3-476366056acc tempest-ProjectMemberTests-792838276 None] Created volume successfully. Aug 11 04:57:53 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-3dcc9a80-02eb-44f5-96c5-28e3ba037ce0 tempest-ProjectReaderTests-1471275840 None] Lock "cinder-77e759ee-6092-4bf0-8ae7-e2abdefe44e1-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:53 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b68c154-0d9a-4263-aa71-7b3d975815fc tempest-ProjectReaderTests-1471275840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:57:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3b68c154-0d9a-4263-aa71-7b3d975815fc tempest-ProjectReaderTests-1471275840 None] Flow 'volume_create_manager' (da6918d6-e2ae-400d-83af-468e96062138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:57:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3b68c154-0d9a-4263-aa71-7b3d975815fc tempest-ProjectReaderTests-1471275840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3018045-dabc-4eca-943b-6b8e6a20ef2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3b68c154-0d9a-4263-aa71-7b3d975815fc tempest-ProjectReaderTests-1471275840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3018045-dabc-4eca-943b-6b8e6a20ef2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-638238392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46b1b5ef-48e5-4174-94b3-0fbd14aa09f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eac2d1b29af40569ab4c329774a247d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:57:53Z,use_quota=True,user_id='7e07e4dd536f4eadaa1800377499c248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3b68c154-0d9a-4263-aa71-7b3d975815fc tempest-ProjectReaderTests-1471275840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b81cc0fe-62cb-458b-b9ab-830ca87875eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3b68c154-0d9a-4263-aa71-7b3d975815fc tempest-ProjectReaderTests-1471275840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b81cc0fe-62cb-458b-b9ab-830ca87875eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3b68c154-0d9a-4263-aa71-7b3d975815fc tempest-ProjectReaderTests-1471275840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdf8d992-ffc7-4a84-a5e4-44cbaf31e28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3b68c154-0d9a-4263-aa71-7b3d975815fc tempest-ProjectReaderTests-1471275840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdf8d992-ffc7-4a84-a5e4-44cbaf31e28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46b1b5ef-48e5-4174-94b3-0fbd14aa09f5', 'volume_name': 'volume-46b1b5ef-48e5-4174-94b3-0fbd14aa09f5', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3b68c154-0d9a-4263-aa71-7b3d975815fc tempest-ProjectReaderTests-1471275840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b471ca29-f11b-41a5-8158-1ea96dd8f1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3b68c154-0d9a-4263-aa71-7b3d975815fc tempest-ProjectReaderTests-1471275840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b471ca29-f11b-41a5-8158-1ea96dd8f1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3b68c154-0d9a-4263-aa71-7b3d975815fc tempest-ProjectReaderTests-1471275840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6073aa9-68c3-4fd1-93c6-71a65f4c2460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:53 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-3b68c154-0d9a-4263-aa71-7b3d975815fc tempest-ProjectReaderTests-1471275840 None] Volume 46b1b5ef-48e5-4174-94b3-0fbd14aa09f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46b1b5ef-48e5-4174-94b3-0fbd14aa09f5', 'volume_size': 1} Aug 11 04:57:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3b68c154-0d9a-4263-aa71-7b3d975815fc tempest-ProjectReaderTests-1471275840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3b68c154-0d9a-4263-aa71-7b3d975815fc tempest-ProjectReaderTests-1471275840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:53 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3b68c154-0d9a-4263-aa71-7b3d975815fc tempest-ProjectReaderTests-1471275840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-638238392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46b1b5ef-48e5-4174-94b3-0fbd14aa09f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eac2d1b29af40569ab4c329774a247d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:57:53Z,use_quota=True,user_id='7e07e4dd536f4eadaa1800377499c248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:57:53 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-3b68c154-0d9a-4263-aa71-7b3d975815fc tempest-ProjectReaderTests-1471275840 None] Creating volume 46b1b5ef-48e5-4174-94b3-0fbd14aa09f5 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:57:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3b68c154-0d9a-4263-aa71-7b3d975815fc tempest-ProjectReaderTests-1471275840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3b68c154-0d9a-4263-aa71-7b3d975815fc tempest-ProjectReaderTests-1471275840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:53 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3b68c154-0d9a-4263-aa71-7b3d975815fc tempest-ProjectReaderTests-1471275840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:57:53 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3b68c154-0d9a-4263-aa71-7b3d975815fc tempest-ProjectReaderTests-1471275840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:57:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3b68c154-0d9a-4263-aa71-7b3d975815fc tempest-ProjectReaderTests-1471275840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:53 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3b68c154-0d9a-4263-aa71-7b3d975815fc tempest-ProjectReaderTests-1471275840 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:57:53 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-3b68c154-0d9a-4263-aa71-7b3d975815fc tempest-ProjectReaderTests-1471275840 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:57:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3b68c154-0d9a-4263-aa71-7b3d975815fc tempest-ProjectReaderTests-1471275840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-46b1b5ef-48e5-4174-94b3-0fbd14aa09f5 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:53 devstack sudo[115633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-46b1b5ef-48e5-4174-94b3-0fbd14aa09f5 1073741824 Aug 11 04:57:53 devstack sudo[115633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:53 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=226,cinder:UPDATE=319,cinder:INSERT=81,cinder:DELETE=28 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:57:53 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:57:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] Flow 'volume_create_manager' (43406191-3ba9-4842-a0f1-b154df56d217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:57:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92693d5d-c63c-410a-807c-4794ea98274f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0760612a-0076-46f6-80b6-14be90197720 tempest-ProjectMemberTests-792838276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92693d5d-c63c-410a-807c-4794ea98274f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7bc1565-20e2-47f7-b61e-a5d60f87de6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9357954bc9dd45a69f674398d7942244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:57:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:57:54Z,use_quota=True,user_id='d02d8e244a4f4c6693ed116047245d4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed958e9c-ab0a-422f-b880-b970ef9872a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed958e9c-ab0a-422f-b880-b970ef9872a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eae8cc13-ec9a-491f-ad7e-8365254b3556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:53 devstack cinder-volume[94472]: DEBUG cinder.image.glance [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] Creating Keystone auth plugin from conf {{(pid=94472) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 11 04:57:54 devstack sudo[115633]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3b68c154-0d9a-4263-aa71-7b3d975815fc tempest-ProjectReaderTests-1471275840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-46b1b5ef-48e5-4174-94b3-0fbd14aa09f5 1073741824" returned: 0 in 0.525s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3b68c154-0d9a-4263-aa71-7b3d975815fc tempest-ProjectReaderTests-1471275840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-46b1b5ef-48e5-4174-94b3-0fbd14aa09f5 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:54 devstack sudo[115639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-46b1b5ef-48e5-4174-94b3-0fbd14aa09f5 Aug 11 04:57:54 devstack sudo[115639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:54 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eae8cc13-ec9a-491f-ad7e-8365254b3556) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f7bc1565-20e2-47f7-b61e-a5d60f87de6f', 'volume_name': 'volume-f7bc1565-20e2-47f7-b61e-a5d60f87de6f', 'volume_size': 1, 'image_id': '23d0a345-6fcb-4b11-b140-873e18521367', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23d0a345-6fcb-4b11-b140-873e18521367', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '673939fd6b4b353c5b38027c3ca2aee8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9357954bc9dd45a69f674398d7942244', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f17616642fe035431667f07c36442e6495b4922a318b716f9161c014fef634bd7b78f65bd72fbfdfe08cdf024d6aa79075c49e314c892e0a540488cd45ddd339', 'id': '23d0a345-6fcb-4b11-b140-873e18521367', 'created_at': datetime.datetime(2026, 8, 11, 2, 57, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 2, 57, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23d0a345-6fcb-4b11-b140-873e18521367/file', 'properties': {}}, 'image_service': }' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:54 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d86dcdb-2e9c-4d36-8c0e-e77176597092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:54 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d86dcdb-2e9c-4d36-8c0e-e77176597092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:54 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa96ff49-bba5-42c9-a5af-c1eb69c2c257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:54 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] Volume f7bc1565-20e2-47f7-b61e-a5d60f87de6f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f7bc1565-20e2-47f7-b61e-a5d60f87de6f', 'volume_size': 1, 'image_id': '23d0a345-6fcb-4b11-b140-873e18521367', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23d0a345-6fcb-4b11-b140-873e18521367', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '673939fd6b4b353c5b38027c3ca2aee8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9357954bc9dd45a69f674398d7942244', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f17616642fe035431667f07c36442e6495b4922a318b716f9161c014fef634bd7b78f65bd72fbfdfe08cdf024d6aa79075c49e314c892e0a540488cd45ddd339', 'id': '23d0a345-6fcb-4b11-b140-873e18521367', 'created_at': datetime.datetime(2026, 8, 11, 2, 57, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 2, 57, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23d0a345-6fcb-4b11-b140-873e18521367/file', 'properties': {}}, 'image_service': } Aug 11 04:57:54 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] Trying to clone f7bc1565-20e2-47f7-b61e-a5d60f87de6f from image 23d0a345-6fcb-4b11-b140-873e18521367 at location (None, [{'url': 'file:///opt/stack/data/glance/images/23d0a345-6fcb-4b11-b140-873e18521367', 'metadata': {}}]). {{(pid=94472) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 11 04:57:54 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_23d0a345-6fcb-4b11-b140-873e18521367_2yk26ynodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 11 04:57:54 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] Image download 0.00 MB at 0.00 MB/s Aug 11 04:57:54 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2a8b98-9ce8-4df2-9f74-3f438928ef74]: (4, 'raw') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:57:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23d0a345-6fcb-4b11-b140-873e18521367_2yk26ynodevstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:54 devstack sudo[115639]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3b68c154-0d9a-4263-aa71-7b3d975815fc tempest-ProjectReaderTests-1471275840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-46b1b5ef-48e5-4174-94b3-0fbd14aa09f5" returned: 0 in 0.313s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:54 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3b68c154-0d9a-4263-aa71-7b3d975815fc tempest-ProjectReaderTests-1471275840 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:57:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3b68c154-0d9a-4263-aa71-7b3d975815fc tempest-ProjectReaderTests-1471275840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0760612a-0076-46f6-80b6-14be90197720 tempest-ProjectMemberTests-792838276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.672s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:54 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-0760612a-0076-46f6-80b6-14be90197720 tempest-ProjectMemberTests-792838276 None] Creating offline snapshot db23f06a-239a-43ad-801a-3e98dc734dff of volume 06cafec8-4133-4a86-b384-bb17a388700f {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 04:57:54 devstack sudo[115641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23d0a345-6fcb-4b11-b140-873e18521367_2yk26ynodevstack@QuobyteHD Aug 11 04:57:54 devstack sudo[115641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:54 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3b68c154-0d9a-4263-aa71-7b3d975815fc tempest-ProjectReaderTests-1471275840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6073aa9-68c3-4fd1-93c6-71a65f4c2460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46b1b5ef-48e5-4174-94b3-0fbd14aa09f5', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:54 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3b68c154-0d9a-4263-aa71-7b3d975815fc tempest-ProjectReaderTests-1471275840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e63632b-3cd8-4bd7-ad9b-a3f8c7311324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:57:54 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47d3cc2-b4d8-4349-a92f-32c626565c77]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:57:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0760612a-0076-46f6-80b6-14be90197720 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-06cafec8-4133-4a86-b384-bb17a388700f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:54 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-3b68c154-0d9a-4263-aa71-7b3d975815fc tempest-ProjectReaderTests-1471275840 None] Volume volume-46b1b5ef-48e5-4174-94b3-0fbd14aa09f5 (46b1b5ef-48e5-4174-94b3-0fbd14aa09f5): created successfully Aug 11 04:57:54 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3b68c154-0d9a-4263-aa71-7b3d975815fc tempest-ProjectReaderTests-1471275840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e63632b-3cd8-4bd7-ad9b-a3f8c7311324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:57:54 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3b68c154-0d9a-4263-aa71-7b3d975815fc tempest-ProjectReaderTests-1471275840 None] Flow 'volume_create_manager' (da6918d6-e2ae-400d-83af-468e96062138) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:57:54 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-3b68c154-0d9a-4263-aa71-7b3d975815fc tempest-ProjectReaderTests-1471275840 None] Created volume successfully. Aug 11 04:57:54 devstack sudo[115644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-06cafec8-4133-4a86-b384-bb17a388700f Aug 11 04:57:54 devstack sudo[115644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:54 devstack sudo[115641]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23d0a345-6fcb-4b11-b140-873e18521367_2yk26ynodevstack@QuobyteHD" returned: 0 in 0.374s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23d0a345-6fcb-4b11-b140-873e18521367_2yk26ynodevstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:54 devstack sudo[115648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23d0a345-6fcb-4b11-b140-873e18521367_2yk26ynodevstack@QuobyteHD Aug 11 04:57:54 devstack sudo[115648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:55 devstack sudo[115644]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0760612a-0076-46f6-80b6-14be90197720 tempest-ProjectMemberTests-792838276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-06cafec8-4133-4a86-b384-bb17a388700f" returned: 0 in 0.424s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0760612a-0076-46f6-80b6-14be90197720 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-06cafec8-4133-4a86-b384-bb17a388700f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-06cafec8-4133-4a86-b384-bb17a388700f.db23f06a-239a-43ad-801a-3e98dc734dff 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:55 devstack sudo[115653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-06cafec8-4133-4a86-b384-bb17a388700f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-06cafec8-4133-4a86-b384-bb17a388700f.db23f06a-239a-43ad-801a-3e98dc734dff 1G Aug 11 04:57:55 devstack sudo[115653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:55 devstack sudo[115648]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23d0a345-6fcb-4b11-b140-873e18521367_2yk26ynodevstack@QuobyteHD" returned: 1 in 0.371s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23d0a345-6fcb-4b11-b140-873e18521367_2yk26ynodevstack@QuobyteHD' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 11 04:57:55 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] Temporary image 23d0a345-6fcb-4b11-b140-873e18521367 is fetched for user d02d8e244a4f4c6693ed116047245d4f. {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 11 04:57:55 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0500b0b-a4a2-41a6-8e9a-1673014625b5]: (4, 'raw') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:57:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23d0a345-6fcb-4b11-b140-873e18521367_2yk26ynodevstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:55 devstack sudo[115660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23d0a345-6fcb-4b11-b140-873e18521367_2yk26ynodevstack@QuobyteHD Aug 11 04:57:55 devstack sudo[115660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:55 devstack sudo[115653]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0760612a-0076-46f6-80b6-14be90197720 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-06cafec8-4133-4a86-b384-bb17a388700f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-06cafec8-4133-4a86-b384-bb17a388700f.db23f06a-239a-43ad-801a-3e98dc734dff 1G" returned: 0 in 0.448s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0760612a-0076-46f6-80b6-14be90197720 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06cafec8-4133-4a86-b384-bb17a388700f -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-06cafec8-4133-4a86-b384-bb17a388700f.db23f06a-239a-43ad-801a-3e98dc734dff {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:55 devstack sudo[115664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06cafec8-4133-4a86-b384-bb17a388700f -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-06cafec8-4133-4a86-b384-bb17a388700f.db23f06a-239a-43ad-801a-3e98dc734dff Aug 11 04:57:55 devstack sudo[115664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:55 devstack sudo[115660]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23d0a345-6fcb-4b11-b140-873e18521367_2yk26ynodevstack@QuobyteHD" returned: 0 in 0.398s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23d0a345-6fcb-4b11-b140-873e18521367_2yk26ynodevstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:55 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-836f358f-a0e1-48fc-8be8-f433651b2ce3 tempest-ProjectReaderTests-1471275840 None] Acquiring lock "cinder-46b1b5ef-48e5-4174-94b3-0fbd14aa09f5-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:55 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-836f358f-a0e1-48fc-8be8-f433651b2ce3 tempest-ProjectReaderTests-1471275840 None] Lock "cinder-46b1b5ef-48e5-4174-94b3-0fbd14aa09f5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:55 devstack sudo[115668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23d0a345-6fcb-4b11-b140-873e18521367_2yk26ynodevstack@QuobyteHD Aug 11 04:57:55 devstack sudo[115668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:55 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-836f358f-a0e1-48fc-8be8-f433651b2ce3 tempest-ProjectReaderTests-1471275840 None] Acquiring lock "cinder-quobyte-46b1b5ef-48e5-4174-94b3-0fbd14aa09f5" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:55 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-836f358f-a0e1-48fc-8be8-f433651b2ce3 tempest-ProjectReaderTests-1471275840 None] Lock "cinder-quobyte-46b1b5ef-48e5-4174-94b3-0fbd14aa09f5" acquired by "delete_volume" :: waited 0.025s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:55 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab17a87-ec25-4c12-ad5a-5241656315da]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:57:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-836f358f-a0e1-48fc-8be8-f433651b2ce3 tempest-ProjectReaderTests-1471275840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-46b1b5ef-48e5-4174-94b3-0fbd14aa09f5 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:56 devstack sudo[115664]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0760612a-0076-46f6-80b6-14be90197720 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06cafec8-4133-4a86-b384-bb17a388700f -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-06cafec8-4133-4a86-b384-bb17a388700f.db23f06a-239a-43ad-801a-3e98dc734dff" returned: 0 in 0.486s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:56 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-0760612a-0076-46f6-80b6-14be90197720 tempest-ProjectMemberTests-792838276 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-06cafec8-4133-4a86-b384-bb17a388700f.db23f06a-239a-43ad-801a-3e98dc734dff is being set with open permissions: ugo+rw Aug 11 04:57:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0760612a-0076-46f6-80b6-14be90197720 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-06cafec8-4133-4a86-b384-bb17a388700f.db23f06a-239a-43ad-801a-3e98dc734dff {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:56 devstack sudo[115674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-06cafec8-4133-4a86-b384-bb17a388700f.db23f06a-239a-43ad-801a-3e98dc734dff Aug 11 04:57:56 devstack sudo[115674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:56 devstack sudo[115673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-46b1b5ef-48e5-4174-94b3-0fbd14aa09f5 Aug 11 04:57:56 devstack sudo[115673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:56 devstack sudo[115668]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23d0a345-6fcb-4b11-b140-873e18521367_2yk26ynodevstack@QuobyteHD" returned: 1 in 0.517s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23d0a345-6fcb-4b11-b140-873e18521367_2yk26ynodevstack@QuobyteHD' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 11 04:57:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:56 devstack sudo[115674]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0760612a-0076-46f6-80b6-14be90197720 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-06cafec8-4133-4a86-b384-bb17a388700f.db23f06a-239a-43ad-801a-3e98dc734dff" returned: 0 in 0.312s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0760612a-0076-46f6-80b6-14be90197720 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-06cafec8-4133-4a86-b384-bb17a388700f.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:56 devstack sudo[115683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-06cafec8-4133-4a86-b384-bb17a388700f.info Aug 11 04:57:56 devstack sudo[115683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:56 devstack sudo[115673]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-836f358f-a0e1-48fc-8be8-f433651b2ce3 tempest-ProjectReaderTests-1471275840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-46b1b5ef-48e5-4174-94b3-0fbd14aa09f5" returned: 0 in 0.448s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-836f358f-a0e1-48fc-8be8-f433651b2ce3 tempest-ProjectReaderTests-1471275840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-46b1b5ef-48e5-4174-94b3-0fbd14aa09f5 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:56 devstack sudo[115686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-46b1b5ef-48e5-4174-94b3-0fbd14aa09f5 Aug 11 04:57:56 devstack sudo[115686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:56 devstack sudo[115683]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0760612a-0076-46f6-80b6-14be90197720 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-06cafec8-4133-4a86-b384-bb17a388700f.info" returned: 0 in 0.279s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:56 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-0760612a-0076-46f6-80b6-14be90197720 tempest-ProjectMemberTests-792838276 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-06cafec8-4133-4a86-b384-bb17a388700f.info is being set with open permissions: ugo+rw Aug 11 04:57:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0760612a-0076-46f6-80b6-14be90197720 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-06cafec8-4133-4a86-b384-bb17a388700f.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:56 devstack sudo[115690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-06cafec8-4133-4a86-b384-bb17a388700f.info Aug 11 04:57:56 devstack sudo[115690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:56 devstack sudo[115686]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-836f358f-a0e1-48fc-8be8-f433651b2ce3 tempest-ProjectReaderTests-1471275840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-46b1b5ef-48e5-4174-94b3-0fbd14aa09f5" returned: 0 in 0.260s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:56 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-836f358f-a0e1-48fc-8be8-f433651b2ce3 tempest-ProjectReaderTests-1471275840 None] Lock "cinder-quobyte-46b1b5ef-48e5-4174-94b3-0fbd14aa09f5" released by "delete_volume" :: held 0.768s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:56 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-836f358f-a0e1-48fc-8be8-f433651b2ce3 tempest-ProjectReaderTests-1471275840 None] Created reservations ['b0198e19-dcf7-43c7-b941-7879a12271b1', 'e35cbf47-1eff-4fb7-b06a-246d06bd98c3', 'f3738e9f-2ff2-473b-b1f0-1751675cd495', '48ac4a01-f5b1-41a5-ba65-7e57289d2da5'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:57:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-836f358f-a0e1-48fc-8be8-f433651b2ce3 tempest-ProjectReaderTests-1471275840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-836f358f-a0e1-48fc-8be8-f433651b2ce3 tempest-ProjectReaderTests-1471275840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-836f358f-a0e1-48fc-8be8-f433651b2ce3 tempest-ProjectReaderTests-1471275840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:57:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-836f358f-a0e1-48fc-8be8-f433651b2ce3 tempest-ProjectReaderTests-1471275840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:57:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-836f358f-a0e1-48fc-8be8-f433651b2ce3 tempest-ProjectReaderTests-1471275840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-836f358f-a0e1-48fc-8be8-f433651b2ce3 tempest-ProjectReaderTests-1471275840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:56 devstack sudo[115692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:57:56 devstack sudo[115692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:56 devstack sudo[115690]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0760612a-0076-46f6-80b6-14be90197720 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-06cafec8-4133-4a86-b384-bb17a388700f.info" returned: 0 in 0.264s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0760612a-0076-46f6-80b6-14be90197720 tempest-ProjectMemberTests-792838276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.338s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.707s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7bc1565-20e2-47f7-b61e-a5d60f87de6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9357954bc9dd45a69f674398d7942244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:57:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:57:54Z,use_quota=True,user_id='d02d8e244a4f4c6693ed116047245d4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:57:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] Creating volume f7bc1565-20e2-47f7-b61e-a5d60f87de6f {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:57:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:57:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:57:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:57:56 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:57:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f7bc1565-20e2-47f7-b61e-a5d60f87de6f 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:56 devstack sudo[115695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f7bc1565-20e2-47f7-b61e-a5d60f87de6f 1073741824 Aug 11 04:57:56 devstack sudo[115695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:56 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-0760612a-0076-46f6-80b6-14be90197720 tempest-ProjectMemberTests-792838276 None] Create snapshot completed successfully Aug 11 04:57:57 devstack sudo[115692]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-836f358f-a0e1-48fc-8be8-f433651b2ce3 tempest-ProjectReaderTests-1471275840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.282s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:57 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-836f358f-a0e1-48fc-8be8-f433651b2ce3 tempest-ProjectReaderTests-1471275840 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:57:57 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-836f358f-a0e1-48fc-8be8-f433651b2ce3 tempest-ProjectReaderTests-1471275840 None] Deleted volume successfully. Aug 11 04:57:57 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-307cbb42-7515-4054-8d7b-fa442c4748f0 tempest-ProjectMemberTests-792838276 None] Acquiring lock "cinder-db23f06a-239a-43ad-801a-3e98dc734dff-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:57 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-836f358f-a0e1-48fc-8be8-f433651b2ce3 tempest-ProjectReaderTests-1471275840 None] Lock "cinder-46b1b5ef-48e5-4174-94b3-0fbd14aa09f5-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:57 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-307cbb42-7515-4054-8d7b-fa442c4748f0 tempest-ProjectMemberTests-792838276 None] Lock "cinder-db23f06a-239a-43ad-801a-3e98dc734dff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:57 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-307cbb42-7515-4054-8d7b-fa442c4748f0 tempest-ProjectMemberTests-792838276 None] Acquiring lock "cinder-quobyte-06cafec8-4133-4a86-b384-bb17a388700f" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:57 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-307cbb42-7515-4054-8d7b-fa442c4748f0 tempest-ProjectMemberTests-792838276 None] Lock "cinder-quobyte-06cafec8-4133-4a86-b384-bb17a388700f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:57 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-307cbb42-7515-4054-8d7b-fa442c4748f0 tempest-ProjectMemberTests-792838276 None] Acquiring lock "cinder-quobyte-db23f06a-239a-43ad-801a-3e98dc734dff" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:57 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-307cbb42-7515-4054-8d7b-fa442c4748f0 tempest-ProjectMemberTests-792838276 None] Lock "cinder-quobyte-db23f06a-239a-43ad-801a-3e98dc734dff" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-307cbb42-7515-4054-8d7b-fa442c4748f0 tempest-ProjectMemberTests-792838276 None] Deleting offline snapshot db23f06a-239a-43ad-801a-3e98dc734dff of volume 06cafec8-4133-4a86-b384-bb17a388700f {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 04:57:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-307cbb42-7515-4054-8d7b-fa442c4748f0 tempest-ProjectMemberTests-792838276 None] snapshot_file for this snap is: volume-06cafec8-4133-4a86-b384-bb17a388700f.db23f06a-239a-43ad-801a-3e98dc734dff {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 04:57:57 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f09fea-fa03-4e36-8d7d-246c9f10cd15]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:57:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-307cbb42-7515-4054-8d7b-fa442c4748f0 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-06cafec8-4133-4a86-b384-bb17a388700f.db23f06a-239a-43ad-801a-3e98dc734dff {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:57 devstack sudo[115701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-06cafec8-4133-4a86-b384-bb17a388700f.db23f06a-239a-43ad-801a-3e98dc734dff Aug 11 04:57:57 devstack sudo[115701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:57 devstack sudo[115695]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f7bc1565-20e2-47f7-b61e-a5d60f87de6f 1073741824" returned: 0 in 0.672s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f7bc1565-20e2-47f7-b61e-a5d60f87de6f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:57 devstack sudo[115705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f7bc1565-20e2-47f7-b61e-a5d60f87de6f Aug 11 04:57:57 devstack sudo[115705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:57 devstack sudo[115701]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-307cbb42-7515-4054-8d7b-fa442c4748f0 tempest-ProjectMemberTests-792838276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-06cafec8-4133-4a86-b384-bb17a388700f.db23f06a-239a-43ad-801a-3e98dc734dff" returned: 0 in 0.523s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-307cbb42-7515-4054-8d7b-fa442c4748f0 tempest-ProjectMemberTests-792838276 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06cafec8-4133-4a86-b384-bb17a388700f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:57:57 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2173d7-af2a-4bbc-b612-2698866f5103]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:57:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-307cbb42-7515-4054-8d7b-fa442c4748f0 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-06cafec8-4133-4a86-b384-bb17a388700f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:57 devstack sudo[115705]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f7bc1565-20e2-47f7-b61e-a5d60f87de6f" returned: 0 in 0.314s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:57:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:58 devstack sudo[115709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-06cafec8-4133-4a86-b384-bb17a388700f Aug 11 04:57:58 devstack sudo[115709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:58 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] Attempting download of 23d0a345-6fcb-4b11-b140-873e18521367 ((None, [{'url': 'file:///opt/stack/data/glance/images/23d0a345-6fcb-4b11-b140-873e18521367', 'metadata': {}}])) to volume f7bc1565-20e2-47f7-b61e-a5d60f87de6f. {{(pid=94472) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 11 04:57:58 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae41683-dad1-4593-baad-fb811499d92e]: (4, 'raw') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:57:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23d0a345-6fcb-4b11-b140-873e18521367_tynb88gw {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:58 devstack sudo[115712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23d0a345-6fcb-4b11-b140-873e18521367_tynb88gw Aug 11 04:57:58 devstack sudo[115712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:58 devstack sudo[115709]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-307cbb42-7515-4054-8d7b-fa442c4748f0 tempest-ProjectMemberTests-792838276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-06cafec8-4133-4a86-b384-bb17a388700f" returned: 0 in 0.523s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-307cbb42-7515-4054-8d7b-fa442c4748f0 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-06cafec8-4133-4a86-b384-bb17a388700f.db23f06a-239a-43ad-801a-3e98dc734dff {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:58 devstack sudo[115717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-06cafec8-4133-4a86-b384-bb17a388700f.db23f06a-239a-43ad-801a-3e98dc734dff Aug 11 04:57:58 devstack sudo[115717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:58 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 04:57:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:57:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:57:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:57:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:57:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:57:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:58 devstack sudo[115712]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23d0a345-6fcb-4b11-b140-873e18521367_tynb88gw" returned: 0 in 0.402s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23d0a345-6fcb-4b11-b140-873e18521367_tynb88gw {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:58 devstack sudo[115721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:57:58 devstack sudo[115721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:58 devstack sudo[115723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23d0a345-6fcb-4b11-b140-873e18521367_tynb88gw Aug 11 04:57:58 devstack sudo[115723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:58 devstack sudo[115717]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-307cbb42-7515-4054-8d7b-fa442c4748f0 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-06cafec8-4133-4a86-b384-bb17a388700f.db23f06a-239a-43ad-801a-3e98dc734dff" returned: 0 in 0.443s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-307cbb42-7515-4054-8d7b-fa442c4748f0 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-06cafec8-4133-4a86-b384-bb17a388700f.db23f06a-239a-43ad-801a-3e98dc734dff {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:58 devstack sudo[115721]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.322s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:58 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:57:58 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running periodic task VolumeManager._thread_info {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 04:57:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] thread count: 28 {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 11 04:57:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] thread info: [<_MainThread(MainThread, started 133315846115456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 11 04:57:58 devstack sudo[115729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-06cafec8-4133-4a86-b384-bb17a388700f.db23f06a-239a-43ad-801a-3e98dc734dff Aug 11 04:57:58 devstack sudo[115729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:58 devstack sudo[115723]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23d0a345-6fcb-4b11-b140-873e18521367_tynb88gw" returned: 1 in 0.425s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23d0a345-6fcb-4b11-b140-873e18521367_tynb88gw' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 11 04:57:58 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f9fc25-9a90-4878-9ea1-4a58fb6abd50]: (4, 'raw') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:57:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23d0a345-6fcb-4b11-b140-873e18521367_2yk26ynodevstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:59 devstack sudo[115729]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-307cbb42-7515-4054-8d7b-fa442c4748f0 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-06cafec8-4133-4a86-b384-bb17a388700f.db23f06a-239a-43ad-801a-3e98dc734dff" returned: 0 in 0.279s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:59 devstack sudo[115733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23d0a345-6fcb-4b11-b140-873e18521367_2yk26ynodevstack@QuobyteHD Aug 11 04:57:59 devstack sudo[115733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:59 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-307cbb42-7515-4054-8d7b-fa442c4748f0 tempest-ProjectMemberTests-792838276 None] Lock "cinder-quobyte-db23f06a-239a-43ad-801a-3e98dc734dff" released by "_delete_snapshot" :: held 1.901s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:59 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-307cbb42-7515-4054-8d7b-fa442c4748f0 tempest-ProjectMemberTests-792838276 None] Lock "cinder-quobyte-06cafec8-4133-4a86-b384-bb17a388700f" released by "delete_snapshot" :: held 1.933s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:59 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:UPDATE=327,cinder:SELECT=248,cinder:DELETE=30,cinder:INSERT=83 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:57:59 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-307cbb42-7515-4054-8d7b-fa442c4748f0 tempest-ProjectMemberTests-792838276 None] Created reservations ['b36bc8a6-afdf-434b-b0dc-7a8521a4aeea', '34f3a336-5154-427f-8af2-f7d68408158a', '7a462a83-f54d-4150-afe3-df5510c7a836', '12783d86-c39b-4c55-890b-14c6d8b43e04'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:57:59 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-307cbb42-7515-4054-8d7b-fa442c4748f0 tempest-ProjectMemberTests-792838276 None] Delete snapshot completed successfully. Aug 11 04:57:59 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-307cbb42-7515-4054-8d7b-fa442c4748f0 tempest-ProjectMemberTests-792838276 None] Lock "cinder-db23f06a-239a-43ad-801a-3e98dc734dff-delete_snapshot" released by "delete_snapshot" :: held 2.144s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:57:59 devstack sudo[115733]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23d0a345-6fcb-4b11-b140-873e18521367_2yk26ynodevstack@QuobyteHD" returned: 0 in 0.431s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23d0a345-6fcb-4b11-b140-873e18521367_2yk26ynodevstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:59 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e717a37d-5482-4fad-b17b-eb9a06eaead6 tempest-ProjectMemberTests-792838276 None] Acquiring lock "cinder-06cafec8-4133-4a86-b384-bb17a388700f-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:59 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e717a37d-5482-4fad-b17b-eb9a06eaead6 tempest-ProjectMemberTests-792838276 None] Lock "cinder-06cafec8-4133-4a86-b384-bb17a388700f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:59 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e717a37d-5482-4fad-b17b-eb9a06eaead6 tempest-ProjectMemberTests-792838276 None] Acquiring lock "cinder-quobyte-06cafec8-4133-4a86-b384-bb17a388700f" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:57:59 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e717a37d-5482-4fad-b17b-eb9a06eaead6 tempest-ProjectMemberTests-792838276 None] Lock "cinder-quobyte-06cafec8-4133-4a86-b384-bb17a388700f" acquired by "delete_volume" :: waited 0.027s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:57:59 devstack sudo[115738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23d0a345-6fcb-4b11-b140-873e18521367_2yk26ynodevstack@QuobyteHD Aug 11 04:57:59 devstack sudo[115738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:59 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d6723f-4820-4251-ac07-365a5e962db4]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:57:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e717a37d-5482-4fad-b17b-eb9a06eaead6 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-06cafec8-4133-4a86-b384-bb17a388700f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:59 devstack sudo[115740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-06cafec8-4133-4a86-b384-bb17a388700f Aug 11 04:57:59 devstack sudo[115740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:57:59 devstack sudo[115738]: pam_unix(sudo:session): session closed for user root Aug 11 04:57:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23d0a345-6fcb-4b11-b140-873e18521367_2yk26ynodevstack@QuobyteHD" returned: 1 in 0.459s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:57:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23d0a345-6fcb-4b11-b140-873e18521367_2yk26ynodevstack@QuobyteHD' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 11 04:57:59 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] 23d0a345-6fcb-4b11-b140-873e18521367 was raw, converting to qcow2 {{(pid=94472) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 11 04:57:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_23d0a345-6fcb-4b11-b140-873e18521367_2yk26ynodevstack@QuobyteHD /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f7bc1565-20e2-47f7-b61e-a5d60f87de6f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:57:59 devstack sudo[115745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_23d0a345-6fcb-4b11-b140-873e18521367_2yk26ynodevstack@QuobyteHD /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f7bc1565-20e2-47f7-b61e-a5d60f87de6f Aug 11 04:57:59 devstack sudo[115745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:00 devstack sudo[115740]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e717a37d-5482-4fad-b17b-eb9a06eaead6 tempest-ProjectMemberTests-792838276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-06cafec8-4133-4a86-b384-bb17a388700f" returned: 0 in 0.478s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e717a37d-5482-4fad-b17b-eb9a06eaead6 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-06cafec8-4133-4a86-b384-bb17a388700f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:00 devstack sudo[115751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-06cafec8-4133-4a86-b384-bb17a388700f Aug 11 04:58:00 devstack sudo[115751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:00 devstack sudo[115751]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e717a37d-5482-4fad-b17b-eb9a06eaead6 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-06cafec8-4133-4a86-b384-bb17a388700f" returned: 0 in 0.343s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:00 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e717a37d-5482-4fad-b17b-eb9a06eaead6 tempest-ProjectMemberTests-792838276 None] Lock "cinder-quobyte-06cafec8-4133-4a86-b384-bb17a388700f" released by "delete_volume" :: held 0.915s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:00 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-e717a37d-5482-4fad-b17b-eb9a06eaead6 tempest-ProjectMemberTests-792838276 None] Created reservations ['377868fc-c34a-4e35-b8b0-a3ffd1a672c5', '508a9ff6-51b9-43f7-8008-76ff84706ab1', '0460d63c-3b05-447d-ba7b-ad3be57a115e', '91642127-9c63-4d42-84e2-269c1907ec81'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:58:00 devstack sudo[115745]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_23d0a345-6fcb-4b11-b140-873e18521367_2yk26ynodevstack@QuobyteHD /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f7bc1565-20e2-47f7-b61e-a5d60f87de6f" returned: 0 in 0.656s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:00 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_23d0a345-6fcb-4b11-b140-873e18521367_2yk26ynodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f7bc1565-20e2-47f7-b61e-a5d60f87de6f {{(pid=94472) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 11 04:58:00 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] Converted 0.00 MB image at 0.00 MB/s Aug 11 04:58:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f7bc1565-20e2-47f7-b61e-a5d60f87de6f 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:00 devstack sudo[115758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f7bc1565-20e2-47f7-b61e-a5d60f87de6f 1G Aug 11 04:58:00 devstack sudo[115758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e717a37d-5482-4fad-b17b-eb9a06eaead6 tempest-ProjectMemberTests-792838276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e717a37d-5482-4fad-b17b-eb9a06eaead6 tempest-ProjectMemberTests-792838276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:00 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e717a37d-5482-4fad-b17b-eb9a06eaead6 tempest-ProjectMemberTests-792838276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:58:00 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e717a37d-5482-4fad-b17b-eb9a06eaead6 tempest-ProjectMemberTests-792838276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:58:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e717a37d-5482-4fad-b17b-eb9a06eaead6 tempest-ProjectMemberTests-792838276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e717a37d-5482-4fad-b17b-eb9a06eaead6 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:00 devstack sudo[115760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:58:00 devstack sudo[115760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:00 devstack sudo[115758]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f7bc1565-20e2-47f7-b61e-a5d60f87de6f 1G" returned: 0 in 0.357s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:00 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] Downloaded image 23d0a345-6fcb-4b11-b140-873e18521367 ((None, [{'url': 'file:///opt/stack/data/glance/images/23d0a345-6fcb-4b11-b140-873e18521367', 'metadata': {}}])) to volume f7bc1565-20e2-47f7-b61e-a5d60f87de6f successfully. {{(pid=94472) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 11 04:58:00 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] Temporary image 23d0a345-6fcb-4b11-b140-873e18521367 for user d02d8e244a4f4c6693ed116047245d4f is deleted. {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 11 04:58:00 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] Marking volume f7bc1565-20e2-47f7-b61e-a5d60f87de6f as bootable. {{(pid=94472) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 11 04:58:00 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] Copying metadata from image 23d0a345-6fcb-4b11-b140-873e18521367 to f7bc1565-20e2-47f7-b61e-a5d60f87de6f. {{(pid=94472) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 11 04:58:00 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] Creating volume glance metadata for volume f7bc1565-20e2-47f7-b61e-a5d60f87de6f backed by image 23d0a345-6fcb-4b11-b140-873e18521367 with: {'image_id': '23d0a345-6fcb-4b11-b140-873e18521367', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '673939fd6b4b353c5b38027c3ca2aee8', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94472) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 11 04:58:00 devstack sudo[115760]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e717a37d-5482-4fad-b17b-eb9a06eaead6 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.297s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:00 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-e717a37d-5482-4fad-b17b-eb9a06eaead6 tempest-ProjectMemberTests-792838276 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:58:00 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-e717a37d-5482-4fad-b17b-eb9a06eaead6 tempest-ProjectMemberTests-792838276 None] Deleted volume successfully. Aug 11 04:58:00 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e717a37d-5482-4fad-b17b-eb9a06eaead6 tempest-ProjectMemberTests-792838276 None] Lock "cinder-06cafec8-4133-4a86-b384-bb17a388700f-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:01 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa96ff49-bba5-42c9-a5af-c1eb69c2c257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7bc1565-20e2-47f7-b61e-a5d60f87de6f', 'volume_size': 1, 'image_id': '23d0a345-6fcb-4b11-b140-873e18521367', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23d0a345-6fcb-4b11-b140-873e18521367', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '673939fd6b4b353c5b38027c3ca2aee8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9357954bc9dd45a69f674398d7942244', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f17616642fe035431667f07c36442e6495b4922a318b716f9161c014fef634bd7b78f65bd72fbfdfe08cdf024d6aa79075c49e314c892e0a540488cd45ddd339', 'id': '23d0a345-6fcb-4b11-b140-873e18521367', 'created_at': datetime.datetime(2026, 8, 11, 2, 57, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 2, 57, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23d0a345-6fcb-4b11-b140-873e18521367/file', 'properties': {}}, 'image_service': }' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:01 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52b31256-721a-4f6f-86ab-7c2bdf68189a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:01 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] Volume volume-f7bc1565-20e2-47f7-b61e-a5d60f87de6f (f7bc1565-20e2-47f7-b61e-a5d60f87de6f): created successfully Aug 11 04:58:01 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52b31256-721a-4f6f-86ab-7c2bdf68189a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:01 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] Flow 'volume_create_manager' (43406191-3ba9-4842-a0f1-b154df56d217) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:58:01 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-d6a501e9-c762-4793-a758-ea43206dcf19 tempest-VolumeImageDependencyTests-32833456 None] Created volume successfully. Aug 11 04:58:01 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1651c77c-0f8a-477b-b504-e928233b36bc tempest-VolumeImageDependencyTests-32833456 None] Acquiring lock "cinder-f7bc1565-20e2-47f7-b61e-a5d60f87de6f-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:01 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1651c77c-0f8a-477b-b504-e928233b36bc tempest-VolumeImageDependencyTests-32833456 None] Lock "cinder-f7bc1565-20e2-47f7-b61e-a5d60f87de6f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:01 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1651c77c-0f8a-477b-b504-e928233b36bc tempest-VolumeImageDependencyTests-32833456 None] Acquiring lock "cinder-quobyte-f7bc1565-20e2-47f7-b61e-a5d60f87de6f" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:01 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1651c77c-0f8a-477b-b504-e928233b36bc tempest-VolumeImageDependencyTests-32833456 None] Lock "cinder-quobyte-f7bc1565-20e2-47f7-b61e-a5d60f87de6f" acquired by "delete_volume" :: waited 0.022s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:01 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ae0b0c-fccb-47a4-8419-43b2dd6342a7]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:58:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1651c77c-0f8a-477b-b504-e928233b36bc tempest-VolumeImageDependencyTests-32833456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f7bc1565-20e2-47f7-b61e-a5d60f87de6f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:01 devstack sudo[115768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f7bc1565-20e2-47f7-b61e-a5d60f87de6f Aug 11 04:58:01 devstack sudo[115768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:02 devstack sudo[115768]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1651c77c-0f8a-477b-b504-e928233b36bc tempest-VolumeImageDependencyTests-32833456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f7bc1565-20e2-47f7-b61e-a5d60f87de6f" returned: 0 in 0.432s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1651c77c-0f8a-477b-b504-e928233b36bc tempest-VolumeImageDependencyTests-32833456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f7bc1565-20e2-47f7-b61e-a5d60f87de6f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:02 devstack sudo[115773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f7bc1565-20e2-47f7-b61e-a5d60f87de6f Aug 11 04:58:02 devstack sudo[115773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:02 devstack sudo[115773]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1651c77c-0f8a-477b-b504-e928233b36bc tempest-VolumeImageDependencyTests-32833456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f7bc1565-20e2-47f7-b61e-a5d60f87de6f" returned: 0 in 0.344s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1651c77c-0f8a-477b-b504-e928233b36bc tempest-VolumeImageDependencyTests-32833456 None] Lock "cinder-quobyte-f7bc1565-20e2-47f7-b61e-a5d60f87de6f" released by "delete_volume" :: held 0.852s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:02 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-d725b7cc-463f-4808-9801-83574a2ace33 tempest-ProjectMemberTests-792838276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:58:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d725b7cc-463f-4808-9801-83574a2ace33 tempest-ProjectMemberTests-792838276 None] Flow 'volume_create_manager' (d0d89748-7672-452f-874a-b5efe22dd36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:58:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d725b7cc-463f-4808-9801-83574a2ace33 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa306183-4af9-44d6-abb4-8f1648728dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d725b7cc-463f-4808-9801-83574a2ace33 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa306183-4af9-44d6-abb4-8f1648728dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-125185955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19f26a59-41b4-4627-9409-e255761b8068,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac225c2b69784eb6b9ec19178ed3af8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:58:02Z,use_quota=True,user_id='4ce57473867c427a94cf64a00303ce0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d725b7cc-463f-4808-9801-83574a2ace33 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca5a3d85-7f5e-4472-a9a0-e06c1442effe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d725b7cc-463f-4808-9801-83574a2ace33 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca5a3d85-7f5e-4472-a9a0-e06c1442effe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d725b7cc-463f-4808-9801-83574a2ace33 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f43dcad-5219-4f4d-bb10-7495ee250a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d725b7cc-463f-4808-9801-83574a2ace33 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f43dcad-5219-4f4d-bb10-7495ee250a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19f26a59-41b4-4627-9409-e255761b8068', 'volume_name': 'volume-19f26a59-41b4-4627-9409-e255761b8068', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d725b7cc-463f-4808-9801-83574a2ace33 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0fef675-5b12-416b-b371-3d77d5c464fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d725b7cc-463f-4808-9801-83574a2ace33 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0fef675-5b12-416b-b371-3d77d5c464fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d725b7cc-463f-4808-9801-83574a2ace33 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e426d69-dab9-4876-bb99-5346a7c33c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:02 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-d725b7cc-463f-4808-9801-83574a2ace33 tempest-ProjectMemberTests-792838276 None] Volume 19f26a59-41b4-4627-9409-e255761b8068: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19f26a59-41b4-4627-9409-e255761b8068', 'volume_size': 1} Aug 11 04:58:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d725b7cc-463f-4808-9801-83574a2ace33 tempest-ProjectMemberTests-792838276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d725b7cc-463f-4808-9801-83574a2ace33 tempest-ProjectMemberTests-792838276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d725b7cc-463f-4808-9801-83574a2ace33 tempest-ProjectMemberTests-792838276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-125185955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19f26a59-41b4-4627-9409-e255761b8068,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac225c2b69784eb6b9ec19178ed3af8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:58:02Z,use_quota=True,user_id='4ce57473867c427a94cf64a00303ce0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:58:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-d725b7cc-463f-4808-9801-83574a2ace33 tempest-ProjectMemberTests-792838276 None] Creating volume 19f26a59-41b4-4627-9409-e255761b8068 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:58:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d725b7cc-463f-4808-9801-83574a2ace33 tempest-ProjectMemberTests-792838276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d725b7cc-463f-4808-9801-83574a2ace33 tempest-ProjectMemberTests-792838276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d725b7cc-463f-4808-9801-83574a2ace33 tempest-ProjectMemberTests-792838276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:58:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d725b7cc-463f-4808-9801-83574a2ace33 tempest-ProjectMemberTests-792838276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:58:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d725b7cc-463f-4808-9801-83574a2ace33 tempest-ProjectMemberTests-792838276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d725b7cc-463f-4808-9801-83574a2ace33 tempest-ProjectMemberTests-792838276 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:58:02 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-d725b7cc-463f-4808-9801-83574a2ace33 tempest-ProjectMemberTests-792838276 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:58:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d725b7cc-463f-4808-9801-83574a2ace33 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-19f26a59-41b4-4627-9409-e255761b8068 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:02 devstack sudo[115776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-19f26a59-41b4-4627-9409-e255761b8068 1073741824 Aug 11 04:58:02 devstack sudo[115776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:02 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-1651c77c-0f8a-477b-b504-e928233b36bc tempest-VolumeImageDependencyTests-32833456 None] Created reservations ['3dec1201-e50c-4f76-82a5-49111cd2f871', '2a6ffd68-7056-4056-b447-9b75696ce021', '367ec294-a5ac-436d-991f-478583814fc5', '1197124f-4ab7-45f9-bd53-2cfdf62c1e00'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:58:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1651c77c-0f8a-477b-b504-e928233b36bc tempest-VolumeImageDependencyTests-32833456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1651c77c-0f8a-477b-b504-e928233b36bc tempest-VolumeImageDependencyTests-32833456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1651c77c-0f8a-477b-b504-e928233b36bc tempest-VolumeImageDependencyTests-32833456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:58:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1651c77c-0f8a-477b-b504-e928233b36bc tempest-VolumeImageDependencyTests-32833456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:58:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1651c77c-0f8a-477b-b504-e928233b36bc tempest-VolumeImageDependencyTests-32833456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1651c77c-0f8a-477b-b504-e928233b36bc tempest-VolumeImageDependencyTests-32833456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:02 devstack sudo[115778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:58:02 devstack sudo[115778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:03 devstack sudo[115778]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1651c77c-0f8a-477b-b504-e928233b36bc tempest-VolumeImageDependencyTests-32833456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.382s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:03 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-1651c77c-0f8a-477b-b504-e928233b36bc tempest-VolumeImageDependencyTests-32833456 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:58:03 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-1651c77c-0f8a-477b-b504-e928233b36bc tempest-VolumeImageDependencyTests-32833456 None] Deleted volume successfully. Aug 11 04:58:03 devstack sudo[115776]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d725b7cc-463f-4808-9801-83574a2ace33 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-19f26a59-41b4-4627-9409-e255761b8068 1073741824" returned: 0 in 0.580s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:03 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1651c77c-0f8a-477b-b504-e928233b36bc tempest-VolumeImageDependencyTests-32833456 None] Lock "cinder-f7bc1565-20e2-47f7-b61e-a5d60f87de6f-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d725b7cc-463f-4808-9801-83574a2ace33 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-19f26a59-41b4-4627-9409-e255761b8068 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:03 devstack sudo[115785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-19f26a59-41b4-4627-9409-e255761b8068 Aug 11 04:58:03 devstack sudo[115785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:03 devstack sudo[115785]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d725b7cc-463f-4808-9801-83574a2ace33 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-19f26a59-41b4-4627-9409-e255761b8068" returned: 0 in 0.286s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:03 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d725b7cc-463f-4808-9801-83574a2ace33 tempest-ProjectMemberTests-792838276 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:58:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d725b7cc-463f-4808-9801-83574a2ace33 tempest-ProjectMemberTests-792838276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d725b7cc-463f-4808-9801-83574a2ace33 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e426d69-dab9-4876-bb99-5346a7c33c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19f26a59-41b4-4627-9409-e255761b8068', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d725b7cc-463f-4808-9801-83574a2ace33 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6e2c063-70c1-4e29-851f-fbc97fe7859f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:03 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-d725b7cc-463f-4808-9801-83574a2ace33 tempest-ProjectMemberTests-792838276 None] Volume volume-19f26a59-41b4-4627-9409-e255761b8068 (19f26a59-41b4-4627-9409-e255761b8068): created successfully Aug 11 04:58:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d725b7cc-463f-4808-9801-83574a2ace33 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6e2c063-70c1-4e29-851f-fbc97fe7859f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d725b7cc-463f-4808-9801-83574a2ace33 tempest-ProjectMemberTests-792838276 None] Flow 'volume_create_manager' (d0d89748-7672-452f-874a-b5efe22dd36a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:58:03 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-d725b7cc-463f-4808-9801-83574a2ace33 tempest-ProjectMemberTests-792838276 None] Created volume successfully. Aug 11 04:58:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b9984ce5-3a8e-40de-9ef2-0810442a11c7 tempest-ProjectMemberTests-792838276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b9984ce5-3a8e-40de-9ef2-0810442a11c7 tempest-ProjectMemberTests-792838276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:04 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-b9984ce5-3a8e-40de-9ef2-0810442a11c7 tempest-ProjectMemberTests-792838276 None] Creating offline snapshot f2ae7636-856f-452a-8994-0dec236e5505 of volume 19f26a59-41b4-4627-9409-e255761b8068 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 04:58:04 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbfe40a9-3f89-4903-bca1-81b5943d4ee3]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:58:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b9984ce5-3a8e-40de-9ef2-0810442a11c7 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-19f26a59-41b4-4627-9409-e255761b8068 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:05 devstack sudo[115789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-19f26a59-41b4-4627-9409-e255761b8068 Aug 11 04:58:05 devstack sudo[115789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:05 devstack sudo[115789]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b9984ce5-3a8e-40de-9ef2-0810442a11c7 tempest-ProjectMemberTests-792838276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-19f26a59-41b4-4627-9409-e255761b8068" returned: 0 in 0.485s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b9984ce5-3a8e-40de-9ef2-0810442a11c7 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-19f26a59-41b4-4627-9409-e255761b8068,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-19f26a59-41b4-4627-9409-e255761b8068.f2ae7636-856f-452a-8994-0dec236e5505 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:05 devstack sudo[115794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-19f26a59-41b4-4627-9409-e255761b8068,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-19f26a59-41b4-4627-9409-e255761b8068.f2ae7636-856f-452a-8994-0dec236e5505 1G Aug 11 04:58:05 devstack sudo[115794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:05 devstack sudo[115794]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b9984ce5-3a8e-40de-9ef2-0810442a11c7 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-19f26a59-41b4-4627-9409-e255761b8068,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-19f26a59-41b4-4627-9409-e255761b8068.f2ae7636-856f-452a-8994-0dec236e5505 1G" returned: 0 in 0.516s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b9984ce5-3a8e-40de-9ef2-0810442a11c7 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19f26a59-41b4-4627-9409-e255761b8068 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-19f26a59-41b4-4627-9409-e255761b8068.f2ae7636-856f-452a-8994-0dec236e5505 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:05 devstack sudo[115800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19f26a59-41b4-4627-9409-e255761b8068 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-19f26a59-41b4-4627-9409-e255761b8068.f2ae7636-856f-452a-8994-0dec236e5505 Aug 11 04:58:05 devstack sudo[115800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:06 devstack sudo[115800]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b9984ce5-3a8e-40de-9ef2-0810442a11c7 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19f26a59-41b4-4627-9409-e255761b8068 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-19f26a59-41b4-4627-9409-e255761b8068.f2ae7636-856f-452a-8994-0dec236e5505" returned: 0 in 0.334s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:06 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-b9984ce5-3a8e-40de-9ef2-0810442a11c7 tempest-ProjectMemberTests-792838276 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-19f26a59-41b4-4627-9409-e255761b8068.f2ae7636-856f-452a-8994-0dec236e5505 is being set with open permissions: ugo+rw Aug 11 04:58:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b9984ce5-3a8e-40de-9ef2-0810442a11c7 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-19f26a59-41b4-4627-9409-e255761b8068.f2ae7636-856f-452a-8994-0dec236e5505 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:06 devstack sudo[115805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-19f26a59-41b4-4627-9409-e255761b8068.f2ae7636-856f-452a-8994-0dec236e5505 Aug 11 04:58:06 devstack sudo[115805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:06 devstack sudo[115805]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b9984ce5-3a8e-40de-9ef2-0810442a11c7 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-19f26a59-41b4-4627-9409-e255761b8068.f2ae7636-856f-452a-8994-0dec236e5505" returned: 0 in 0.270s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b9984ce5-3a8e-40de-9ef2-0810442a11c7 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-19f26a59-41b4-4627-9409-e255761b8068.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:06 devstack sudo[115808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-19f26a59-41b4-4627-9409-e255761b8068.info Aug 11 04:58:06 devstack sudo[115808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:06 devstack sudo[115808]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b9984ce5-3a8e-40de-9ef2-0810442a11c7 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-19f26a59-41b4-4627-9409-e255761b8068.info" returned: 0 in 0.316s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:06 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-b9984ce5-3a8e-40de-9ef2-0810442a11c7 tempest-ProjectMemberTests-792838276 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-19f26a59-41b4-4627-9409-e255761b8068.info is being set with open permissions: ugo+rw Aug 11 04:58:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b9984ce5-3a8e-40de-9ef2-0810442a11c7 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-19f26a59-41b4-4627-9409-e255761b8068.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:06 devstack sudo[115811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-19f26a59-41b4-4627-9409-e255761b8068.info Aug 11 04:58:06 devstack sudo[115811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:07 devstack sudo[115811]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b9984ce5-3a8e-40de-9ef2-0810442a11c7 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-19f26a59-41b4-4627-9409-e255761b8068.info" returned: 0 in 0.266s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b9984ce5-3a8e-40de-9ef2-0810442a11c7 tempest-ProjectMemberTests-792838276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.287s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:07 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-b9984ce5-3a8e-40de-9ef2-0810442a11c7 tempest-ProjectMemberTests-792838276 None] Create snapshot completed successfully Aug 11 04:58:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5dba3cea-1036-4b97-bf2b-373e653a2241 tempest-ProjectAdminTests-1874793242 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7576522827148, 'free_capacity_gb': 1775.7576522827148, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94472) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 11 04:58:08 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a1331543-17a1-46fd-a107-2b36454ec0bd tempest-ProjectMemberTests-792838276 None] Acquiring lock "cinder-f2ae7636-856f-452a-8994-0dec236e5505-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:08 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a1331543-17a1-46fd-a107-2b36454ec0bd tempest-ProjectMemberTests-792838276 None] Lock "cinder-f2ae7636-856f-452a-8994-0dec236e5505-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:08 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a1331543-17a1-46fd-a107-2b36454ec0bd tempest-ProjectMemberTests-792838276 None] Acquiring lock "cinder-quobyte-19f26a59-41b4-4627-9409-e255761b8068" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:08 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a1331543-17a1-46fd-a107-2b36454ec0bd tempest-ProjectMemberTests-792838276 None] Lock "cinder-quobyte-19f26a59-41b4-4627-9409-e255761b8068" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:08 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a1331543-17a1-46fd-a107-2b36454ec0bd tempest-ProjectMemberTests-792838276 None] Acquiring lock "cinder-quobyte-f2ae7636-856f-452a-8994-0dec236e5505" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:08 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a1331543-17a1-46fd-a107-2b36454ec0bd tempest-ProjectMemberTests-792838276 None] Lock "cinder-quobyte-f2ae7636-856f-452a-8994-0dec236e5505" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:08 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-a1331543-17a1-46fd-a107-2b36454ec0bd tempest-ProjectMemberTests-792838276 None] Deleting offline snapshot f2ae7636-856f-452a-8994-0dec236e5505 of volume 19f26a59-41b4-4627-9409-e255761b8068 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 04:58:08 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-a1331543-17a1-46fd-a107-2b36454ec0bd tempest-ProjectMemberTests-792838276 None] snapshot_file for this snap is: volume-19f26a59-41b4-4627-9409-e255761b8068.f2ae7636-856f-452a-8994-0dec236e5505 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 04:58:08 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6be0ebc-9348-4252-9ed6-4ad5b44785d4]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:58:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a1331543-17a1-46fd-a107-2b36454ec0bd tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-19f26a59-41b4-4627-9409-e255761b8068.f2ae7636-856f-452a-8994-0dec236e5505 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:08 devstack sudo[115814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-19f26a59-41b4-4627-9409-e255761b8068.f2ae7636-856f-452a-8994-0dec236e5505 Aug 11 04:58:08 devstack sudo[115814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:08 devstack sudo[115814]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a1331543-17a1-46fd-a107-2b36454ec0bd tempest-ProjectMemberTests-792838276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-19f26a59-41b4-4627-9409-e255761b8068.f2ae7636-856f-452a-8994-0dec236e5505" returned: 0 in 0.409s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:08 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-a1331543-17a1-46fd-a107-2b36454ec0bd tempest-ProjectMemberTests-792838276 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19f26a59-41b4-4627-9409-e255761b8068(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:58:08 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[380820f4-a51c-475d-8b4e-16b5cbf2a836]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:58:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a1331543-17a1-46fd-a107-2b36454ec0bd tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-19f26a59-41b4-4627-9409-e255761b8068 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:08 devstack sudo[115819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-19f26a59-41b4-4627-9409-e255761b8068 Aug 11 04:58:08 devstack sudo[115819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:09 devstack sudo[115819]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a1331543-17a1-46fd-a107-2b36454ec0bd tempest-ProjectMemberTests-792838276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-19f26a59-41b4-4627-9409-e255761b8068" returned: 0 in 0.536s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a1331543-17a1-46fd-a107-2b36454ec0bd tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-19f26a59-41b4-4627-9409-e255761b8068.f2ae7636-856f-452a-8994-0dec236e5505 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:09 devstack sudo[115827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-19f26a59-41b4-4627-9409-e255761b8068.f2ae7636-856f-452a-8994-0dec236e5505 Aug 11 04:58:09 devstack sudo[115827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:09 devstack sudo[115827]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a1331543-17a1-46fd-a107-2b36454ec0bd tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-19f26a59-41b4-4627-9409-e255761b8068.f2ae7636-856f-452a-8994-0dec236e5505" returned: 0 in 0.402s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a1331543-17a1-46fd-a107-2b36454ec0bd tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-19f26a59-41b4-4627-9409-e255761b8068.f2ae7636-856f-452a-8994-0dec236e5505 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:09 devstack sudo[115833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-19f26a59-41b4-4627-9409-e255761b8068.f2ae7636-856f-452a-8994-0dec236e5505 Aug 11 04:58:09 devstack sudo[115833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:09 devstack sudo[115833]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a1331543-17a1-46fd-a107-2b36454ec0bd tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-19f26a59-41b4-4627-9409-e255761b8068.f2ae7636-856f-452a-8994-0dec236e5505" returned: 0 in 0.274s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:09 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a1331543-17a1-46fd-a107-2b36454ec0bd tempest-ProjectMemberTests-792838276 None] Lock "cinder-quobyte-f2ae7636-856f-452a-8994-0dec236e5505" released by "_delete_snapshot" :: held 1.743s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:09 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a1331543-17a1-46fd-a107-2b36454ec0bd tempest-ProjectMemberTests-792838276 None] Lock "cinder-quobyte-19f26a59-41b4-4627-9409-e255761b8068" released by "delete_snapshot" :: held 1.777s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:09 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-a1331543-17a1-46fd-a107-2b36454ec0bd tempest-ProjectMemberTests-792838276 None] Created reservations ['0dbfc31e-eb8e-4257-bb36-6078987ffa38', 'da8f1feb-79b4-4e7b-bc4b-4a7be456e750', '86f19fae-dc57-4eb3-95c0-ec58611c00e7', 'f041dc29-5ba2-4b61-b64c-73c57d04c8da'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:58:09 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-a1331543-17a1-46fd-a107-2b36454ec0bd tempest-ProjectMemberTests-792838276 None] Delete snapshot completed successfully. Aug 11 04:58:09 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a1331543-17a1-46fd-a107-2b36454ec0bd tempest-ProjectMemberTests-792838276 None] Lock "cinder-f2ae7636-856f-452a-8994-0dec236e5505-delete_snapshot" released by "delete_snapshot" :: held 1.918s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-59ad6254-1d22-41b9-8535-e7274913191c tempest-ProjectMemberTests-792838276 None] Acquiring lock "cinder-19f26a59-41b4-4627-9409-e255761b8068-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-59ad6254-1d22-41b9-8535-e7274913191c tempest-ProjectMemberTests-792838276 None] Lock "cinder-19f26a59-41b4-4627-9409-e255761b8068-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-59ad6254-1d22-41b9-8535-e7274913191c tempest-ProjectMemberTests-792838276 None] Acquiring lock "cinder-quobyte-19f26a59-41b4-4627-9409-e255761b8068" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-59ad6254-1d22-41b9-8535-e7274913191c tempest-ProjectMemberTests-792838276 None] Lock "cinder-quobyte-19f26a59-41b4-4627-9409-e255761b8068" acquired by "delete_volume" :: waited 0.028s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:10 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba98266-391e-4552-8e9c-05e7ad43bf16]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:58:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-59ad6254-1d22-41b9-8535-e7274913191c tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-19f26a59-41b4-4627-9409-e255761b8068 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:10 devstack sudo[115836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-19f26a59-41b4-4627-9409-e255761b8068 Aug 11 04:58:10 devstack sudo[115836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:10 devstack sudo[115836]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-59ad6254-1d22-41b9-8535-e7274913191c tempest-ProjectMemberTests-792838276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-19f26a59-41b4-4627-9409-e255761b8068" returned: 0 in 0.442s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-59ad6254-1d22-41b9-8535-e7274913191c tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-19f26a59-41b4-4627-9409-e255761b8068 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:10 devstack sudo[115841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-19f26a59-41b4-4627-9409-e255761b8068 Aug 11 04:58:10 devstack sudo[115841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:11 devstack sudo[115841]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-59ad6254-1d22-41b9-8535-e7274913191c tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-19f26a59-41b4-4627-9409-e255761b8068" returned: 0 in 0.276s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-59ad6254-1d22-41b9-8535-e7274913191c tempest-ProjectMemberTests-792838276 None] Lock "cinder-quobyte-19f26a59-41b4-4627-9409-e255761b8068" released by "delete_volume" :: held 0.792s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:11 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-59ad6254-1d22-41b9-8535-e7274913191c tempest-ProjectMemberTests-792838276 None] Created reservations ['133d6d08-d80d-4b44-a54c-b4269433cf19', 'b64c7c3e-b40a-4f40-bec9-dea414fd4a6c', 'c3b26adf-1bd6-4495-8f2b-a988910f4771', 'b582ebed-29df-4263-a499-890d86558eb6'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:58:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-59ad6254-1d22-41b9-8535-e7274913191c tempest-ProjectMemberTests-792838276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-59ad6254-1d22-41b9-8535-e7274913191c tempest-ProjectMemberTests-792838276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-59ad6254-1d22-41b9-8535-e7274913191c tempest-ProjectMemberTests-792838276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:58:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-59ad6254-1d22-41b9-8535-e7274913191c tempest-ProjectMemberTests-792838276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:58:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-59ad6254-1d22-41b9-8535-e7274913191c tempest-ProjectMemberTests-792838276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-59ad6254-1d22-41b9-8535-e7274913191c tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:11 devstack sudo[115844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:58:11 devstack sudo[115844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:11 devstack sudo[115844]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-59ad6254-1d22-41b9-8535-e7274913191c tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.286s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:11 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-59ad6254-1d22-41b9-8535-e7274913191c tempest-ProjectMemberTests-792838276 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:58:11 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-59ad6254-1d22-41b9-8535-e7274913191c tempest-ProjectMemberTests-792838276 None] Deleted volume successfully. Aug 11 04:58:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-59ad6254-1d22-41b9-8535-e7274913191c tempest-ProjectMemberTests-792838276 None] Lock "cinder-19f26a59-41b4-4627-9409-e255761b8068-delete_volume" released by "delete_volume" :: held 1.343s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:12 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ce7045a-7c3f-4e29-9218-0b8ddb3f7fab tempest-ProjectMemberTests-792838276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:58:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3ce7045a-7c3f-4e29-9218-0b8ddb3f7fab tempest-ProjectMemberTests-792838276 None] Flow 'volume_create_manager' (ceadfa51-052d-47c9-a056-2e9e3e273eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:58:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3ce7045a-7c3f-4e29-9218-0b8ddb3f7fab tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d59cfac-af65-4d24-87c6-310a7124fd8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3ce7045a-7c3f-4e29-9218-0b8ddb3f7fab tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d59cfac-af65-4d24-87c6-310a7124fd8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-488209038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1333eed-c4ff-48db-8fcb-c718a0dfeb26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac225c2b69784eb6b9ec19178ed3af8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:58:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:58:12Z,use_quota=True,user_id='4ce57473867c427a94cf64a00303ce0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3ce7045a-7c3f-4e29-9218-0b8ddb3f7fab tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b27c168d-feb8-4049-9470-dcc34fdb5e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3ce7045a-7c3f-4e29-9218-0b8ddb3f7fab tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b27c168d-feb8-4049-9470-dcc34fdb5e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3ce7045a-7c3f-4e29-9218-0b8ddb3f7fab tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (281b291e-6031-41c4-9a66-7c7a94dbc4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3ce7045a-7c3f-4e29-9218-0b8ddb3f7fab tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (281b291e-6031-41c4-9a66-7c7a94dbc4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1333eed-c4ff-48db-8fcb-c718a0dfeb26', 'volume_name': 'volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3ce7045a-7c3f-4e29-9218-0b8ddb3f7fab tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ea333d3-55a1-4ada-9984-4fe2051d1b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3ce7045a-7c3f-4e29-9218-0b8ddb3f7fab tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ea333d3-55a1-4ada-9984-4fe2051d1b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3ce7045a-7c3f-4e29-9218-0b8ddb3f7fab tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d544aa2-18b8-4c68-9710-704ada3661ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:12 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-3ce7045a-7c3f-4e29-9218-0b8ddb3f7fab tempest-ProjectMemberTests-792838276 None] Volume c1333eed-c4ff-48db-8fcb-c718a0dfeb26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26', 'volume_size': 1} Aug 11 04:58:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3ce7045a-7c3f-4e29-9218-0b8ddb3f7fab tempest-ProjectMemberTests-792838276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3ce7045a-7c3f-4e29-9218-0b8ddb3f7fab tempest-ProjectMemberTests-792838276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3ce7045a-7c3f-4e29-9218-0b8ddb3f7fab tempest-ProjectMemberTests-792838276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-488209038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1333eed-c4ff-48db-8fcb-c718a0dfeb26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac225c2b69784eb6b9ec19178ed3af8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:58:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:58:12Z,use_quota=True,user_id='4ce57473867c427a94cf64a00303ce0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:58:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-3ce7045a-7c3f-4e29-9218-0b8ddb3f7fab tempest-ProjectMemberTests-792838276 None] Creating volume c1333eed-c4ff-48db-8fcb-c718a0dfeb26 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:58:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3ce7045a-7c3f-4e29-9218-0b8ddb3f7fab tempest-ProjectMemberTests-792838276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3ce7045a-7c3f-4e29-9218-0b8ddb3f7fab tempest-ProjectMemberTests-792838276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3ce7045a-7c3f-4e29-9218-0b8ddb3f7fab tempest-ProjectMemberTests-792838276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:58:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3ce7045a-7c3f-4e29-9218-0b8ddb3f7fab tempest-ProjectMemberTests-792838276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:58:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3ce7045a-7c3f-4e29-9218-0b8ddb3f7fab tempest-ProjectMemberTests-792838276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3ce7045a-7c3f-4e29-9218-0b8ddb3f7fab tempest-ProjectMemberTests-792838276 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:58:12 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-3ce7045a-7c3f-4e29-9218-0b8ddb3f7fab tempest-ProjectMemberTests-792838276 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:58:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3ce7045a-7c3f-4e29-9218-0b8ddb3f7fab tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:12 devstack sudo[115847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26 1073741824 Aug 11 04:58:12 devstack sudo[115847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:12 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cd5f3d1-5093-4b2c-947b-cb020a5ee136 tempest-ProjectReaderTests-692176530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:58:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1cd5f3d1-5093-4b2c-947b-cb020a5ee136 tempest-ProjectReaderTests-692176530 None] Flow 'volume_create_manager' (2eaed54a-1d82-43cb-8fc0-18d464cfc71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:58:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1cd5f3d1-5093-4b2c-947b-cb020a5ee136 tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2765eaaa-f769-4829-9ffa-8fb9030aa286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1cd5f3d1-5093-4b2c-947b-cb020a5ee136 tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2765eaaa-f769-4829-9ffa-8fb9030aa286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-88108752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f331ec9f-776c-440c-a707-f641021c1d3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95563f14c47841708c0521bda11769a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:58:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:58:12Z,use_quota=True,user_id='f7bf5308d1fc4270957690c1005f4a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1cd5f3d1-5093-4b2c-947b-cb020a5ee136 tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c97afa1-91e2-4d07-882f-5047d3793a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1cd5f3d1-5093-4b2c-947b-cb020a5ee136 tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c97afa1-91e2-4d07-882f-5047d3793a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1cd5f3d1-5093-4b2c-947b-cb020a5ee136 tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eee5388-26a4-4c9e-940e-2c2665dd52c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1cd5f3d1-5093-4b2c-947b-cb020a5ee136 tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eee5388-26a4-4c9e-940e-2c2665dd52c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f331ec9f-776c-440c-a707-f641021c1d3f', 'volume_name': 'volume-f331ec9f-776c-440c-a707-f641021c1d3f', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1cd5f3d1-5093-4b2c-947b-cb020a5ee136 tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54af1275-d04f-4e14-940a-0bd559d7f622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1cd5f3d1-5093-4b2c-947b-cb020a5ee136 tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54af1275-d04f-4e14-940a-0bd559d7f622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1cd5f3d1-5093-4b2c-947b-cb020a5ee136 tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb27f9bd-ca76-43ee-9e9b-17b00a852042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:12 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-1cd5f3d1-5093-4b2c-947b-cb020a5ee136 tempest-ProjectReaderTests-692176530 None] Volume f331ec9f-776c-440c-a707-f641021c1d3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f331ec9f-776c-440c-a707-f641021c1d3f', 'volume_size': 1} Aug 11 04:58:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1cd5f3d1-5093-4b2c-947b-cb020a5ee136 tempest-ProjectReaderTests-692176530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:12 devstack sudo[115847]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3ce7045a-7c3f-4e29-9218-0b8ddb3f7fab tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26 1073741824" returned: 0 in 0.503s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3ce7045a-7c3f-4e29-9218-0b8ddb3f7fab tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:12 devstack sudo[115852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26 Aug 11 04:58:12 devstack sudo[115852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:12 devstack sudo[115852]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3ce7045a-7c3f-4e29-9218-0b8ddb3f7fab tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26" returned: 0 in 0.244s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3ce7045a-7c3f-4e29-9218-0b8ddb3f7fab tempest-ProjectMemberTests-792838276 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:58:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3ce7045a-7c3f-4e29-9218-0b8ddb3f7fab tempest-ProjectMemberTests-792838276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1cd5f3d1-5093-4b2c-947b-cb020a5ee136 tempest-ProjectReaderTests-692176530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.483s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1cd5f3d1-5093-4b2c-947b-cb020a5ee136 tempest-ProjectReaderTests-692176530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-88108752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f331ec9f-776c-440c-a707-f641021c1d3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95563f14c47841708c0521bda11769a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:58:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:58:12Z,use_quota=True,user_id='f7bf5308d1fc4270957690c1005f4a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:58:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-1cd5f3d1-5093-4b2c-947b-cb020a5ee136 tempest-ProjectReaderTests-692176530 None] Creating volume f331ec9f-776c-440c-a707-f641021c1d3f {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:58:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1cd5f3d1-5093-4b2c-947b-cb020a5ee136 tempest-ProjectReaderTests-692176530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1cd5f3d1-5093-4b2c-947b-cb020a5ee136 tempest-ProjectReaderTests-692176530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1cd5f3d1-5093-4b2c-947b-cb020a5ee136 tempest-ProjectReaderTests-692176530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:58:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1cd5f3d1-5093-4b2c-947b-cb020a5ee136 tempest-ProjectReaderTests-692176530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:58:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1cd5f3d1-5093-4b2c-947b-cb020a5ee136 tempest-ProjectReaderTests-692176530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1cd5f3d1-5093-4b2c-947b-cb020a5ee136 tempest-ProjectReaderTests-692176530 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:58:12 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-1cd5f3d1-5093-4b2c-947b-cb020a5ee136 tempest-ProjectReaderTests-692176530 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:58:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1cd5f3d1-5093-4b2c-947b-cb020a5ee136 tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f331ec9f-776c-440c-a707-f641021c1d3f 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3ce7045a-7c3f-4e29-9218-0b8ddb3f7fab tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d544aa2-18b8-4c68-9710-704ada3661ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:12 devstack sudo[115855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f331ec9f-776c-440c-a707-f641021c1d3f 1073741824 Aug 11 04:58:12 devstack sudo[115855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3ce7045a-7c3f-4e29-9218-0b8ddb3f7fab tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2210588-aa1a-48b8-b28f-37b9343ceadf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:12 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-3ce7045a-7c3f-4e29-9218-0b8ddb3f7fab tempest-ProjectMemberTests-792838276 None] Volume volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26 (c1333eed-c4ff-48db-8fcb-c718a0dfeb26): created successfully Aug 11 04:58:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3ce7045a-7c3f-4e29-9218-0b8ddb3f7fab tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2210588-aa1a-48b8-b28f-37b9343ceadf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3ce7045a-7c3f-4e29-9218-0b8ddb3f7fab tempest-ProjectMemberTests-792838276 None] Flow 'volume_create_manager' (ceadfa51-052d-47c9-a056-2e9e3e273eb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:58:12 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-3ce7045a-7c3f-4e29-9218-0b8ddb3f7fab tempest-ProjectMemberTests-792838276 None] Created volume successfully. Aug 11 04:58:13 devstack sudo[115855]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1cd5f3d1-5093-4b2c-947b-cb020a5ee136 tempest-ProjectReaderTests-692176530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f331ec9f-776c-440c-a707-f641021c1d3f 1073741824" returned: 0 in 0.442s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1cd5f3d1-5093-4b2c-947b-cb020a5ee136 tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f331ec9f-776c-440c-a707-f641021c1d3f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:13 devstack sudo[115861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f331ec9f-776c-440c-a707-f641021c1d3f Aug 11 04:58:13 devstack sudo[115861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:13 devstack sudo[115861]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1cd5f3d1-5093-4b2c-947b-cb020a5ee136 tempest-ProjectReaderTests-692176530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f331ec9f-776c-440c-a707-f641021c1d3f" returned: 0 in 0.266s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1cd5f3d1-5093-4b2c-947b-cb020a5ee136 tempest-ProjectReaderTests-692176530 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:58:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1cd5f3d1-5093-4b2c-947b-cb020a5ee136 tempest-ProjectReaderTests-692176530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1cd5f3d1-5093-4b2c-947b-cb020a5ee136 tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb27f9bd-ca76-43ee-9e9b-17b00a852042) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f331ec9f-776c-440c-a707-f641021c1d3f', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1cd5f3d1-5093-4b2c-947b-cb020a5ee136 tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e14a4de-fb0b-4a38-b7b7-2d9326593a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:13 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-1cd5f3d1-5093-4b2c-947b-cb020a5ee136 tempest-ProjectReaderTests-692176530 None] Volume volume-f331ec9f-776c-440c-a707-f641021c1d3f (f331ec9f-776c-440c-a707-f641021c1d3f): created successfully Aug 11 04:58:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1cd5f3d1-5093-4b2c-947b-cb020a5ee136 tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e14a4de-fb0b-4a38-b7b7-2d9326593a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1cd5f3d1-5093-4b2c-947b-cb020a5ee136 tempest-ProjectReaderTests-692176530 None] Flow 'volume_create_manager' (2eaed54a-1d82-43cb-8fc0-18d464cfc71c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:58:13 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-1cd5f3d1-5093-4b2c-947b-cb020a5ee136 tempest-ProjectReaderTests-692176530 None] Created volume successfully. Aug 11 04:58:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2a10b066-3f19-4b5f-8959-d42c06b87a17 tempest-ProjectMemberTests-792838276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2a10b066-3f19-4b5f-8959-d42c06b87a17 tempest-ProjectMemberTests-792838276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-2a10b066-3f19-4b5f-8959-d42c06b87a17 tempest-ProjectMemberTests-792838276 None] Creating offline snapshot 3e0087d3-d890-4f98-82f7-5ae49537afef of volume c1333eed-c4ff-48db-8fcb-c718a0dfeb26 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 04:58:14 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[d353a631-eb6f-4cbc-97a9-53cd83dbd7bd]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:58:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2a10b066-3f19-4b5f-8959-d42c06b87a17 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:14 devstack sudo[115865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26 Aug 11 04:58:14 devstack sudo[115865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bb8afebc-3b6a-47d1-a968-c3bc570d8daf tempest-ProjectReaderTests-692176530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:14 devstack sudo[115865]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2a10b066-3f19-4b5f-8959-d42c06b87a17 tempest-ProjectMemberTests-792838276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26" returned: 0 in 0.427s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2a10b066-3f19-4b5f-8959-d42c06b87a17 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26.3e0087d3-d890-4f98-82f7-5ae49537afef 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:14 devstack sudo[115870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26.3e0087d3-d890-4f98-82f7-5ae49537afef 1G Aug 11 04:58:14 devstack sudo[115870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:15 devstack sudo[115870]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2a10b066-3f19-4b5f-8959-d42c06b87a17 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26.3e0087d3-d890-4f98-82f7-5ae49537afef 1G" returned: 0 in 0.431s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2a10b066-3f19-4b5f-8959-d42c06b87a17 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26.3e0087d3-d890-4f98-82f7-5ae49537afef {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:15 devstack sudo[115876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26.3e0087d3-d890-4f98-82f7-5ae49537afef Aug 11 04:58:15 devstack sudo[115876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:15 devstack sudo[115876]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2a10b066-3f19-4b5f-8959-d42c06b87a17 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26.3e0087d3-d890-4f98-82f7-5ae49537afef" returned: 0 in 0.304s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:15 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-2a10b066-3f19-4b5f-8959-d42c06b87a17 tempest-ProjectMemberTests-792838276 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26.3e0087d3-d890-4f98-82f7-5ae49537afef is being set with open permissions: ugo+rw Aug 11 04:58:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2a10b066-3f19-4b5f-8959-d42c06b87a17 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26.3e0087d3-d890-4f98-82f7-5ae49537afef {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:15 devstack sudo[115881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26.3e0087d3-d890-4f98-82f7-5ae49537afef Aug 11 04:58:15 devstack sudo[115881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:15 devstack sudo[115881]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2a10b066-3f19-4b5f-8959-d42c06b87a17 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26.3e0087d3-d890-4f98-82f7-5ae49537afef" returned: 0 in 0.255s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2a10b066-3f19-4b5f-8959-d42c06b87a17 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:15 devstack sudo[115884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26.info Aug 11 04:58:15 devstack sudo[115884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:15 devstack sudo[115884]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2a10b066-3f19-4b5f-8959-d42c06b87a17 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26.info" returned: 0 in 0.257s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:15 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-2a10b066-3f19-4b5f-8959-d42c06b87a17 tempest-ProjectMemberTests-792838276 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26.info is being set with open permissions: ugo+rw Aug 11 04:58:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2a10b066-3f19-4b5f-8959-d42c06b87a17 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:16 devstack sudo[115887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26.info Aug 11 04:58:16 devstack sudo[115887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:16 devstack sudo[115887]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2a10b066-3f19-4b5f-8959-d42c06b87a17 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26.info" returned: 0 in 0.260s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2a10b066-3f19-4b5f-8959-d42c06b87a17 tempest-ProjectMemberTests-792838276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.029s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bb8afebc-3b6a-47d1-a968-c3bc570d8daf tempest-ProjectReaderTests-692176530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.638s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-bb8afebc-3b6a-47d1-a968-c3bc570d8daf tempest-ProjectReaderTests-692176530 None] Creating offline snapshot 92880ec8-2f33-4510-83d5-7447cf0001b1 of volume f331ec9f-776c-440c-a707-f641021c1d3f {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 04:58:16 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7f420e-9da3-4d1f-b068-1727ea2e837b]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:58:16 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-2a10b066-3f19-4b5f-8959-d42c06b87a17 tempest-ProjectMemberTests-792838276 None] Create snapshot completed successfully Aug 11 04:58:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bb8afebc-3b6a-47d1-a968-c3bc570d8daf tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f331ec9f-776c-440c-a707-f641021c1d3f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:16 devstack sudo[115890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f331ec9f-776c-440c-a707-f641021c1d3f Aug 11 04:58:16 devstack sudo[115890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:16 devstack sudo[115890]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bb8afebc-3b6a-47d1-a968-c3bc570d8daf tempest-ProjectReaderTests-692176530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f331ec9f-776c-440c-a707-f641021c1d3f" returned: 0 in 0.422s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bb8afebc-3b6a-47d1-a968-c3bc570d8daf tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f331ec9f-776c-440c-a707-f641021c1d3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f331ec9f-776c-440c-a707-f641021c1d3f.92880ec8-2f33-4510-83d5-7447cf0001b1 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:16 devstack sudo[115896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f331ec9f-776c-440c-a707-f641021c1d3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f331ec9f-776c-440c-a707-f641021c1d3f.92880ec8-2f33-4510-83d5-7447cf0001b1 1G Aug 11 04:58:16 devstack sudo[115896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:17 devstack sudo[115896]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bb8afebc-3b6a-47d1-a968-c3bc570d8daf tempest-ProjectReaderTests-692176530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f331ec9f-776c-440c-a707-f641021c1d3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f331ec9f-776c-440c-a707-f641021c1d3f.92880ec8-2f33-4510-83d5-7447cf0001b1 1G" returned: 0 in 0.450s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bb8afebc-3b6a-47d1-a968-c3bc570d8daf tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f331ec9f-776c-440c-a707-f641021c1d3f -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f331ec9f-776c-440c-a707-f641021c1d3f.92880ec8-2f33-4510-83d5-7447cf0001b1 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:17 devstack sudo[115902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f331ec9f-776c-440c-a707-f641021c1d3f -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f331ec9f-776c-440c-a707-f641021c1d3f.92880ec8-2f33-4510-83d5-7447cf0001b1 Aug 11 04:58:17 devstack sudo[115902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e291a408-e99a-4805-a031-b157e5d681b1 tempest-ProjectMemberTests-792838276 None] Acquiring lock "cinder-3e0087d3-d890-4f98-82f7-5ae49537afef-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e291a408-e99a-4805-a031-b157e5d681b1 tempest-ProjectMemberTests-792838276 None] Lock "cinder-3e0087d3-d890-4f98-82f7-5ae49537afef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e291a408-e99a-4805-a031-b157e5d681b1 tempest-ProjectMemberTests-792838276 None] Acquiring lock "cinder-quobyte-c1333eed-c4ff-48db-8fcb-c718a0dfeb26" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e291a408-e99a-4805-a031-b157e5d681b1 tempest-ProjectMemberTests-792838276 None] Lock "cinder-quobyte-c1333eed-c4ff-48db-8fcb-c718a0dfeb26" acquired by "delete_snapshot" :: waited 0.028s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e291a408-e99a-4805-a031-b157e5d681b1 tempest-ProjectMemberTests-792838276 None] Acquiring lock "cinder-quobyte-3e0087d3-d890-4f98-82f7-5ae49537afef" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e291a408-e99a-4805-a031-b157e5d681b1 tempest-ProjectMemberTests-792838276 None] Lock "cinder-quobyte-3e0087d3-d890-4f98-82f7-5ae49537afef" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-e291a408-e99a-4805-a031-b157e5d681b1 tempest-ProjectMemberTests-792838276 None] Deleting offline snapshot 3e0087d3-d890-4f98-82f7-5ae49537afef of volume c1333eed-c4ff-48db-8fcb-c718a0dfeb26 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 04:58:17 devstack sudo[115902]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-e291a408-e99a-4805-a031-b157e5d681b1 tempest-ProjectMemberTests-792838276 None] snapshot_file for this snap is: volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26.3e0087d3-d890-4f98-82f7-5ae49537afef {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 04:58:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bb8afebc-3b6a-47d1-a968-c3bc570d8daf tempest-ProjectReaderTests-692176530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f331ec9f-776c-440c-a707-f641021c1d3f -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f331ec9f-776c-440c-a707-f641021c1d3f.92880ec8-2f33-4510-83d5-7447cf0001b1" returned: 0 in 0.354s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:17 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-bb8afebc-3b6a-47d1-a968-c3bc570d8daf tempest-ProjectReaderTests-692176530 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f331ec9f-776c-440c-a707-f641021c1d3f.92880ec8-2f33-4510-83d5-7447cf0001b1 is being set with open permissions: ugo+rw Aug 11 04:58:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bb8afebc-3b6a-47d1-a968-c3bc570d8daf tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f331ec9f-776c-440c-a707-f641021c1d3f.92880ec8-2f33-4510-83d5-7447cf0001b1 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:17 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13502b9-1572-43df-957f-5f1a00df5e51]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:58:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e291a408-e99a-4805-a031-b157e5d681b1 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26.3e0087d3-d890-4f98-82f7-5ae49537afef {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:17 devstack sudo[115907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f331ec9f-776c-440c-a707-f641021c1d3f.92880ec8-2f33-4510-83d5-7447cf0001b1 Aug 11 04:58:17 devstack sudo[115907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:17 devstack sudo[115908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26.3e0087d3-d890-4f98-82f7-5ae49537afef Aug 11 04:58:17 devstack sudo[115908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:17 devstack sudo[115907]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bb8afebc-3b6a-47d1-a968-c3bc570d8daf tempest-ProjectReaderTests-692176530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f331ec9f-776c-440c-a707-f641021c1d3f.92880ec8-2f33-4510-83d5-7447cf0001b1" returned: 0 in 0.265s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bb8afebc-3b6a-47d1-a968-c3bc570d8daf tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f331ec9f-776c-440c-a707-f641021c1d3f.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:17 devstack sudo[115912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f331ec9f-776c-440c-a707-f641021c1d3f.info Aug 11 04:58:17 devstack sudo[115912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:17 devstack sudo[115908]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e291a408-e99a-4805-a031-b157e5d681b1 tempest-ProjectMemberTests-792838276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26.3e0087d3-d890-4f98-82f7-5ae49537afef" returned: 0 in 0.405s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-e291a408-e99a-4805-a031-b157e5d681b1 tempest-ProjectMemberTests-792838276 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:58:17 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be2d59c-71f2-4315-8c71-052738289437]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:58:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e291a408-e99a-4805-a031-b157e5d681b1 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:18 devstack sudo[115912]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bb8afebc-3b6a-47d1-a968-c3bc570d8daf tempest-ProjectReaderTests-692176530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f331ec9f-776c-440c-a707-f641021c1d3f.info" returned: 0 in 0.272s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:18 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-bb8afebc-3b6a-47d1-a968-c3bc570d8daf tempest-ProjectReaderTests-692176530 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f331ec9f-776c-440c-a707-f641021c1d3f.info is being set with open permissions: ugo+rw Aug 11 04:58:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bb8afebc-3b6a-47d1-a968-c3bc570d8daf tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f331ec9f-776c-440c-a707-f641021c1d3f.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:18 devstack sudo[115917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26 Aug 11 04:58:18 devstack sudo[115917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:18 devstack sudo[115920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f331ec9f-776c-440c-a707-f641021c1d3f.info Aug 11 04:58:18 devstack sudo[115920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:18 devstack sudo[115917]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e291a408-e99a-4805-a031-b157e5d681b1 tempest-ProjectMemberTests-792838276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26" returned: 0 in 0.379s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e291a408-e99a-4805-a031-b157e5d681b1 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26.3e0087d3-d890-4f98-82f7-5ae49537afef {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:18 devstack sudo[115920]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bb8afebc-3b6a-47d1-a968-c3bc570d8daf tempest-ProjectReaderTests-692176530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f331ec9f-776c-440c-a707-f641021c1d3f.info" returned: 0 in 0.279s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:18 devstack sudo[115927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26.3e0087d3-d890-4f98-82f7-5ae49537afef Aug 11 04:58:18 devstack sudo[115927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bb8afebc-3b6a-47d1-a968-c3bc570d8daf tempest-ProjectReaderTests-692176530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.147s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:18 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-bb8afebc-3b6a-47d1-a968-c3bc570d8daf tempest-ProjectReaderTests-692176530 None] Create snapshot completed successfully Aug 11 04:58:18 devstack sudo[115927]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e291a408-e99a-4805-a031-b157e5d681b1 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26.3e0087d3-d890-4f98-82f7-5ae49537afef" returned: 0 in 0.391s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e291a408-e99a-4805-a031-b157e5d681b1 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26.3e0087d3-d890-4f98-82f7-5ae49537afef {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:18 devstack sudo[115933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26.3e0087d3-d890-4f98-82f7-5ae49537afef Aug 11 04:58:18 devstack sudo[115933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:19 devstack sudo[115933]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e291a408-e99a-4805-a031-b157e5d681b1 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26.3e0087d3-d890-4f98-82f7-5ae49537afef" returned: 0 in 0.269s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5b79f3bd-d4a4-4aef-b2c9-3f837b2cb168 tempest-ProjectReaderTests-692176530 None] Acquiring lock "cinder-92880ec8-2f33-4510-83d5-7447cf0001b1-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e291a408-e99a-4805-a031-b157e5d681b1 tempest-ProjectMemberTests-792838276 None] Lock "cinder-quobyte-3e0087d3-d890-4f98-82f7-5ae49537afef" released by "_delete_snapshot" :: held 1.577s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e291a408-e99a-4805-a031-b157e5d681b1 tempest-ProjectMemberTests-792838276 None] Lock "cinder-quobyte-c1333eed-c4ff-48db-8fcb-c718a0dfeb26" released by "delete_snapshot" :: held 1.618s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5b79f3bd-d4a4-4aef-b2c9-3f837b2cb168 tempest-ProjectReaderTests-692176530 None] Lock "cinder-92880ec8-2f33-4510-83d5-7447cf0001b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5b79f3bd-d4a4-4aef-b2c9-3f837b2cb168 tempest-ProjectReaderTests-692176530 None] Acquiring lock "cinder-quobyte-f331ec9f-776c-440c-a707-f641021c1d3f" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5b79f3bd-d4a4-4aef-b2c9-3f837b2cb168 tempest-ProjectReaderTests-692176530 None] Lock "cinder-quobyte-f331ec9f-776c-440c-a707-f641021c1d3f" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5b79f3bd-d4a4-4aef-b2c9-3f837b2cb168 tempest-ProjectReaderTests-692176530 None] Acquiring lock "cinder-quobyte-92880ec8-2f33-4510-83d5-7447cf0001b1" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5b79f3bd-d4a4-4aef-b2c9-3f837b2cb168 tempest-ProjectReaderTests-692176530 None] Lock "cinder-quobyte-92880ec8-2f33-4510-83d5-7447cf0001b1" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-5b79f3bd-d4a4-4aef-b2c9-3f837b2cb168 tempest-ProjectReaderTests-692176530 None] Deleting offline snapshot 92880ec8-2f33-4510-83d5-7447cf0001b1 of volume f331ec9f-776c-440c-a707-f641021c1d3f {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 04:58:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-5b79f3bd-d4a4-4aef-b2c9-3f837b2cb168 tempest-ProjectReaderTests-692176530 None] snapshot_file for this snap is: volume-f331ec9f-776c-440c-a707-f641021c1d3f.92880ec8-2f33-4510-83d5-7447cf0001b1 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 04:58:19 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde669a3-d6b3-4fe6-b05d-7bc32db91f73]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:58:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5b79f3bd-d4a4-4aef-b2c9-3f837b2cb168 tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f331ec9f-776c-440c-a707-f641021c1d3f.92880ec8-2f33-4510-83d5-7447cf0001b1 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:19 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-e291a408-e99a-4805-a031-b157e5d681b1 tempest-ProjectMemberTests-792838276 None] Created reservations ['584963dd-b013-40ac-9792-4c9382e42465', 'fbb27e4d-3790-4340-b4ef-af8923f5df63', '8581a8a9-91ff-4670-88d4-79dbc9532b59', 'dc8f6478-30eb-42fa-bcab-d2d137a0eec4'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:58:19 devstack sudo[115936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f331ec9f-776c-440c-a707-f641021c1d3f.92880ec8-2f33-4510-83d5-7447cf0001b1 Aug 11 04:58:19 devstack sudo[115936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:19 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-e291a408-e99a-4805-a031-b157e5d681b1 tempest-ProjectMemberTests-792838276 None] Delete snapshot completed successfully. Aug 11 04:58:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e291a408-e99a-4805-a031-b157e5d681b1 tempest-ProjectMemberTests-792838276 None] Lock "cinder-3e0087d3-d890-4f98-82f7-5ae49537afef-delete_snapshot" released by "delete_snapshot" :: held 1.884s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:19 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ae4e996-bb02-45ba-a84b-dd208d1d264b tempest-ProjectReaderTests-750734017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:58:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7ae4e996-bb02-45ba-a84b-dd208d1d264b tempest-ProjectReaderTests-750734017 None] Flow 'volume_create_manager' (7870ab0a-557d-4020-b87b-3d5c748816ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:58:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7ae4e996-bb02-45ba-a84b-dd208d1d264b tempest-ProjectReaderTests-750734017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b8349b7-61d1-4614-8318-e7694e940400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7ae4e996-bb02-45ba-a84b-dd208d1d264b tempest-ProjectReaderTests-750734017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b8349b7-61d1-4614-8318-e7694e940400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-475763121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=242c26e6-b01b-438b-99cb-3bc7fd2912bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74315cc5ab964111aa490d052fcd09fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:58:19Z,use_quota=True,user_id='0fcc67d5a80a4706887e00b9f7c1f946',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7ae4e996-bb02-45ba-a84b-dd208d1d264b tempest-ProjectReaderTests-750734017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f95788a2-523b-4f10-a167-02f954d5279d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7ae4e996-bb02-45ba-a84b-dd208d1d264b tempest-ProjectReaderTests-750734017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f95788a2-523b-4f10-a167-02f954d5279d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7ae4e996-bb02-45ba-a84b-dd208d1d264b tempest-ProjectReaderTests-750734017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb46c0e3-2761-48e2-93a6-6bac60834ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7ae4e996-bb02-45ba-a84b-dd208d1d264b tempest-ProjectReaderTests-750734017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb46c0e3-2761-48e2-93a6-6bac60834ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '242c26e6-b01b-438b-99cb-3bc7fd2912bd', 'volume_name': 'volume-242c26e6-b01b-438b-99cb-3bc7fd2912bd', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7ae4e996-bb02-45ba-a84b-dd208d1d264b tempest-ProjectReaderTests-750734017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5c09d45-07cf-4389-86fa-52c58d5e1162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7ae4e996-bb02-45ba-a84b-dd208d1d264b tempest-ProjectReaderTests-750734017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5c09d45-07cf-4389-86fa-52c58d5e1162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7ae4e996-bb02-45ba-a84b-dd208d1d264b tempest-ProjectReaderTests-750734017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cb7b096-6d43-478c-a60d-2724e9d907d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:19 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-7ae4e996-bb02-45ba-a84b-dd208d1d264b tempest-ProjectReaderTests-750734017 None] Volume 242c26e6-b01b-438b-99cb-3bc7fd2912bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-242c26e6-b01b-438b-99cb-3bc7fd2912bd', 'volume_size': 1} Aug 11 04:58:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7ae4e996-bb02-45ba-a84b-dd208d1d264b tempest-ProjectReaderTests-750734017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7ae4e996-bb02-45ba-a84b-dd208d1d264b tempest-ProjectReaderTests-750734017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7ae4e996-bb02-45ba-a84b-dd208d1d264b tempest-ProjectReaderTests-750734017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-475763121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=242c26e6-b01b-438b-99cb-3bc7fd2912bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74315cc5ab964111aa490d052fcd09fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:58:19Z,use_quota=True,user_id='0fcc67d5a80a4706887e00b9f7c1f946',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:58:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-7ae4e996-bb02-45ba-a84b-dd208d1d264b tempest-ProjectReaderTests-750734017 None] Creating volume 242c26e6-b01b-438b-99cb-3bc7fd2912bd {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:58:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7ae4e996-bb02-45ba-a84b-dd208d1d264b tempest-ProjectReaderTests-750734017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7ae4e996-bb02-45ba-a84b-dd208d1d264b tempest-ProjectReaderTests-750734017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7ae4e996-bb02-45ba-a84b-dd208d1d264b tempest-ProjectReaderTests-750734017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:58:19 devstack sudo[115936]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7ae4e996-bb02-45ba-a84b-dd208d1d264b tempest-ProjectReaderTests-750734017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:58:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7ae4e996-bb02-45ba-a84b-dd208d1d264b tempest-ProjectReaderTests-750734017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7ae4e996-bb02-45ba-a84b-dd208d1d264b tempest-ProjectReaderTests-750734017 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:58:19 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-7ae4e996-bb02-45ba-a84b-dd208d1d264b tempest-ProjectReaderTests-750734017 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:58:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7ae4e996-bb02-45ba-a84b-dd208d1d264b tempest-ProjectReaderTests-750734017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-242c26e6-b01b-438b-99cb-3bc7fd2912bd 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5b79f3bd-d4a4-4aef-b2c9-3f837b2cb168 tempest-ProjectReaderTests-692176530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f331ec9f-776c-440c-a707-f641021c1d3f.92880ec8-2f33-4510-83d5-7447cf0001b1" returned: 0 in 0.413s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-5b79f3bd-d4a4-4aef-b2c9-3f837b2cb168 tempest-ProjectReaderTests-692176530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f331ec9f-776c-440c-a707-f641021c1d3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:58:19 devstack sudo[115941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-242c26e6-b01b-438b-99cb-3bc7fd2912bd 1073741824 Aug 11 04:58:19 devstack sudo[115941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2bad2a99-9950-47bc-88c8-09a22362b632 tempest-ProjectMemberTests-792838276 None] Acquiring lock "cinder-c1333eed-c4ff-48db-8fcb-c718a0dfeb26-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:19 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1de753-fd21-4387-8150-037959ce357b]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:58:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5b79f3bd-d4a4-4aef-b2c9-3f837b2cb168 tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f331ec9f-776c-440c-a707-f641021c1d3f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2bad2a99-9950-47bc-88c8-09a22362b632 tempest-ProjectMemberTests-792838276 None] Lock "cinder-c1333eed-c4ff-48db-8fcb-c718a0dfeb26-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2bad2a99-9950-47bc-88c8-09a22362b632 tempest-ProjectMemberTests-792838276 None] Acquiring lock "cinder-quobyte-c1333eed-c4ff-48db-8fcb-c718a0dfeb26" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2bad2a99-9950-47bc-88c8-09a22362b632 tempest-ProjectMemberTests-792838276 None] Lock "cinder-quobyte-c1333eed-c4ff-48db-8fcb-c718a0dfeb26" acquired by "delete_volume" :: waited 0.016s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:19 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[7caa084b-0ab6-450b-bb29-f9e9f77a0797]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:58:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2bad2a99-9950-47bc-88c8-09a22362b632 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:19 devstack sudo[115943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f331ec9f-776c-440c-a707-f641021c1d3f Aug 11 04:58:19 devstack sudo[115943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:19 devstack sudo[115944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26 Aug 11 04:58:19 devstack sudo[115944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:20 devstack sudo[115941]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7ae4e996-bb02-45ba-a84b-dd208d1d264b tempest-ProjectReaderTests-750734017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-242c26e6-b01b-438b-99cb-3bc7fd2912bd 1073741824" returned: 0 in 0.456s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:20 devstack sudo[115943]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5b79f3bd-d4a4-4aef-b2c9-3f837b2cb168 tempest-ProjectReaderTests-692176530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f331ec9f-776c-440c-a707-f641021c1d3f" returned: 0 in 0.423s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5b79f3bd-d4a4-4aef-b2c9-3f837b2cb168 tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f331ec9f-776c-440c-a707-f641021c1d3f.92880ec8-2f33-4510-83d5-7447cf0001b1 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7ae4e996-bb02-45ba-a84b-dd208d1d264b tempest-ProjectReaderTests-750734017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-242c26e6-b01b-438b-99cb-3bc7fd2912bd {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:20 devstack sudo[115954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f331ec9f-776c-440c-a707-f641021c1d3f.92880ec8-2f33-4510-83d5-7447cf0001b1 Aug 11 04:58:20 devstack sudo[115954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:20 devstack sudo[115957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-242c26e6-b01b-438b-99cb-3bc7fd2912bd Aug 11 04:58:20 devstack sudo[115957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:20 devstack sudo[115944]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2bad2a99-9950-47bc-88c8-09a22362b632 tempest-ProjectMemberTests-792838276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26" returned: 0 in 0.423s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2bad2a99-9950-47bc-88c8-09a22362b632 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:20 devstack sudo[115961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26 Aug 11 04:58:20 devstack sudo[115961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:20 devstack sudo[115957]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7ae4e996-bb02-45ba-a84b-dd208d1d264b tempest-ProjectReaderTests-750734017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-242c26e6-b01b-438b-99cb-3bc7fd2912bd" returned: 0 in 0.272s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7ae4e996-bb02-45ba-a84b-dd208d1d264b tempest-ProjectReaderTests-750734017 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:58:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7ae4e996-bb02-45ba-a84b-dd208d1d264b tempest-ProjectReaderTests-750734017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7ae4e996-bb02-45ba-a84b-dd208d1d264b tempest-ProjectReaderTests-750734017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cb7b096-6d43-478c-a60d-2724e9d907d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-242c26e6-b01b-438b-99cb-3bc7fd2912bd', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7ae4e996-bb02-45ba-a84b-dd208d1d264b tempest-ProjectReaderTests-750734017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (340f8f29-e5b2-4da9-a27d-2ec4a3686fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:20 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-7ae4e996-bb02-45ba-a84b-dd208d1d264b tempest-ProjectReaderTests-750734017 None] Volume volume-242c26e6-b01b-438b-99cb-3bc7fd2912bd (242c26e6-b01b-438b-99cb-3bc7fd2912bd): created successfully Aug 11 04:58:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7ae4e996-bb02-45ba-a84b-dd208d1d264b tempest-ProjectReaderTests-750734017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (340f8f29-e5b2-4da9-a27d-2ec4a3686fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7ae4e996-bb02-45ba-a84b-dd208d1d264b tempest-ProjectReaderTests-750734017 None] Flow 'volume_create_manager' (7870ab0a-557d-4020-b87b-3d5c748816ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:58:20 devstack sudo[115954]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5b79f3bd-d4a4-4aef-b2c9-3f837b2cb168 tempest-ProjectReaderTests-692176530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f331ec9f-776c-440c-a707-f641021c1d3f.92880ec8-2f33-4510-83d5-7447cf0001b1" returned: 0 in 0.382s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5b79f3bd-d4a4-4aef-b2c9-3f837b2cb168 tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f331ec9f-776c-440c-a707-f641021c1d3f.92880ec8-2f33-4510-83d5-7447cf0001b1 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:20 devstack sudo[115961]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:20 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-7ae4e996-bb02-45ba-a84b-dd208d1d264b tempest-ProjectReaderTests-750734017 None] Created volume successfully. Aug 11 04:58:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2bad2a99-9950-47bc-88c8-09a22362b632 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c1333eed-c4ff-48db-8fcb-c718a0dfeb26" returned: 0 in 0.280s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:20 devstack sudo[115969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f331ec9f-776c-440c-a707-f641021c1d3f.92880ec8-2f33-4510-83d5-7447cf0001b1 Aug 11 04:58:20 devstack sudo[115969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2bad2a99-9950-47bc-88c8-09a22362b632 tempest-ProjectMemberTests-792838276 None] Lock "cinder-quobyte-c1333eed-c4ff-48db-8fcb-c718a0dfeb26" released by "delete_volume" :: held 0.768s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:20 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-2bad2a99-9950-47bc-88c8-09a22362b632 tempest-ProjectMemberTests-792838276 None] Created reservations ['ae3b56f0-ef4d-44b8-ba1c-af19b28ea3bc', '88c7e1b7-1cf0-422d-8fa4-312cb4382c78', 'f4a45801-2b0f-4c09-9812-6f89c1ac65bf', '68a858ed-0e96-465b-a12a-62a413ab803c'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:58:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2bad2a99-9950-47bc-88c8-09a22362b632 tempest-ProjectMemberTests-792838276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2bad2a99-9950-47bc-88c8-09a22362b632 tempest-ProjectMemberTests-792838276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2bad2a99-9950-47bc-88c8-09a22362b632 tempest-ProjectMemberTests-792838276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:58:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2bad2a99-9950-47bc-88c8-09a22362b632 tempest-ProjectMemberTests-792838276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:58:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2bad2a99-9950-47bc-88c8-09a22362b632 tempest-ProjectMemberTests-792838276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2bad2a99-9950-47bc-88c8-09a22362b632 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:20 devstack sudo[115971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:58:20 devstack sudo[115971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:20 devstack sudo[115969]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5b79f3bd-d4a4-4aef-b2c9-3f837b2cb168 tempest-ProjectReaderTests-692176530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f331ec9f-776c-440c-a707-f641021c1d3f.92880ec8-2f33-4510-83d5-7447cf0001b1" returned: 0 in 0.269s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5b79f3bd-d4a4-4aef-b2c9-3f837b2cb168 tempest-ProjectReaderTests-692176530 None] Lock "cinder-quobyte-92880ec8-2f33-4510-83d5-7447cf0001b1" released by "_delete_snapshot" :: held 1.608s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5b79f3bd-d4a4-4aef-b2c9-3f837b2cb168 tempest-ProjectReaderTests-692176530 None] Lock "cinder-quobyte-f331ec9f-776c-440c-a707-f641021c1d3f" released by "delete_snapshot" :: held 1.636s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:20 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-5b79f3bd-d4a4-4aef-b2c9-3f837b2cb168 tempest-ProjectReaderTests-692176530 None] Created reservations ['fc65e71e-f701-4b79-8f9c-5617254d535e', 'ed663e04-faba-4b0d-a627-bd7a55e8c7ff', '0f43fab9-56f6-4e4a-aa9e-4c3777ffb298', '886c3ad8-fa95-4c85-8deb-7128430cf553'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:58:20 devstack sudo[115971]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2bad2a99-9950-47bc-88c8-09a22362b632 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.267s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:20 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-2bad2a99-9950-47bc-88c8-09a22362b632 tempest-ProjectMemberTests-792838276 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:58:20 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-2bad2a99-9950-47bc-88c8-09a22362b632 tempest-ProjectMemberTests-792838276 None] Deleted volume successfully. Aug 11 04:58:20 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-5b79f3bd-d4a4-4aef-b2c9-3f837b2cb168 tempest-ProjectReaderTests-692176530 None] Delete snapshot completed successfully. Aug 11 04:58:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5b79f3bd-d4a4-4aef-b2c9-3f837b2cb168 tempest-ProjectReaderTests-692176530 None] Lock "cinder-92880ec8-2f33-4510-83d5-7447cf0001b1-delete_snapshot" released by "delete_snapshot" :: held 1.796s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2bad2a99-9950-47bc-88c8-09a22362b632 tempest-ProjectMemberTests-792838276 None] Lock "cinder-c1333eed-c4ff-48db-8fcb-c718a0dfeb26-delete_volume" released by "delete_volume" :: held 1.234s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ab17704d-9b14-4125-b868-a15fe2045ca3 tempest-ProjectReaderTests-692176530 None] Acquiring lock "cinder-f331ec9f-776c-440c-a707-f641021c1d3f-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ab17704d-9b14-4125-b868-a15fe2045ca3 tempest-ProjectReaderTests-692176530 None] Lock "cinder-f331ec9f-776c-440c-a707-f641021c1d3f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:21 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-712a7d8e-6595-4f1f-a4de-cabc7ad3fd79 tempest-ProjectMemberTests-792838276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:58:21 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-712a7d8e-6595-4f1f-a4de-cabc7ad3fd79 tempest-ProjectMemberTests-792838276 None] Flow 'volume_create_manager' (6401140b-a933-43e4-a9d0-4e858374f3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:58:21 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-712a7d8e-6595-4f1f-a4de-cabc7ad3fd79 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7bc8019-ed5d-4a38-a825-6bd895d8828a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:21 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-712a7d8e-6595-4f1f-a4de-cabc7ad3fd79 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7bc8019-ed5d-4a38-a825-6bd895d8828a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:58:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-841209971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2dc92fe-86e3-46a0-8cdf-051036843eeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac225c2b69784eb6b9ec19178ed3af8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:58:21Z,use_quota=True,user_id='4ce57473867c427a94cf64a00303ce0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:21 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-712a7d8e-6595-4f1f-a4de-cabc7ad3fd79 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (455b3108-69e9-48db-977b-3488aa9f42d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:21 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-712a7d8e-6595-4f1f-a4de-cabc7ad3fd79 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (455b3108-69e9-48db-977b-3488aa9f42d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:21 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-712a7d8e-6595-4f1f-a4de-cabc7ad3fd79 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f186bb93-e59c-47a4-84f0-1e794a5e4572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:21 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-712a7d8e-6595-4f1f-a4de-cabc7ad3fd79 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f186bb93-e59c-47a4-84f0-1e794a5e4572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2dc92fe-86e3-46a0-8cdf-051036843eeb', 'volume_name': 'volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:21 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-712a7d8e-6595-4f1f-a4de-cabc7ad3fd79 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c0a5574-c995-40ec-99e9-5e58eba142fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:21 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-712a7d8e-6595-4f1f-a4de-cabc7ad3fd79 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c0a5574-c995-40ec-99e9-5e58eba142fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:21 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-712a7d8e-6595-4f1f-a4de-cabc7ad3fd79 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04bbc023-030b-4894-ba32-6d864ad88ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:21 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-712a7d8e-6595-4f1f-a4de-cabc7ad3fd79 tempest-ProjectMemberTests-792838276 None] Volume b2dc92fe-86e3-46a0-8cdf-051036843eeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb', 'volume_size': 1} Aug 11 04:58:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-712a7d8e-6595-4f1f-a4de-cabc7ad3fd79 tempest-ProjectMemberTests-792838276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-712a7d8e-6595-4f1f-a4de-cabc7ad3fd79 tempest-ProjectMemberTests-792838276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:21 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-712a7d8e-6595-4f1f-a4de-cabc7ad3fd79 tempest-ProjectMemberTests-792838276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:58:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-841209971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2dc92fe-86e3-46a0-8cdf-051036843eeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac225c2b69784eb6b9ec19178ed3af8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:58:21Z,use_quota=True,user_id='4ce57473867c427a94cf64a00303ce0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:58:21 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-712a7d8e-6595-4f1f-a4de-cabc7ad3fd79 tempest-ProjectMemberTests-792838276 None] Creating volume b2dc92fe-86e3-46a0-8cdf-051036843eeb {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:58:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-712a7d8e-6595-4f1f-a4de-cabc7ad3fd79 tempest-ProjectMemberTests-792838276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-712a7d8e-6595-4f1f-a4de-cabc7ad3fd79 tempest-ProjectMemberTests-792838276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:21 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-712a7d8e-6595-4f1f-a4de-cabc7ad3fd79 tempest-ProjectMemberTests-792838276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:58:21 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-712a7d8e-6595-4f1f-a4de-cabc7ad3fd79 tempest-ProjectMemberTests-792838276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:58:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-712a7d8e-6595-4f1f-a4de-cabc7ad3fd79 tempest-ProjectMemberTests-792838276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:21 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-712a7d8e-6595-4f1f-a4de-cabc7ad3fd79 tempest-ProjectMemberTests-792838276 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:58:21 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-712a7d8e-6595-4f1f-a4de-cabc7ad3fd79 tempest-ProjectMemberTests-792838276 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:58:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-712a7d8e-6595-4f1f-a4de-cabc7ad3fd79 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:21 devstack sudo[116011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb 1073741824 Aug 11 04:58:21 devstack sudo[116011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ab17704d-9b14-4125-b868-a15fe2045ca3 tempest-ProjectReaderTests-692176530 None] Acquiring lock "cinder-quobyte-f331ec9f-776c-440c-a707-f641021c1d3f" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ab17704d-9b14-4125-b868-a15fe2045ca3 tempest-ProjectReaderTests-692176530 None] Lock "cinder-quobyte-f331ec9f-776c-440c-a707-f641021c1d3f" acquired by "delete_volume" :: waited 0.018s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:21 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[35499540-844c-48c0-afc1-f89385e73b27]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:58:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ab17704d-9b14-4125-b868-a15fe2045ca3 tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f331ec9f-776c-440c-a707-f641021c1d3f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:21 devstack sudo[116013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f331ec9f-776c-440c-a707-f641021c1d3f Aug 11 04:58:21 devstack sudo[116013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-07240e7f-7c9a-4c4c-b838-23f35df940e7 tempest-ProjectReaderTests-750734017 None] Acquiring lock "cinder-242c26e6-b01b-438b-99cb-3bc7fd2912bd-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-07240e7f-7c9a-4c4c-b838-23f35df940e7 tempest-ProjectReaderTests-750734017 None] Lock "cinder-242c26e6-b01b-438b-99cb-3bc7fd2912bd-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-07240e7f-7c9a-4c4c-b838-23f35df940e7 tempest-ProjectReaderTests-750734017 None] Acquiring lock "cinder-quobyte-242c26e6-b01b-438b-99cb-3bc7fd2912bd" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-07240e7f-7c9a-4c4c-b838-23f35df940e7 tempest-ProjectReaderTests-750734017 None] Lock "cinder-quobyte-242c26e6-b01b-438b-99cb-3bc7fd2912bd" acquired by "delete_volume" :: waited 0.017s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:21 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4334d4-7738-4023-9d16-fbd89136cc5a]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:58:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-07240e7f-7c9a-4c4c-b838-23f35df940e7 tempest-ProjectReaderTests-750734017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-242c26e6-b01b-438b-99cb-3bc7fd2912bd {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:21 devstack sudo[116013]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:21 devstack sudo[116011]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ab17704d-9b14-4125-b868-a15fe2045ca3 tempest-ProjectReaderTests-692176530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f331ec9f-776c-440c-a707-f641021c1d3f" returned: 0 in 0.444s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ab17704d-9b14-4125-b868-a15fe2045ca3 tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f331ec9f-776c-440c-a707-f641021c1d3f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-712a7d8e-6595-4f1f-a4de-cabc7ad3fd79 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb 1073741824" returned: 0 in 0.553s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:21 devstack sudo[116024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f331ec9f-776c-440c-a707-f641021c1d3f Aug 11 04:58:21 devstack sudo[116024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-712a7d8e-6595-4f1f-a4de-cabc7ad3fd79 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:21 devstack sudo[116026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb Aug 11 04:58:21 devstack sudo[116026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:22 devstack sudo[116023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-242c26e6-b01b-438b-99cb-3bc7fd2912bd Aug 11 04:58:22 devstack sudo[116023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:22 devstack sudo[116024]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ab17704d-9b14-4125-b868-a15fe2045ca3 tempest-ProjectReaderTests-692176530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-f331ec9f-776c-440c-a707-f641021c1d3f" returned: 0 in 0.279s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ab17704d-9b14-4125-b868-a15fe2045ca3 tempest-ProjectReaderTests-692176530 None] Lock "cinder-quobyte-f331ec9f-776c-440c-a707-f641021c1d3f" released by "delete_volume" :: held 0.798s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:22 devstack sudo[116026]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-712a7d8e-6595-4f1f-a4de-cabc7ad3fd79 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb" returned: 0 in 0.273s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-712a7d8e-6595-4f1f-a4de-cabc7ad3fd79 tempest-ProjectMemberTests-792838276 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:58:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-712a7d8e-6595-4f1f-a4de-cabc7ad3fd79 tempest-ProjectMemberTests-792838276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-712a7d8e-6595-4f1f-a4de-cabc7ad3fd79 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04bbc023-030b-4894-ba32-6d864ad88ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-712a7d8e-6595-4f1f-a4de-cabc7ad3fd79 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (712ad4d4-bbdc-4255-adde-1a6f5bcc7831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:22 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-712a7d8e-6595-4f1f-a4de-cabc7ad3fd79 tempest-ProjectMemberTests-792838276 None] Volume volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb (b2dc92fe-86e3-46a0-8cdf-051036843eeb): created successfully Aug 11 04:58:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-712a7d8e-6595-4f1f-a4de-cabc7ad3fd79 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (712ad4d4-bbdc-4255-adde-1a6f5bcc7831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-712a7d8e-6595-4f1f-a4de-cabc7ad3fd79 tempest-ProjectMemberTests-792838276 None] Flow 'volume_create_manager' (6401140b-a933-43e4-a9d0-4e858374f3d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:58:22 devstack sudo[116023]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-07240e7f-7c9a-4c4c-b838-23f35df940e7 tempest-ProjectReaderTests-750734017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-242c26e6-b01b-438b-99cb-3bc7fd2912bd" returned: 0 in 0.411s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-07240e7f-7c9a-4c4c-b838-23f35df940e7 tempest-ProjectReaderTests-750734017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-242c26e6-b01b-438b-99cb-3bc7fd2912bd {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:22 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-712a7d8e-6595-4f1f-a4de-cabc7ad3fd79 tempest-ProjectMemberTests-792838276 None] Created volume successfully. Aug 11 04:58:22 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-ab17704d-9b14-4125-b868-a15fe2045ca3 tempest-ProjectReaderTests-692176530 None] Created reservations ['dbcd565d-fc20-41f1-8454-700c933cac91', '547396db-9383-4f11-995d-0e485284b17b', '502afd4c-e4cb-4fa2-8c33-7279a64c3e20', 'a5e93ef6-3d35-4e6d-8cc2-f48a05cd1255'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:58:22 devstack sudo[116034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-242c26e6-b01b-438b-99cb-3bc7fd2912bd Aug 11 04:58:22 devstack sudo[116034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ab17704d-9b14-4125-b868-a15fe2045ca3 tempest-ProjectReaderTests-692176530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ab17704d-9b14-4125-b868-a15fe2045ca3 tempest-ProjectReaderTests-692176530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ab17704d-9b14-4125-b868-a15fe2045ca3 tempest-ProjectReaderTests-692176530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:58:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ab17704d-9b14-4125-b868-a15fe2045ca3 tempest-ProjectReaderTests-692176530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:58:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ab17704d-9b14-4125-b868-a15fe2045ca3 tempest-ProjectReaderTests-692176530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ab17704d-9b14-4125-b868-a15fe2045ca3 tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:22 devstack sudo[116036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:58:22 devstack sudo[116036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:22 devstack sudo[116034]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-07240e7f-7c9a-4c4c-b838-23f35df940e7 tempest-ProjectReaderTests-750734017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-242c26e6-b01b-438b-99cb-3bc7fd2912bd" returned: 0 in 0.259s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-07240e7f-7c9a-4c4c-b838-23f35df940e7 tempest-ProjectReaderTests-750734017 None] Lock "cinder-quobyte-242c26e6-b01b-438b-99cb-3bc7fd2912bd" released by "delete_volume" :: held 0.717s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:22 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-07240e7f-7c9a-4c4c-b838-23f35df940e7 tempest-ProjectReaderTests-750734017 None] Created reservations ['4b84b722-f306-49bb-9863-f025bb1c3d63', 'f1188f58-8518-46ae-976f-f3e5b4351d67', '12c3bb0a-e5f9-466a-80a3-d5c8c605a4ea', 'ab80ca76-8ea0-46f7-b082-4cf3736b1f89'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:58:22 devstack sudo[116036]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ab17704d-9b14-4125-b868-a15fe2045ca3 tempest-ProjectReaderTests-692176530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.265s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:22 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-ab17704d-9b14-4125-b868-a15fe2045ca3 tempest-ProjectReaderTests-692176530 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:58:22 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-ab17704d-9b14-4125-b868-a15fe2045ca3 tempest-ProjectReaderTests-692176530 None] Deleted volume successfully. Aug 11 04:58:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ab17704d-9b14-4125-b868-a15fe2045ca3 tempest-ProjectReaderTests-692176530 None] Lock "cinder-f331ec9f-776c-440c-a707-f641021c1d3f-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-07240e7f-7c9a-4c4c-b838-23f35df940e7 tempest-ProjectReaderTests-750734017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-07240e7f-7c9a-4c4c-b838-23f35df940e7 tempest-ProjectReaderTests-750734017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-07240e7f-7c9a-4c4c-b838-23f35df940e7 tempest-ProjectReaderTests-750734017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:58:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-07240e7f-7c9a-4c4c-b838-23f35df940e7 tempest-ProjectReaderTests-750734017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:58:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-07240e7f-7c9a-4c4c-b838-23f35df940e7 tempest-ProjectReaderTests-750734017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-07240e7f-7c9a-4c4c-b838-23f35df940e7 tempest-ProjectReaderTests-750734017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:22 devstack sudo[116040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:58:22 devstack sudo[116040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:23 devstack sudo[116040]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-07240e7f-7c9a-4c4c-b838-23f35df940e7 tempest-ProjectReaderTests-750734017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.258s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:23 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-07240e7f-7c9a-4c4c-b838-23f35df940e7 tempest-ProjectReaderTests-750734017 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:58:23 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-07240e7f-7c9a-4c4c-b838-23f35df940e7 tempest-ProjectReaderTests-750734017 None] Deleted volume successfully. Aug 11 04:58:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-07240e7f-7c9a-4c4c-b838-23f35df940e7 tempest-ProjectReaderTests-750734017 None] Lock "cinder-242c26e6-b01b-438b-99cb-3bc7fd2912bd-delete_volume" released by "delete_volume" :: held 1.267s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:23 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-6835345e-7400-4a78-9afe-783f6e3c7d38 tempest-ProjectReaderTests-750734017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:58:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6835345e-7400-4a78-9afe-783f6e3c7d38 tempest-ProjectReaderTests-750734017 None] Flow 'volume_create_manager' (352a0725-6883-47e1-8aca-42b03573ded7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:58:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6835345e-7400-4a78-9afe-783f6e3c7d38 tempest-ProjectReaderTests-750734017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70d8332d-feee-47f9-bb35-2abe12c7937b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6835345e-7400-4a78-9afe-783f6e3c7d38 tempest-ProjectReaderTests-750734017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70d8332d-feee-47f9-bb35-2abe12c7937b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:58:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-304679727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=117d86ee-9538-493c-9c11-85cecc09b0e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74315cc5ab964111aa490d052fcd09fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:58:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:58:23Z,use_quota=True,user_id='0fcc67d5a80a4706887e00b9f7c1f946',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6835345e-7400-4a78-9afe-783f6e3c7d38 tempest-ProjectReaderTests-750734017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a1840fd-7b18-4ab5-84d5-29ae51bd82e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6835345e-7400-4a78-9afe-783f6e3c7d38 tempest-ProjectReaderTests-750734017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a1840fd-7b18-4ab5-84d5-29ae51bd82e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6835345e-7400-4a78-9afe-783f6e3c7d38 tempest-ProjectReaderTests-750734017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (336a2339-cf1a-487b-ba2f-3499477d8669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6835345e-7400-4a78-9afe-783f6e3c7d38 tempest-ProjectReaderTests-750734017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (336a2339-cf1a-487b-ba2f-3499477d8669) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '117d86ee-9538-493c-9c11-85cecc09b0e2', 'volume_name': 'volume-117d86ee-9538-493c-9c11-85cecc09b0e2', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6835345e-7400-4a78-9afe-783f6e3c7d38 tempest-ProjectReaderTests-750734017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4c80002-728e-484e-9616-e019b7ca7e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6835345e-7400-4a78-9afe-783f6e3c7d38 tempest-ProjectReaderTests-750734017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4c80002-728e-484e-9616-e019b7ca7e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6835345e-7400-4a78-9afe-783f6e3c7d38 tempest-ProjectReaderTests-750734017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5752de4e-a82e-4afe-af40-34a1e5e59169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:23 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-6835345e-7400-4a78-9afe-783f6e3c7d38 tempest-ProjectReaderTests-750734017 None] Volume 117d86ee-9538-493c-9c11-85cecc09b0e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-117d86ee-9538-493c-9c11-85cecc09b0e2', 'volume_size': 1} Aug 11 04:58:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6835345e-7400-4a78-9afe-783f6e3c7d38 tempest-ProjectReaderTests-750734017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6835345e-7400-4a78-9afe-783f6e3c7d38 tempest-ProjectReaderTests-750734017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:23 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6835345e-7400-4a78-9afe-783f6e3c7d38 tempest-ProjectReaderTests-750734017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:58:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-304679727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=117d86ee-9538-493c-9c11-85cecc09b0e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74315cc5ab964111aa490d052fcd09fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:58:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:58:23Z,use_quota=True,user_id='0fcc67d5a80a4706887e00b9f7c1f946',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:58:23 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-6835345e-7400-4a78-9afe-783f6e3c7d38 tempest-ProjectReaderTests-750734017 None] Creating volume 117d86ee-9538-493c-9c11-85cecc09b0e2 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:58:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6835345e-7400-4a78-9afe-783f6e3c7d38 tempest-ProjectReaderTests-750734017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6835345e-7400-4a78-9afe-783f6e3c7d38 tempest-ProjectReaderTests-750734017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:23 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6835345e-7400-4a78-9afe-783f6e3c7d38 tempest-ProjectReaderTests-750734017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:58:23 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6835345e-7400-4a78-9afe-783f6e3c7d38 tempest-ProjectReaderTests-750734017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:58:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6835345e-7400-4a78-9afe-783f6e3c7d38 tempest-ProjectReaderTests-750734017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:23 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6835345e-7400-4a78-9afe-783f6e3c7d38 tempest-ProjectReaderTests-750734017 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:58:23 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-6835345e-7400-4a78-9afe-783f6e3c7d38 tempest-ProjectReaderTests-750734017 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:58:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6835345e-7400-4a78-9afe-783f6e3c7d38 tempest-ProjectReaderTests-750734017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-117d86ee-9538-493c-9c11-85cecc09b0e2 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:23 devstack sudo[116044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-117d86ee-9538-493c-9c11-85cecc09b0e2 1073741824 Aug 11 04:58:23 devstack sudo[116044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8d126d98-e3b9-4d06-9909-ec89e0d1e407 tempest-ProjectMemberTests-792838276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:23 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fbf4d44-38d5-4dcb-8e88-f1aada7888bb tempest-ProjectReaderTests-692176530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:58:23 devstack sudo[116044]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fbf4d44-38d5-4dcb-8e88-f1aada7888bb tempest-ProjectReaderTests-692176530 None] Flow 'volume_create_manager' (01041c90-25c2-4869-9ae9-c3cfbb2b1dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:58:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fbf4d44-38d5-4dcb-8e88-f1aada7888bb tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dce787d-6650-4cd2-869d-08b011abd001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6835345e-7400-4a78-9afe-783f6e3c7d38 tempest-ProjectReaderTests-750734017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-117d86ee-9538-493c-9c11-85cecc09b0e2 1073741824" returned: 0 in 0.493s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fbf4d44-38d5-4dcb-8e88-f1aada7888bb tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dce787d-6650-4cd2-869d-08b011abd001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:58:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1783781215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=213b2d8a-10a4-430a-a0e4-68efebd4cc24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95563f14c47841708c0521bda11769a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:58:24Z,use_quota=True,user_id='f7bf5308d1fc4270957690c1005f4a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fbf4d44-38d5-4dcb-8e88-f1aada7888bb tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32e48f06-453a-45d7-9808-a9480f4d4b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fbf4d44-38d5-4dcb-8e88-f1aada7888bb tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32e48f06-453a-45d7-9808-a9480f4d4b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fbf4d44-38d5-4dcb-8e88-f1aada7888bb tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa4fd352-ee72-4d52-bc16-3e1aeee4d688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fbf4d44-38d5-4dcb-8e88-f1aada7888bb tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa4fd352-ee72-4d52-bc16-3e1aeee4d688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '213b2d8a-10a4-430a-a0e4-68efebd4cc24', 'volume_name': 'volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fbf4d44-38d5-4dcb-8e88-f1aada7888bb tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aac6d38-75ca-49a0-aa33-08b0c004b39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fbf4d44-38d5-4dcb-8e88-f1aada7888bb tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aac6d38-75ca-49a0-aa33-08b0c004b39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fbf4d44-38d5-4dcb-8e88-f1aada7888bb tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (460a1961-0338-4d6e-be98-50471671eff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:24 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-4fbf4d44-38d5-4dcb-8e88-f1aada7888bb tempest-ProjectReaderTests-692176530 None] Volume 213b2d8a-10a4-430a-a0e4-68efebd4cc24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24', 'volume_size': 1} Aug 11 04:58:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fbf4d44-38d5-4dcb-8e88-f1aada7888bb tempest-ProjectReaderTests-692176530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6835345e-7400-4a78-9afe-783f6e3c7d38 tempest-ProjectReaderTests-750734017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-117d86ee-9538-493c-9c11-85cecc09b0e2 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:24 devstack sudo[116049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-117d86ee-9538-493c-9c11-85cecc09b0e2 Aug 11 04:58:24 devstack sudo[116049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:24 devstack sudo[116049]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6835345e-7400-4a78-9afe-783f6e3c7d38 tempest-ProjectReaderTests-750734017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-117d86ee-9538-493c-9c11-85cecc09b0e2" returned: 0 in 0.256s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6835345e-7400-4a78-9afe-783f6e3c7d38 tempest-ProjectReaderTests-750734017 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:58:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6835345e-7400-4a78-9afe-783f6e3c7d38 tempest-ProjectReaderTests-750734017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8d126d98-e3b9-4d06-9909-ec89e0d1e407 tempest-ProjectMemberTests-792838276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.785s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6835345e-7400-4a78-9afe-783f6e3c7d38 tempest-ProjectReaderTests-750734017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5752de4e-a82e-4afe-af40-34a1e5e59169) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-117d86ee-9538-493c-9c11-85cecc09b0e2', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6835345e-7400-4a78-9afe-783f6e3c7d38 tempest-ProjectReaderTests-750734017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6d98c63-f98c-49f2-8953-153f3516b73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-8d126d98-e3b9-4d06-9909-ec89e0d1e407 tempest-ProjectMemberTests-792838276 None] Creating offline snapshot 0e9dc421-527d-4385-9b12-6dde35443677 of volume b2dc92fe-86e3-46a0-8cdf-051036843eeb {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 04:58:24 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-6835345e-7400-4a78-9afe-783f6e3c7d38 tempest-ProjectReaderTests-750734017 None] Volume volume-117d86ee-9538-493c-9c11-85cecc09b0e2 (117d86ee-9538-493c-9c11-85cecc09b0e2): created successfully Aug 11 04:58:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6835345e-7400-4a78-9afe-783f6e3c7d38 tempest-ProjectReaderTests-750734017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6d98c63-f98c-49f2-8953-153f3516b73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6835345e-7400-4a78-9afe-783f6e3c7d38 tempest-ProjectReaderTests-750734017 None] Flow 'volume_create_manager' (352a0725-6883-47e1-8aca-42b03573ded7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:58:24 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[8584f393-92c3-4d01-8f01-c5f95944a07b]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:58:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8d126d98-e3b9-4d06-9909-ec89e0d1e407 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:24 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-6835345e-7400-4a78-9afe-783f6e3c7d38 tempest-ProjectReaderTests-750734017 None] Created volume successfully. Aug 11 04:58:24 devstack sudo[116052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb Aug 11 04:58:24 devstack sudo[116052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:24 devstack sudo[116052]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8d126d98-e3b9-4d06-9909-ec89e0d1e407 tempest-ProjectMemberTests-792838276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb" returned: 0 in 0.356s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8d126d98-e3b9-4d06-9909-ec89e0d1e407 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb.0e9dc421-527d-4385-9b12-6dde35443677 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:24 devstack sudo[116057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb.0e9dc421-527d-4385-9b12-6dde35443677 1G Aug 11 04:58:24 devstack sudo[116057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:25 devstack sudo[116057]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8d126d98-e3b9-4d06-9909-ec89e0d1e407 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb.0e9dc421-527d-4385-9b12-6dde35443677 1G" returned: 0 in 0.374s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8d126d98-e3b9-4d06-9909-ec89e0d1e407 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb.0e9dc421-527d-4385-9b12-6dde35443677 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:25 devstack sudo[116063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb.0e9dc421-527d-4385-9b12-6dde35443677 Aug 11 04:58:25 devstack sudo[116063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:25 devstack sudo[116063]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8d126d98-e3b9-4d06-9909-ec89e0d1e407 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb.0e9dc421-527d-4385-9b12-6dde35443677" returned: 0 in 0.293s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:25 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-8d126d98-e3b9-4d06-9909-ec89e0d1e407 tempest-ProjectMemberTests-792838276 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb.0e9dc421-527d-4385-9b12-6dde35443677 is being set with open permissions: ugo+rw Aug 11 04:58:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8d126d98-e3b9-4d06-9909-ec89e0d1e407 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb.0e9dc421-527d-4385-9b12-6dde35443677 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:25 devstack sudo[116074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb.0e9dc421-527d-4385-9b12-6dde35443677 Aug 11 04:58:25 devstack sudo[116074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-30afe025-2a07-4719-93b3-c0fdc3c7e253 tempest-ProjectReaderTests-750734017 None] Acquiring lock "cinder-117d86ee-9538-493c-9c11-85cecc09b0e2-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-30afe025-2a07-4719-93b3-c0fdc3c7e253 tempest-ProjectReaderTests-750734017 None] Lock "cinder-117d86ee-9538-493c-9c11-85cecc09b0e2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-30afe025-2a07-4719-93b3-c0fdc3c7e253 tempest-ProjectReaderTests-750734017 None] Acquiring lock "cinder-quobyte-117d86ee-9538-493c-9c11-85cecc09b0e2" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-30afe025-2a07-4719-93b3-c0fdc3c7e253 tempest-ProjectReaderTests-750734017 None] Lock "cinder-quobyte-117d86ee-9538-493c-9c11-85cecc09b0e2" acquired by "delete_volume" :: waited 0.014s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:25 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94b650f-2e74-4514-b2cc-a8c446f0d1ee]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:58:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-30afe025-2a07-4719-93b3-c0fdc3c7e253 tempest-ProjectReaderTests-750734017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-117d86ee-9538-493c-9c11-85cecc09b0e2 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:25 devstack sudo[116074]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8d126d98-e3b9-4d06-9909-ec89e0d1e407 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb.0e9dc421-527d-4385-9b12-6dde35443677" returned: 0 in 0.267s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8d126d98-e3b9-4d06-9909-ec89e0d1e407 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:25 devstack sudo[116076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-117d86ee-9538-493c-9c11-85cecc09b0e2 Aug 11 04:58:25 devstack sudo[116076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:25 devstack sudo[116078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb.info Aug 11 04:58:25 devstack sudo[116078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:25 devstack sudo[116078]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8d126d98-e3b9-4d06-9909-ec89e0d1e407 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb.info" returned: 0 in 0.270s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:25 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-8d126d98-e3b9-4d06-9909-ec89e0d1e407 tempest-ProjectMemberTests-792838276 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb.info is being set with open permissions: ugo+rw Aug 11 04:58:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8d126d98-e3b9-4d06-9909-ec89e0d1e407 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:25 devstack sudo[116076]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-30afe025-2a07-4719-93b3-c0fdc3c7e253 tempest-ProjectReaderTests-750734017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-117d86ee-9538-493c-9c11-85cecc09b0e2" returned: 0 in 0.386s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-30afe025-2a07-4719-93b3-c0fdc3c7e253 tempest-ProjectReaderTests-750734017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-117d86ee-9538-493c-9c11-85cecc09b0e2 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:26 devstack sudo[116085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb.info Aug 11 04:58:26 devstack sudo[116085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:26 devstack sudo[116086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-117d86ee-9538-493c-9c11-85cecc09b0e2 Aug 11 04:58:26 devstack sudo[116086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:26 devstack sudo[116085]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8d126d98-e3b9-4d06-9909-ec89e0d1e407 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb.info" returned: 0 in 0.253s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8d126d98-e3b9-4d06-9909-ec89e0d1e407 tempest-ProjectMemberTests-792838276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.914s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fbf4d44-38d5-4dcb-8e88-f1aada7888bb tempest-ProjectReaderTests-692176530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.201s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:26 devstack sudo[116086]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:26 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4fbf4d44-38d5-4dcb-8e88-f1aada7888bb tempest-ProjectReaderTests-692176530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:58:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1783781215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=213b2d8a-10a4-430a-a0e4-68efebd4cc24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95563f14c47841708c0521bda11769a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:58:24Z,use_quota=True,user_id='f7bf5308d1fc4270957690c1005f4a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:58:26 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-4fbf4d44-38d5-4dcb-8e88-f1aada7888bb tempest-ProjectReaderTests-692176530 None] Creating volume 213b2d8a-10a4-430a-a0e4-68efebd4cc24 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:58:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fbf4d44-38d5-4dcb-8e88-f1aada7888bb tempest-ProjectReaderTests-692176530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fbf4d44-38d5-4dcb-8e88-f1aada7888bb tempest-ProjectReaderTests-692176530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:26 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4fbf4d44-38d5-4dcb-8e88-f1aada7888bb tempest-ProjectReaderTests-692176530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:58:26 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4fbf4d44-38d5-4dcb-8e88-f1aada7888bb tempest-ProjectReaderTests-692176530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:58:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fbf4d44-38d5-4dcb-8e88-f1aada7888bb tempest-ProjectReaderTests-692176530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:26 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4fbf4d44-38d5-4dcb-8e88-f1aada7888bb tempest-ProjectReaderTests-692176530 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:58:26 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-4fbf4d44-38d5-4dcb-8e88-f1aada7888bb tempest-ProjectReaderTests-692176530 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:58:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4fbf4d44-38d5-4dcb-8e88-f1aada7888bb tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-30afe025-2a07-4719-93b3-c0fdc3c7e253 tempest-ProjectReaderTests-750734017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-117d86ee-9538-493c-9c11-85cecc09b0e2" returned: 0 in 0.284s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:26 devstack sudo[116091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24 1073741824 Aug 11 04:58:26 devstack sudo[116091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:26 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-30afe025-2a07-4719-93b3-c0fdc3c7e253 tempest-ProjectReaderTests-750734017 None] Lock "cinder-quobyte-117d86ee-9538-493c-9c11-85cecc09b0e2" released by "delete_volume" :: held 0.726s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:26 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-8d126d98-e3b9-4d06-9909-ec89e0d1e407 tempest-ProjectMemberTests-792838276 None] Create snapshot completed successfully Aug 11 04:58:26 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-30afe025-2a07-4719-93b3-c0fdc3c7e253 tempest-ProjectReaderTests-750734017 None] Created reservations ['6a5684bd-b2cd-459e-9d18-71ca91eb3e46', '1ec84bf0-31b9-4d33-bf4c-e3b5079c7158', 'a36a5a01-f262-40b1-acf8-a39ac655853a', 'dbf6d99d-1e88-442a-9f67-88ab83c0a4e9'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:58:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-30afe025-2a07-4719-93b3-c0fdc3c7e253 tempest-ProjectReaderTests-750734017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-30afe025-2a07-4719-93b3-c0fdc3c7e253 tempest-ProjectReaderTests-750734017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:26 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-30afe025-2a07-4719-93b3-c0fdc3c7e253 tempest-ProjectReaderTests-750734017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:58:26 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-30afe025-2a07-4719-93b3-c0fdc3c7e253 tempest-ProjectReaderTests-750734017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:58:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-30afe025-2a07-4719-93b3-c0fdc3c7e253 tempest-ProjectReaderTests-750734017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-30afe025-2a07-4719-93b3-c0fdc3c7e253 tempest-ProjectReaderTests-750734017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:26 devstack sudo[116093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:58:26 devstack sudo[116093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:26 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-37de0c4c-a17b-4e47-bb7d-ae82fc10bbd2 tempest-ProjectMemberTests-792838276 None] Acquiring lock "cinder-0e9dc421-527d-4385-9b12-6dde35443677-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:26 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-37de0c4c-a17b-4e47-bb7d-ae82fc10bbd2 tempest-ProjectMemberTests-792838276 None] Lock "cinder-0e9dc421-527d-4385-9b12-6dde35443677-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:26 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-37de0c4c-a17b-4e47-bb7d-ae82fc10bbd2 tempest-ProjectMemberTests-792838276 None] Acquiring lock "cinder-quobyte-b2dc92fe-86e3-46a0-8cdf-051036843eeb" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:26 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-37de0c4c-a17b-4e47-bb7d-ae82fc10bbd2 tempest-ProjectMemberTests-792838276 None] Lock "cinder-quobyte-b2dc92fe-86e3-46a0-8cdf-051036843eeb" acquired by "delete_snapshot" :: waited 0.030s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:26 devstack sudo[116093]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:26 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-37de0c4c-a17b-4e47-bb7d-ae82fc10bbd2 tempest-ProjectMemberTests-792838276 None] Acquiring lock "cinder-quobyte-0e9dc421-527d-4385-9b12-6dde35443677" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-30afe025-2a07-4719-93b3-c0fdc3c7e253 tempest-ProjectReaderTests-750734017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.313s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:26 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-30afe025-2a07-4719-93b3-c0fdc3c7e253 tempest-ProjectReaderTests-750734017 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:58:26 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-30afe025-2a07-4719-93b3-c0fdc3c7e253 tempest-ProjectReaderTests-750734017 None] Deleted volume successfully. Aug 11 04:58:26 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-37de0c4c-a17b-4e47-bb7d-ae82fc10bbd2 tempest-ProjectMemberTests-792838276 None] Lock "cinder-quobyte-0e9dc421-527d-4385-9b12-6dde35443677" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:26 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-37de0c4c-a17b-4e47-bb7d-ae82fc10bbd2 tempest-ProjectMemberTests-792838276 None] Deleting offline snapshot 0e9dc421-527d-4385-9b12-6dde35443677 of volume b2dc92fe-86e3-46a0-8cdf-051036843eeb {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 04:58:26 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-37de0c4c-a17b-4e47-bb7d-ae82fc10bbd2 tempest-ProjectMemberTests-792838276 None] snapshot_file for this snap is: volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb.0e9dc421-527d-4385-9b12-6dde35443677 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 04:58:26 devstack sudo[116091]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:26 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-30afe025-2a07-4719-93b3-c0fdc3c7e253 tempest-ProjectReaderTests-750734017 None] Lock "cinder-117d86ee-9538-493c-9c11-85cecc09b0e2-delete_volume" released by "delete_volume" :: held 1.268s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:26 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[2966fb5b-65a3-4e5a-86a7-935a24f9237c]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:58:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-37de0c4c-a17b-4e47-bb7d-ae82fc10bbd2 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb.0e9dc421-527d-4385-9b12-6dde35443677 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4fbf4d44-38d5-4dcb-8e88-f1aada7888bb tempest-ProjectReaderTests-692176530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24 1073741824" returned: 0 in 0.541s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4fbf4d44-38d5-4dcb-8e88-f1aada7888bb tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:26 devstack sudo[116101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24 Aug 11 04:58:26 devstack sudo[116101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:26 devstack sudo[116100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb.0e9dc421-527d-4385-9b12-6dde35443677 Aug 11 04:58:26 devstack sudo[116100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:27 devstack sudo[116101]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4fbf4d44-38d5-4dcb-8e88-f1aada7888bb tempest-ProjectReaderTests-692176530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24" returned: 0 in 0.296s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4fbf4d44-38d5-4dcb-8e88-f1aada7888bb tempest-ProjectReaderTests-692176530 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:58:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fbf4d44-38d5-4dcb-8e88-f1aada7888bb tempest-ProjectReaderTests-692176530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fbf4d44-38d5-4dcb-8e88-f1aada7888bb tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (460a1961-0338-4d6e-be98-50471671eff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fbf4d44-38d5-4dcb-8e88-f1aada7888bb tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f205c8a1-45b2-40e7-a0aa-1374812eca69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:27 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-4fbf4d44-38d5-4dcb-8e88-f1aada7888bb tempest-ProjectReaderTests-692176530 None] Volume volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24 (213b2d8a-10a4-430a-a0e4-68efebd4cc24): created successfully Aug 11 04:58:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fbf4d44-38d5-4dcb-8e88-f1aada7888bb tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f205c8a1-45b2-40e7-a0aa-1374812eca69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fbf4d44-38d5-4dcb-8e88-f1aada7888bb tempest-ProjectReaderTests-692176530 None] Flow 'volume_create_manager' (01041c90-25c2-4869-9ae9-c3cfbb2b1dfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:58:27 devstack sudo[116100]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:27 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b52faa8-467a-4eaf-96f8-97a861904071 tempest-ProjectReaderTests-750734017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:58:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7b52faa8-467a-4eaf-96f8-97a861904071 tempest-ProjectReaderTests-750734017 None] Flow 'volume_create_manager' (691dfeb5-f0bf-4abe-bd4e-0471820bb214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:58:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7b52faa8-467a-4eaf-96f8-97a861904071 tempest-ProjectReaderTests-750734017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (375b7dbf-6784-496c-bd3c-78b136baf53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-37de0c4c-a17b-4e47-bb7d-ae82fc10bbd2 tempest-ProjectMemberTests-792838276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb.0e9dc421-527d-4385-9b12-6dde35443677" returned: 0 in 0.462s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-37de0c4c-a17b-4e47-bb7d-ae82fc10bbd2 tempest-ProjectMemberTests-792838276 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:58:27 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-4fbf4d44-38d5-4dcb-8e88-f1aada7888bb tempest-ProjectReaderTests-692176530 None] Created volume successfully. Aug 11 04:58:27 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[4297e1c2-7f6d-4293-8a05-e0e2a5c3c6b0]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:58:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-37de0c4c-a17b-4e47-bb7d-ae82fc10bbd2 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7b52faa8-467a-4eaf-96f8-97a861904071 tempest-ProjectReaderTests-750734017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (375b7dbf-6784-496c-bd3c-78b136baf53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-458648220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65fce7d1-c65d-4dac-8b42-7a43f4850d02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74315cc5ab964111aa490d052fcd09fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:58:27Z,use_quota=True,user_id='0fcc67d5a80a4706887e00b9f7c1f946',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7b52faa8-467a-4eaf-96f8-97a861904071 tempest-ProjectReaderTests-750734017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (383e9eab-ea1f-406d-8542-68c6b987bd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7b52faa8-467a-4eaf-96f8-97a861904071 tempest-ProjectReaderTests-750734017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (383e9eab-ea1f-406d-8542-68c6b987bd54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7b52faa8-467a-4eaf-96f8-97a861904071 tempest-ProjectReaderTests-750734017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d00dd843-4b07-4f52-ba48-c94311dd8481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7b52faa8-467a-4eaf-96f8-97a861904071 tempest-ProjectReaderTests-750734017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d00dd843-4b07-4f52-ba48-c94311dd8481) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65fce7d1-c65d-4dac-8b42-7a43f4850d02', 'volume_name': 'volume-65fce7d1-c65d-4dac-8b42-7a43f4850d02', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7b52faa8-467a-4eaf-96f8-97a861904071 tempest-ProjectReaderTests-750734017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f7e84aa-f156-4279-a1ad-f6d0c239039a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7b52faa8-467a-4eaf-96f8-97a861904071 tempest-ProjectReaderTests-750734017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f7e84aa-f156-4279-a1ad-f6d0c239039a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7b52faa8-467a-4eaf-96f8-97a861904071 tempest-ProjectReaderTests-750734017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8d1b84f-3825-4aaf-978f-815a66a67bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:27 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-7b52faa8-467a-4eaf-96f8-97a861904071 tempest-ProjectReaderTests-750734017 None] Volume 65fce7d1-c65d-4dac-8b42-7a43f4850d02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65fce7d1-c65d-4dac-8b42-7a43f4850d02', 'volume_size': 1} Aug 11 04:58:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7b52faa8-467a-4eaf-96f8-97a861904071 tempest-ProjectReaderTests-750734017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7b52faa8-467a-4eaf-96f8-97a861904071 tempest-ProjectReaderTests-750734017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7b52faa8-467a-4eaf-96f8-97a861904071 tempest-ProjectReaderTests-750734017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-458648220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65fce7d1-c65d-4dac-8b42-7a43f4850d02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74315cc5ab964111aa490d052fcd09fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:58:27Z,use_quota=True,user_id='0fcc67d5a80a4706887e00b9f7c1f946',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:58:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-7b52faa8-467a-4eaf-96f8-97a861904071 tempest-ProjectReaderTests-750734017 None] Creating volume 65fce7d1-c65d-4dac-8b42-7a43f4850d02 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:58:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7b52faa8-467a-4eaf-96f8-97a861904071 tempest-ProjectReaderTests-750734017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7b52faa8-467a-4eaf-96f8-97a861904071 tempest-ProjectReaderTests-750734017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7b52faa8-467a-4eaf-96f8-97a861904071 tempest-ProjectReaderTests-750734017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:58:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7b52faa8-467a-4eaf-96f8-97a861904071 tempest-ProjectReaderTests-750734017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:58:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7b52faa8-467a-4eaf-96f8-97a861904071 tempest-ProjectReaderTests-750734017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7b52faa8-467a-4eaf-96f8-97a861904071 tempest-ProjectReaderTests-750734017 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:58:27 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-7b52faa8-467a-4eaf-96f8-97a861904071 tempest-ProjectReaderTests-750734017 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:58:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7b52faa8-467a-4eaf-96f8-97a861904071 tempest-ProjectReaderTests-750734017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-65fce7d1-c65d-4dac-8b42-7a43f4850d02 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:27 devstack sudo[116109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-65fce7d1-c65d-4dac-8b42-7a43f4850d02 1073741824 Aug 11 04:58:27 devstack sudo[116109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:27 devstack sudo[116108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb Aug 11 04:58:27 devstack sudo[116108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:27 devstack sudo[116108]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-37de0c4c-a17b-4e47-bb7d-ae82fc10bbd2 tempest-ProjectMemberTests-792838276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb" returned: 0 in 0.396s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-37de0c4c-a17b-4e47-bb7d-ae82fc10bbd2 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb.0e9dc421-527d-4385-9b12-6dde35443677 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:27 devstack sudo[116119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb.0e9dc421-527d-4385-9b12-6dde35443677 Aug 11 04:58:27 devstack sudo[116119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:27 devstack sudo[116109]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7b52faa8-467a-4eaf-96f8-97a861904071 tempest-ProjectReaderTests-750734017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-65fce7d1-c65d-4dac-8b42-7a43f4850d02 1073741824" returned: 0 in 0.454s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7b52faa8-467a-4eaf-96f8-97a861904071 tempest-ProjectReaderTests-750734017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-65fce7d1-c65d-4dac-8b42-7a43f4850d02 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:27 devstack sudo[116121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-65fce7d1-c65d-4dac-8b42-7a43f4850d02 Aug 11 04:58:27 devstack sudo[116121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:28 devstack sudo[116119]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-37de0c4c-a17b-4e47-bb7d-ae82fc10bbd2 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb.0e9dc421-527d-4385-9b12-6dde35443677" returned: 0 in 0.354s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-37de0c4c-a17b-4e47-bb7d-ae82fc10bbd2 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb.0e9dc421-527d-4385-9b12-6dde35443677 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:28 devstack sudo[116126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb.0e9dc421-527d-4385-9b12-6dde35443677 Aug 11 04:58:28 devstack sudo[116126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:28 devstack sudo[116121]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7b52faa8-467a-4eaf-96f8-97a861904071 tempest-ProjectReaderTests-750734017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-65fce7d1-c65d-4dac-8b42-7a43f4850d02" returned: 0 in 0.269s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:28 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7b52faa8-467a-4eaf-96f8-97a861904071 tempest-ProjectReaderTests-750734017 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:58:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7b52faa8-467a-4eaf-96f8-97a861904071 tempest-ProjectReaderTests-750734017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7b52faa8-467a-4eaf-96f8-97a861904071 tempest-ProjectReaderTests-750734017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8d1b84f-3825-4aaf-978f-815a66a67bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65fce7d1-c65d-4dac-8b42-7a43f4850d02', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7b52faa8-467a-4eaf-96f8-97a861904071 tempest-ProjectReaderTests-750734017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (686fdd8e-2ea6-4b37-83d2-cb3e89eabe1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:28 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-7b52faa8-467a-4eaf-96f8-97a861904071 tempest-ProjectReaderTests-750734017 None] Volume volume-65fce7d1-c65d-4dac-8b42-7a43f4850d02 (65fce7d1-c65d-4dac-8b42-7a43f4850d02): created successfully Aug 11 04:58:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7b52faa8-467a-4eaf-96f8-97a861904071 tempest-ProjectReaderTests-750734017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (686fdd8e-2ea6-4b37-83d2-cb3e89eabe1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7b52faa8-467a-4eaf-96f8-97a861904071 tempest-ProjectReaderTests-750734017 None] Flow 'volume_create_manager' (691dfeb5-f0bf-4abe-bd4e-0471820bb214) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:58:28 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-7b52faa8-467a-4eaf-96f8-97a861904071 tempest-ProjectReaderTests-750734017 None] Created volume successfully. Aug 11 04:58:28 devstack sudo[116126]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-37de0c4c-a17b-4e47-bb7d-ae82fc10bbd2 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb.0e9dc421-527d-4385-9b12-6dde35443677" returned: 0 in 0.273s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:28 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-37de0c4c-a17b-4e47-bb7d-ae82fc10bbd2 tempest-ProjectMemberTests-792838276 None] Lock "cinder-quobyte-0e9dc421-527d-4385-9b12-6dde35443677" released by "_delete_snapshot" :: held 1.603s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:28 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-37de0c4c-a17b-4e47-bb7d-ae82fc10bbd2 tempest-ProjectMemberTests-792838276 None] Lock "cinder-quobyte-b2dc92fe-86e3-46a0-8cdf-051036843eeb" released by "delete_snapshot" :: held 1.639s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6fbeacdf-1c0c-47fa-b818-e8e4e01522a9 tempest-ProjectReaderTests-692176530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6fbeacdf-1c0c-47fa-b818-e8e4e01522a9 tempest-ProjectReaderTests-692176530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:28 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-6fbeacdf-1c0c-47fa-b818-e8e4e01522a9 tempest-ProjectReaderTests-692176530 None] Creating offline snapshot 22f7c0e9-a34a-4f0f-b9de-12aafbda9e22 of volume 213b2d8a-10a4-430a-a0e4-68efebd4cc24 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 04:58:28 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[298f6987-1272-409c-abb1-03b6e386e8d1]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:58:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6fbeacdf-1c0c-47fa-b818-e8e4e01522a9 tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:28 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-37de0c4c-a17b-4e47-bb7d-ae82fc10bbd2 tempest-ProjectMemberTests-792838276 None] Created reservations ['14741117-1dbb-4881-ad7b-847d799f047b', 'ca04f5aa-49e8-47bf-8191-1c7ce8aaaff3', 'dd2e4291-b2f4-4e6c-bc14-a36cb5443e58', 'b6adebf6-6d16-4176-a47a-a76707a7d324'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:58:28 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-37de0c4c-a17b-4e47-bb7d-ae82fc10bbd2 tempest-ProjectMemberTests-792838276 None] Delete snapshot completed successfully. Aug 11 04:58:28 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-37de0c4c-a17b-4e47-bb7d-ae82fc10bbd2 tempest-ProjectMemberTests-792838276 None] Lock "cinder-0e9dc421-527d-4385-9b12-6dde35443677-delete_snapshot" released by "delete_snapshot" :: held 1.839s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:28 devstack sudo[116130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24 Aug 11 04:58:28 devstack sudo[116130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:28 devstack sudo[116130]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6fbeacdf-1c0c-47fa-b818-e8e4e01522a9 tempest-ProjectReaderTests-692176530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24" returned: 0 in 0.370s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6fbeacdf-1c0c-47fa-b818-e8e4e01522a9 tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24.22f7c0e9-a34a-4f0f-b9de-12aafbda9e22 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:28 devstack sudo[116135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24.22f7c0e9-a34a-4f0f-b9de-12aafbda9e22 1G Aug 11 04:58:28 devstack sudo[116135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:28 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-59d81a19-f720-44f9-ac0e-83efc4bb1775 tempest-ProjectMemberTests-792838276 None] Acquiring lock "cinder-b2dc92fe-86e3-46a0-8cdf-051036843eeb-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:28 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-59d81a19-f720-44f9-ac0e-83efc4bb1775 tempest-ProjectMemberTests-792838276 None] Lock "cinder-b2dc92fe-86e3-46a0-8cdf-051036843eeb-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:28 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-59d81a19-f720-44f9-ac0e-83efc4bb1775 tempest-ProjectMemberTests-792838276 None] Acquiring lock "cinder-quobyte-b2dc92fe-86e3-46a0-8cdf-051036843eeb" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:28 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-59d81a19-f720-44f9-ac0e-83efc4bb1775 tempest-ProjectMemberTests-792838276 None] Lock "cinder-quobyte-b2dc92fe-86e3-46a0-8cdf-051036843eeb" acquired by "delete_volume" :: waited 0.014s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:28 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27c79c9-de46-4804-972d-2e8a7d1e9c4a]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:58:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-59d81a19-f720-44f9-ac0e-83efc4bb1775 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:29 devstack sudo[116137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb Aug 11 04:58:29 devstack sudo[116137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:29 devstack sudo[116135]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6fbeacdf-1c0c-47fa-b818-e8e4e01522a9 tempest-ProjectReaderTests-692176530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24.22f7c0e9-a34a-4f0f-b9de-12aafbda9e22 1G" returned: 0 in 0.469s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6fbeacdf-1c0c-47fa-b818-e8e4e01522a9 tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24.22f7c0e9-a34a-4f0f-b9de-12aafbda9e22 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:29 devstack sudo[116145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24.22f7c0e9-a34a-4f0f-b9de-12aafbda9e22 Aug 11 04:58:29 devstack sudo[116145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:29 devstack sudo[116137]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-59d81a19-f720-44f9-ac0e-83efc4bb1775 tempest-ProjectMemberTests-792838276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb" returned: 0 in 0.393s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-59d81a19-f720-44f9-ac0e-83efc4bb1775 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:29 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6076ee0f-e669-4dc7-9336-7da0da8a52f0 tempest-ProjectReaderTests-750734017 None] Acquiring lock "cinder-65fce7d1-c65d-4dac-8b42-7a43f4850d02-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:29 devstack sudo[116148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb Aug 11 04:58:29 devstack sudo[116148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:29 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6076ee0f-e669-4dc7-9336-7da0da8a52f0 tempest-ProjectReaderTests-750734017 None] Lock "cinder-65fce7d1-c65d-4dac-8b42-7a43f4850d02-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:29 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6076ee0f-e669-4dc7-9336-7da0da8a52f0 tempest-ProjectReaderTests-750734017 None] Acquiring lock "cinder-quobyte-65fce7d1-c65d-4dac-8b42-7a43f4850d02" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:29 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6076ee0f-e669-4dc7-9336-7da0da8a52f0 tempest-ProjectReaderTests-750734017 None] Lock "cinder-quobyte-65fce7d1-c65d-4dac-8b42-7a43f4850d02" acquired by "delete_volume" :: waited 0.016s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:29 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ba6767-9c34-4191-8bfc-932fb741c9ca]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:58:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6076ee0f-e669-4dc7-9336-7da0da8a52f0 tempest-ProjectReaderTests-750734017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-65fce7d1-c65d-4dac-8b42-7a43f4850d02 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:29 devstack sudo[116145]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6fbeacdf-1c0c-47fa-b818-e8e4e01522a9 tempest-ProjectReaderTests-692176530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24.22f7c0e9-a34a-4f0f-b9de-12aafbda9e22" returned: 0 in 0.360s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:29 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-6fbeacdf-1c0c-47fa-b818-e8e4e01522a9 tempest-ProjectReaderTests-692176530 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24.22f7c0e9-a34a-4f0f-b9de-12aafbda9e22 is being set with open permissions: ugo+rw Aug 11 04:58:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6fbeacdf-1c0c-47fa-b818-e8e4e01522a9 tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24.22f7c0e9-a34a-4f0f-b9de-12aafbda9e22 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:29 devstack sudo[116151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-65fce7d1-c65d-4dac-8b42-7a43f4850d02 Aug 11 04:58:29 devstack sudo[116151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:29 devstack sudo[116155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24.22f7c0e9-a34a-4f0f-b9de-12aafbda9e22 Aug 11 04:58:29 devstack sudo[116155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:29 devstack sudo[116148]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-59d81a19-f720-44f9-ac0e-83efc4bb1775 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b2dc92fe-86e3-46a0-8cdf-051036843eeb" returned: 0 in 0.336s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:29 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-59d81a19-f720-44f9-ac0e-83efc4bb1775 tempest-ProjectMemberTests-792838276 None] Lock "cinder-quobyte-b2dc92fe-86e3-46a0-8cdf-051036843eeb" released by "delete_volume" :: held 0.806s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:29 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-59d81a19-f720-44f9-ac0e-83efc4bb1775 tempest-ProjectMemberTests-792838276 None] Created reservations ['433b0306-e9de-465b-bffe-28d7695ab754', 'cb0b098c-d230-480c-9dbc-23cbc61958ba', 'd92e2186-0067-4939-9756-0030afcaedef', '6abfb642-1956-4741-9a94-770bc457e39b'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:58:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-59d81a19-f720-44f9-ac0e-83efc4bb1775 tempest-ProjectMemberTests-792838276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-59d81a19-f720-44f9-ac0e-83efc4bb1775 tempest-ProjectMemberTests-792838276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:29 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-59d81a19-f720-44f9-ac0e-83efc4bb1775 tempest-ProjectMemberTests-792838276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:58:29 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-59d81a19-f720-44f9-ac0e-83efc4bb1775 tempest-ProjectMemberTests-792838276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:58:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-59d81a19-f720-44f9-ac0e-83efc4bb1775 tempest-ProjectMemberTests-792838276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-59d81a19-f720-44f9-ac0e-83efc4bb1775 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:29 devstack sudo[116160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:58:29 devstack sudo[116160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:29 devstack sudo[116155]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6fbeacdf-1c0c-47fa-b818-e8e4e01522a9 tempest-ProjectReaderTests-692176530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24.22f7c0e9-a34a-4f0f-b9de-12aafbda9e22" returned: 0 in 0.293s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:29 devstack sudo[116151]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6076ee0f-e669-4dc7-9336-7da0da8a52f0 tempest-ProjectReaderTests-750734017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-65fce7d1-c65d-4dac-8b42-7a43f4850d02" returned: 0 in 0.411s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6076ee0f-e669-4dc7-9336-7da0da8a52f0 tempest-ProjectReaderTests-750734017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-65fce7d1-c65d-4dac-8b42-7a43f4850d02 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:29 devstack sudo[116164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-65fce7d1-c65d-4dac-8b42-7a43f4850d02 Aug 11 04:58:29 devstack sudo[116164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6fbeacdf-1c0c-47fa-b818-e8e4e01522a9 tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:30 devstack sudo[116166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24.info Aug 11 04:58:30 devstack sudo[116166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:30 devstack sudo[116160]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-59d81a19-f720-44f9-ac0e-83efc4bb1775 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.286s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:30 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-59d81a19-f720-44f9-ac0e-83efc4bb1775 tempest-ProjectMemberTests-792838276 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:58:30 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-59d81a19-f720-44f9-ac0e-83efc4bb1775 tempest-ProjectMemberTests-792838276 None] Deleted volume successfully. Aug 11 04:58:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-59d81a19-f720-44f9-ac0e-83efc4bb1775 tempest-ProjectMemberTests-792838276 None] Lock "cinder-b2dc92fe-86e3-46a0-8cdf-051036843eeb-delete_volume" released by "delete_volume" :: held 1.332s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:30 devstack sudo[116164]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6076ee0f-e669-4dc7-9336-7da0da8a52f0 tempest-ProjectReaderTests-750734017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-65fce7d1-c65d-4dac-8b42-7a43f4850d02" returned: 0 in 0.315s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6076ee0f-e669-4dc7-9336-7da0da8a52f0 tempest-ProjectReaderTests-750734017 None] Lock "cinder-quobyte-65fce7d1-c65d-4dac-8b42-7a43f4850d02" released by "delete_volume" :: held 0.771s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:30 devstack sudo[116166]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6fbeacdf-1c0c-47fa-b818-e8e4e01522a9 tempest-ProjectReaderTests-692176530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24.info" returned: 0 in 0.302s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:30 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-6fbeacdf-1c0c-47fa-b818-e8e4e01522a9 tempest-ProjectReaderTests-692176530 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24.info is being set with open permissions: ugo+rw Aug 11 04:58:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6fbeacdf-1c0c-47fa-b818-e8e4e01522a9 tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:30 devstack sudo[116171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24.info Aug 11 04:58:30 devstack sudo[116171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:30 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-6076ee0f-e669-4dc7-9336-7da0da8a52f0 tempest-ProjectReaderTests-750734017 None] Created reservations ['5d7f97fb-da14-4c2e-8b33-333031889805', 'a0bca0c9-e95b-4ff7-bda4-151da13c5216', 'a05aabd3-e653-43d2-bd50-1179551335ac', '3069fcee-9dff-49f7-b44a-229fd6f64845'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:58:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6076ee0f-e669-4dc7-9336-7da0da8a52f0 tempest-ProjectReaderTests-750734017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6076ee0f-e669-4dc7-9336-7da0da8a52f0 tempest-ProjectReaderTests-750734017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6076ee0f-e669-4dc7-9336-7da0da8a52f0 tempest-ProjectReaderTests-750734017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:58:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6076ee0f-e669-4dc7-9336-7da0da8a52f0 tempest-ProjectReaderTests-750734017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:58:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6076ee0f-e669-4dc7-9336-7da0da8a52f0 tempest-ProjectReaderTests-750734017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6076ee0f-e669-4dc7-9336-7da0da8a52f0 tempest-ProjectReaderTests-750734017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:30 devstack sudo[116173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:58:30 devstack sudo[116173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:30 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd5316b0-0b78-4360-b981-7d096a460ff7 tempest-ProjectMemberTests-792838276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:58:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-dd5316b0-0b78-4360-b981-7d096a460ff7 tempest-ProjectMemberTests-792838276 None] Flow 'volume_create_manager' (e710d275-2e0b-4825-9224-73b5bad3e48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:58:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-dd5316b0-0b78-4360-b981-7d096a460ff7 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92a33b9f-0eb6-409c-8746-443609423ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:30 devstack sudo[116171]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-dd5316b0-0b78-4360-b981-7d096a460ff7 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92a33b9f-0eb6-409c-8746-443609423ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:58:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1811146879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23000e4c-31fd-4abc-8f4e-2e58af47b4ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac225c2b69784eb6b9ec19178ed3af8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:58:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:58:31Z,use_quota=True,user_id='4ce57473867c427a94cf64a00303ce0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-dd5316b0-0b78-4360-b981-7d096a460ff7 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6958d24-957a-4ca3-bda0-da4330aa95d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-dd5316b0-0b78-4360-b981-7d096a460ff7 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6958d24-957a-4ca3-bda0-da4330aa95d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-dd5316b0-0b78-4360-b981-7d096a460ff7 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c507a797-99d6-4f19-8554-d371f03b8974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-dd5316b0-0b78-4360-b981-7d096a460ff7 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c507a797-99d6-4f19-8554-d371f03b8974) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23000e4c-31fd-4abc-8f4e-2e58af47b4ac', 'volume_name': 'volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-dd5316b0-0b78-4360-b981-7d096a460ff7 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c96616b-5f98-4525-8b72-5515a3117986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-dd5316b0-0b78-4360-b981-7d096a460ff7 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c96616b-5f98-4525-8b72-5515a3117986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-dd5316b0-0b78-4360-b981-7d096a460ff7 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2baad6ad-c06b-4d7b-bd67-c1a9ed983f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:30 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-dd5316b0-0b78-4360-b981-7d096a460ff7 tempest-ProjectMemberTests-792838276 None] Volume 23000e4c-31fd-4abc-8f4e-2e58af47b4ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac', 'volume_size': 1} Aug 11 04:58:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-dd5316b0-0b78-4360-b981-7d096a460ff7 tempest-ProjectMemberTests-792838276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6fbeacdf-1c0c-47fa-b818-e8e4e01522a9 tempest-ProjectReaderTests-692176530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24.info" returned: 0 in 0.375s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6fbeacdf-1c0c-47fa-b818-e8e4e01522a9 tempest-ProjectReaderTests-692176530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.279s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-dd5316b0-0b78-4360-b981-7d096a460ff7 tempest-ProjectMemberTests-792838276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.022s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-dd5316b0-0b78-4360-b981-7d096a460ff7 tempest-ProjectMemberTests-792838276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:58:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1811146879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23000e4c-31fd-4abc-8f4e-2e58af47b4ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac225c2b69784eb6b9ec19178ed3af8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:58:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:58:31Z,use_quota=True,user_id='4ce57473867c427a94cf64a00303ce0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:58:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-dd5316b0-0b78-4360-b981-7d096a460ff7 tempest-ProjectMemberTests-792838276 None] Creating volume 23000e4c-31fd-4abc-8f4e-2e58af47b4ac {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:58:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-dd5316b0-0b78-4360-b981-7d096a460ff7 tempest-ProjectMemberTests-792838276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-dd5316b0-0b78-4360-b981-7d096a460ff7 tempest-ProjectMemberTests-792838276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-dd5316b0-0b78-4360-b981-7d096a460ff7 tempest-ProjectMemberTests-792838276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:58:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-dd5316b0-0b78-4360-b981-7d096a460ff7 tempest-ProjectMemberTests-792838276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:58:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-dd5316b0-0b78-4360-b981-7d096a460ff7 tempest-ProjectMemberTests-792838276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-dd5316b0-0b78-4360-b981-7d096a460ff7 tempest-ProjectMemberTests-792838276 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:58:30 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-dd5316b0-0b78-4360-b981-7d096a460ff7 tempest-ProjectMemberTests-792838276 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:58:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-dd5316b0-0b78-4360-b981-7d096a460ff7 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:30 devstack sudo[116176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac 1073741824 Aug 11 04:58:30 devstack sudo[116176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:30 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-6fbeacdf-1c0c-47fa-b818-e8e4e01522a9 tempest-ProjectReaderTests-692176530 None] Create snapshot completed successfully Aug 11 04:58:30 devstack sudo[116173]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6076ee0f-e669-4dc7-9336-7da0da8a52f0 tempest-ProjectReaderTests-750734017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.303s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:30 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-6076ee0f-e669-4dc7-9336-7da0da8a52f0 tempest-ProjectReaderTests-750734017 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:58:30 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-6076ee0f-e669-4dc7-9336-7da0da8a52f0 tempest-ProjectReaderTests-750734017 None] Deleted volume successfully. Aug 11 04:58:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6076ee0f-e669-4dc7-9336-7da0da8a52f0 tempest-ProjectReaderTests-750734017 None] Lock "cinder-65fce7d1-c65d-4dac-8b42-7a43f4850d02-delete_volume" released by "delete_volume" :: held 1.384s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:31 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-897e7cd2-a8a5-425d-9459-37cc85246850 tempest-ProjectReaderTests-750734017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:58:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-897e7cd2-a8a5-425d-9459-37cc85246850 tempest-ProjectReaderTests-750734017 None] Flow 'volume_create_manager' (e6f34ebd-7fac-42f8-9cb8-ecab63a1c93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:58:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-897e7cd2-a8a5-425d-9459-37cc85246850 tempest-ProjectReaderTests-750734017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9d34594-9631-479d-b33a-c23fd790c510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-897e7cd2-a8a5-425d-9459-37cc85246850 tempest-ProjectReaderTests-750734017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9d34594-9631-479d-b33a-c23fd790c510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:58:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1435012773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e80055fb-731d-4c87-ad0c-0e91cd134125,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74315cc5ab964111aa490d052fcd09fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:58:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:58:31Z,use_quota=True,user_id='0fcc67d5a80a4706887e00b9f7c1f946',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-897e7cd2-a8a5-425d-9459-37cc85246850 tempest-ProjectReaderTests-750734017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b20c8c5-8b86-42a7-a310-766a0bd7a4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-897e7cd2-a8a5-425d-9459-37cc85246850 tempest-ProjectReaderTests-750734017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b20c8c5-8b86-42a7-a310-766a0bd7a4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-897e7cd2-a8a5-425d-9459-37cc85246850 tempest-ProjectReaderTests-750734017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5db96242-0f5f-499b-8398-dac98f478496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-897e7cd2-a8a5-425d-9459-37cc85246850 tempest-ProjectReaderTests-750734017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5db96242-0f5f-499b-8398-dac98f478496) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e80055fb-731d-4c87-ad0c-0e91cd134125', 'volume_name': 'volume-e80055fb-731d-4c87-ad0c-0e91cd134125', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-897e7cd2-a8a5-425d-9459-37cc85246850 tempest-ProjectReaderTests-750734017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (337b2086-bd34-4755-b486-a2391cb4c9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:31 devstack sudo[116176]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-897e7cd2-a8a5-425d-9459-37cc85246850 tempest-ProjectReaderTests-750734017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (337b2086-bd34-4755-b486-a2391cb4c9a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-897e7cd2-a8a5-425d-9459-37cc85246850 tempest-ProjectReaderTests-750734017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf6e0cfd-3616-44ac-a228-456f70456346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:31 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-897e7cd2-a8a5-425d-9459-37cc85246850 tempest-ProjectReaderTests-750734017 None] Volume e80055fb-731d-4c87-ad0c-0e91cd134125: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e80055fb-731d-4c87-ad0c-0e91cd134125', 'volume_size': 1} Aug 11 04:58:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-897e7cd2-a8a5-425d-9459-37cc85246850 tempest-ProjectReaderTests-750734017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-dd5316b0-0b78-4360-b981-7d096a460ff7 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac 1073741824" returned: 0 in 0.488s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-dd5316b0-0b78-4360-b981-7d096a460ff7 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:31 devstack sudo[116183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac Aug 11 04:58:31 devstack sudo[116183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:31 devstack sudo[116183]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-dd5316b0-0b78-4360-b981-7d096a460ff7 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac" returned: 0 in 0.244s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:31 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-dd5316b0-0b78-4360-b981-7d096a460ff7 tempest-ProjectMemberTests-792838276 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:58:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-dd5316b0-0b78-4360-b981-7d096a460ff7 tempest-ProjectMemberTests-792838276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-897e7cd2-a8a5-425d-9459-37cc85246850 tempest-ProjectReaderTests-750734017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.284s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:31 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-897e7cd2-a8a5-425d-9459-37cc85246850 tempest-ProjectReaderTests-750734017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:58:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1435012773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e80055fb-731d-4c87-ad0c-0e91cd134125,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74315cc5ab964111aa490d052fcd09fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:58:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:58:31Z,use_quota=True,user_id='0fcc67d5a80a4706887e00b9f7c1f946',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:58:31 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-897e7cd2-a8a5-425d-9459-37cc85246850 tempest-ProjectReaderTests-750734017 None] Creating volume e80055fb-731d-4c87-ad0c-0e91cd134125 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:58:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-897e7cd2-a8a5-425d-9459-37cc85246850 tempest-ProjectReaderTests-750734017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-897e7cd2-a8a5-425d-9459-37cc85246850 tempest-ProjectReaderTests-750734017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:31 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-897e7cd2-a8a5-425d-9459-37cc85246850 tempest-ProjectReaderTests-750734017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:58:31 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-897e7cd2-a8a5-425d-9459-37cc85246850 tempest-ProjectReaderTests-750734017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:58:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-897e7cd2-a8a5-425d-9459-37cc85246850 tempest-ProjectReaderTests-750734017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:31 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-897e7cd2-a8a5-425d-9459-37cc85246850 tempest-ProjectReaderTests-750734017 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:58:31 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-897e7cd2-a8a5-425d-9459-37cc85246850 tempest-ProjectReaderTests-750734017 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:58:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-897e7cd2-a8a5-425d-9459-37cc85246850 tempest-ProjectReaderTests-750734017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e80055fb-731d-4c87-ad0c-0e91cd134125 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:31 devstack sudo[116186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e80055fb-731d-4c87-ad0c-0e91cd134125 1073741824 Aug 11 04:58:31 devstack sudo[116186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-dd5316b0-0b78-4360-b981-7d096a460ff7 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2baad6ad-c06b-4d7b-bd67-c1a9ed983f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-dd5316b0-0b78-4360-b981-7d096a460ff7 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d887de76-e04d-4ace-a5a7-8c53a6579ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:31 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-dd5316b0-0b78-4360-b981-7d096a460ff7 tempest-ProjectMemberTests-792838276 None] Volume volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac (23000e4c-31fd-4abc-8f4e-2e58af47b4ac): created successfully Aug 11 04:58:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-dd5316b0-0b78-4360-b981-7d096a460ff7 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d887de76-e04d-4ace-a5a7-8c53a6579ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-dd5316b0-0b78-4360-b981-7d096a460ff7 tempest-ProjectMemberTests-792838276 None] Flow 'volume_create_manager' (e710d275-2e0b-4825-9224-73b5bad3e48b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:58:31 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-dd5316b0-0b78-4360-b981-7d096a460ff7 tempest-ProjectMemberTests-792838276 None] Created volume successfully. Aug 11 04:58:31 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1b3ed924-39db-43c0-a02f-c064783baf78 tempest-ProjectReaderTests-692176530 None] Acquiring lock "cinder-22f7c0e9-a34a-4f0f-b9de-12aafbda9e22-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:31 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1b3ed924-39db-43c0-a02f-c064783baf78 tempest-ProjectReaderTests-692176530 None] Lock "cinder-22f7c0e9-a34a-4f0f-b9de-12aafbda9e22-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:31 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1b3ed924-39db-43c0-a02f-c064783baf78 tempest-ProjectReaderTests-692176530 None] Acquiring lock "cinder-quobyte-213b2d8a-10a4-430a-a0e4-68efebd4cc24" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:31 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1b3ed924-39db-43c0-a02f-c064783baf78 tempest-ProjectReaderTests-692176530 None] Lock "cinder-quobyte-213b2d8a-10a4-430a-a0e4-68efebd4cc24" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:31 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1b3ed924-39db-43c0-a02f-c064783baf78 tempest-ProjectReaderTests-692176530 None] Acquiring lock "cinder-quobyte-22f7c0e9-a34a-4f0f-b9de-12aafbda9e22" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:31 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1b3ed924-39db-43c0-a02f-c064783baf78 tempest-ProjectReaderTests-692176530 None] Lock "cinder-quobyte-22f7c0e9-a34a-4f0f-b9de-12aafbda9e22" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:31 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-1b3ed924-39db-43c0-a02f-c064783baf78 tempest-ProjectReaderTests-692176530 None] Deleting offline snapshot 22f7c0e9-a34a-4f0f-b9de-12aafbda9e22 of volume 213b2d8a-10a4-430a-a0e4-68efebd4cc24 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 04:58:31 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-1b3ed924-39db-43c0-a02f-c064783baf78 tempest-ProjectReaderTests-692176530 None] snapshot_file for this snap is: volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24.22f7c0e9-a34a-4f0f-b9de-12aafbda9e22 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 04:58:31 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28e8dd6-c02f-43cb-8263-8ba16592f9d4]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:58:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1b3ed924-39db-43c0-a02f-c064783baf78 tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24.22f7c0e9-a34a-4f0f-b9de-12aafbda9e22 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:31 devstack sudo[116189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24.22f7c0e9-a34a-4f0f-b9de-12aafbda9e22 Aug 11 04:58:31 devstack sudo[116189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:31 devstack sudo[116186]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-897e7cd2-a8a5-425d-9459-37cc85246850 tempest-ProjectReaderTests-750734017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e80055fb-731d-4c87-ad0c-0e91cd134125 1073741824" returned: 0 in 0.441s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-897e7cd2-a8a5-425d-9459-37cc85246850 tempest-ProjectReaderTests-750734017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e80055fb-731d-4c87-ad0c-0e91cd134125 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:32 devstack sudo[116194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e80055fb-731d-4c87-ad0c-0e91cd134125 Aug 11 04:58:32 devstack sudo[116194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:32 devstack sudo[116189]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1b3ed924-39db-43c0-a02f-c064783baf78 tempest-ProjectReaderTests-692176530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24.22f7c0e9-a34a-4f0f-b9de-12aafbda9e22" returned: 0 in 0.397s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-1b3ed924-39db-43c0-a02f-c064783baf78 tempest-ProjectReaderTests-692176530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:58:32 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[5affcf64-6542-4f80-a0d5-34a5b72a7a24]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:58:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1b3ed924-39db-43c0-a02f-c064783baf78 tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:32 devstack sudo[116194]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-897e7cd2-a8a5-425d-9459-37cc85246850 tempest-ProjectReaderTests-750734017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e80055fb-731d-4c87-ad0c-0e91cd134125" returned: 0 in 0.265s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-897e7cd2-a8a5-425d-9459-37cc85246850 tempest-ProjectReaderTests-750734017 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:58:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-897e7cd2-a8a5-425d-9459-37cc85246850 tempest-ProjectReaderTests-750734017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:32 devstack sudo[116199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24 Aug 11 04:58:32 devstack sudo[116199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-897e7cd2-a8a5-425d-9459-37cc85246850 tempest-ProjectReaderTests-750734017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf6e0cfd-3616-44ac-a228-456f70456346) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e80055fb-731d-4c87-ad0c-0e91cd134125', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-897e7cd2-a8a5-425d-9459-37cc85246850 tempest-ProjectReaderTests-750734017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03d1eb12-fb7e-46bd-824b-51d8d67220c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:32 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-897e7cd2-a8a5-425d-9459-37cc85246850 tempest-ProjectReaderTests-750734017 None] Volume volume-e80055fb-731d-4c87-ad0c-0e91cd134125 (e80055fb-731d-4c87-ad0c-0e91cd134125): created successfully Aug 11 04:58:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-897e7cd2-a8a5-425d-9459-37cc85246850 tempest-ProjectReaderTests-750734017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03d1eb12-fb7e-46bd-824b-51d8d67220c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-897e7cd2-a8a5-425d-9459-37cc85246850 tempest-ProjectReaderTests-750734017 None] Flow 'volume_create_manager' (e6f34ebd-7fac-42f8-9cb8-ecab63a1c93d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:58:32 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-897e7cd2-a8a5-425d-9459-37cc85246850 tempest-ProjectReaderTests-750734017 None] Created volume successfully. Aug 11 04:58:32 devstack sudo[116199]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1b3ed924-39db-43c0-a02f-c064783baf78 tempest-ProjectReaderTests-692176530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24" returned: 0 in 0.356s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1b3ed924-39db-43c0-a02f-c064783baf78 tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24.22f7c0e9-a34a-4f0f-b9de-12aafbda9e22 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:32 devstack sudo[116205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24.22f7c0e9-a34a-4f0f-b9de-12aafbda9e22 Aug 11 04:58:32 devstack sudo[116205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ddd0d2e6-28de-4e94-ba2c-c0c7145c971e tempest-ProjectMemberTests-792838276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ddd0d2e6-28de-4e94-ba2c-c0c7145c971e tempest-ProjectMemberTests-792838276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-ddd0d2e6-28de-4e94-ba2c-c0c7145c971e tempest-ProjectMemberTests-792838276 None] Creating offline snapshot 876dd902-4fb0-4f84-9c7d-7747e99bd321 of volume 23000e4c-31fd-4abc-8f4e-2e58af47b4ac {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 04:58:32 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[776e9551-36c6-4b2c-a548-86d33e2bf1b7]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:58:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ddd0d2e6-28de-4e94-ba2c-c0c7145c971e tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:32 devstack sudo[116205]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1b3ed924-39db-43c0-a02f-c064783baf78 tempest-ProjectReaderTests-692176530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24.22f7c0e9-a34a-4f0f-b9de-12aafbda9e22" returned: 0 in 0.365s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1b3ed924-39db-43c0-a02f-c064783baf78 tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24.22f7c0e9-a34a-4f0f-b9de-12aafbda9e22 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:32 devstack sudo[116212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24.22f7c0e9-a34a-4f0f-b9de-12aafbda9e22 Aug 11 04:58:32 devstack sudo[116212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:32 devstack sudo[116211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac Aug 11 04:58:32 devstack sudo[116211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:33 devstack sudo[116212]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1b3ed924-39db-43c0-a02f-c064783baf78 tempest-ProjectReaderTests-692176530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24.22f7c0e9-a34a-4f0f-b9de-12aafbda9e22" returned: 0 in 0.264s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1b3ed924-39db-43c0-a02f-c064783baf78 tempest-ProjectReaderTests-692176530 None] Lock "cinder-quobyte-22f7c0e9-a34a-4f0f-b9de-12aafbda9e22" released by "_delete_snapshot" :: held 1.490s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1b3ed924-39db-43c0-a02f-c064783baf78 tempest-ProjectReaderTests-692176530 None] Lock "cinder-quobyte-213b2d8a-10a4-430a-a0e4-68efebd4cc24" released by "delete_snapshot" :: held 1.516s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:33 devstack sudo[116211]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ddd0d2e6-28de-4e94-ba2c-c0c7145c971e tempest-ProjectMemberTests-792838276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac" returned: 0 in 0.383s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ddd0d2e6-28de-4e94-ba2c-c0c7145c971e tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac.876dd902-4fb0-4f84-9c7d-7747e99bd321 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:33 devstack sudo[116220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac.876dd902-4fb0-4f84-9c7d-7747e99bd321 1G Aug 11 04:58:33 devstack sudo[116220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a0e60fb3-9662-4820-b7f2-b4b2a5af46d4 tempest-ProjectReaderTests-750734017 None] Acquiring lock "cinder-e80055fb-731d-4c87-ad0c-0e91cd134125-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a0e60fb3-9662-4820-b7f2-b4b2a5af46d4 tempest-ProjectReaderTests-750734017 None] Lock "cinder-e80055fb-731d-4c87-ad0c-0e91cd134125-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:33 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-1b3ed924-39db-43c0-a02f-c064783baf78 tempest-ProjectReaderTests-692176530 None] Created reservations ['60fe2e70-e3a9-4b9f-9911-ea103eeb23c7', '19385790-d592-4ca0-a791-8fd9da5773a8', '88cbe12b-7ee3-4dff-ae17-e9ccad65f487', 'a9f2d054-bb26-4916-9b80-601b6ed09f88'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:58:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a0e60fb3-9662-4820-b7f2-b4b2a5af46d4 tempest-ProjectReaderTests-750734017 None] Acquiring lock "cinder-quobyte-e80055fb-731d-4c87-ad0c-0e91cd134125" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a0e60fb3-9662-4820-b7f2-b4b2a5af46d4 tempest-ProjectReaderTests-750734017 None] Lock "cinder-quobyte-e80055fb-731d-4c87-ad0c-0e91cd134125" acquired by "delete_volume" :: waited 0.026s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:33 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-1b3ed924-39db-43c0-a02f-c064783baf78 tempest-ProjectReaderTests-692176530 None] Delete snapshot completed successfully. Aug 11 04:58:33 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[89bb7398-9326-4aaf-b8f2-7730647146f4]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:58:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a0e60fb3-9662-4820-b7f2-b4b2a5af46d4 tempest-ProjectReaderTests-750734017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e80055fb-731d-4c87-ad0c-0e91cd134125 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1b3ed924-39db-43c0-a02f-c064783baf78 tempest-ProjectReaderTests-692176530 None] Lock "cinder-22f7c0e9-a34a-4f0f-b9de-12aafbda9e22-delete_snapshot" released by "delete_snapshot" :: held 1.758s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:33 devstack sudo[116222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e80055fb-731d-4c87-ad0c-0e91cd134125 Aug 11 04:58:33 devstack sudo[116222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:33 devstack sudo[116220]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ddd0d2e6-28de-4e94-ba2c-c0c7145c971e tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac.876dd902-4fb0-4f84-9c7d-7747e99bd321 1G" returned: 0 in 0.434s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ddd0d2e6-28de-4e94-ba2c-c0c7145c971e tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac.876dd902-4fb0-4f84-9c7d-7747e99bd321 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:33 devstack sudo[116229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac.876dd902-4fb0-4f84-9c7d-7747e99bd321 Aug 11 04:58:33 devstack sudo[116229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:33 devstack sudo[116222]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a0e60fb3-9662-4820-b7f2-b4b2a5af46d4 tempest-ProjectReaderTests-750734017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e80055fb-731d-4c87-ad0c-0e91cd134125" returned: 0 in 0.393s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a0e60fb3-9662-4820-b7f2-b4b2a5af46d4 tempest-ProjectReaderTests-750734017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e80055fb-731d-4c87-ad0c-0e91cd134125 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-90150f40-5a7f-4eba-956d-09268c54c58d tempest-ProjectReaderTests-692176530 None] Acquiring lock "cinder-213b2d8a-10a4-430a-a0e4-68efebd4cc24-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:33 devstack sudo[116235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e80055fb-731d-4c87-ad0c-0e91cd134125 Aug 11 04:58:33 devstack sudo[116235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-90150f40-5a7f-4eba-956d-09268c54c58d tempest-ProjectReaderTests-692176530 None] Lock "cinder-213b2d8a-10a4-430a-a0e4-68efebd4cc24-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-90150f40-5a7f-4eba-956d-09268c54c58d tempest-ProjectReaderTests-692176530 None] Acquiring lock "cinder-quobyte-213b2d8a-10a4-430a-a0e4-68efebd4cc24" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-90150f40-5a7f-4eba-956d-09268c54c58d tempest-ProjectReaderTests-692176530 None] Lock "cinder-quobyte-213b2d8a-10a4-430a-a0e4-68efebd4cc24" acquired by "delete_volume" :: waited 0.013s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:33 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b3d28f-080f-4cbf-9962-39c98ba2d6a4]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:58:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-90150f40-5a7f-4eba-956d-09268c54c58d tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:33 devstack sudo[116229]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ddd0d2e6-28de-4e94-ba2c-c0c7145c971e tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac.876dd902-4fb0-4f84-9c7d-7747e99bd321" returned: 0 in 0.326s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:33 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-ddd0d2e6-28de-4e94-ba2c-c0c7145c971e tempest-ProjectMemberTests-792838276 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac.876dd902-4fb0-4f84-9c7d-7747e99bd321 is being set with open permissions: ugo+rw Aug 11 04:58:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ddd0d2e6-28de-4e94-ba2c-c0c7145c971e tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac.876dd902-4fb0-4f84-9c7d-7747e99bd321 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:34 devstack sudo[116241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac.876dd902-4fb0-4f84-9c7d-7747e99bd321 Aug 11 04:58:34 devstack sudo[116241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:34 devstack sudo[116240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24 Aug 11 04:58:34 devstack sudo[116240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:34 devstack sudo[116235]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a0e60fb3-9662-4820-b7f2-b4b2a5af46d4 tempest-ProjectReaderTests-750734017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-e80055fb-731d-4c87-ad0c-0e91cd134125" returned: 0 in 0.310s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:34 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a0e60fb3-9662-4820-b7f2-b4b2a5af46d4 tempest-ProjectReaderTests-750734017 None] Lock "cinder-quobyte-e80055fb-731d-4c87-ad0c-0e91cd134125" released by "delete_volume" :: held 0.747s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:34 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-a0e60fb3-9662-4820-b7f2-b4b2a5af46d4 tempest-ProjectReaderTests-750734017 None] Created reservations ['344b981b-c322-45a4-b088-863822b36a03', 'fd45d4af-9ab5-4e29-a05c-11a59f7a2ccd', 'c4e465ec-4a34-4a81-be82-5508f02a330f', 'b92d7dfb-580d-4554-94b9-ef44a0889ab2'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:58:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a0e60fb3-9662-4820-b7f2-b4b2a5af46d4 tempest-ProjectReaderTests-750734017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a0e60fb3-9662-4820-b7f2-b4b2a5af46d4 tempest-ProjectReaderTests-750734017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a0e60fb3-9662-4820-b7f2-b4b2a5af46d4 tempest-ProjectReaderTests-750734017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:58:34 devstack sudo[116241]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a0e60fb3-9662-4820-b7f2-b4b2a5af46d4 tempest-ProjectReaderTests-750734017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:58:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a0e60fb3-9662-4820-b7f2-b4b2a5af46d4 tempest-ProjectReaderTests-750734017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a0e60fb3-9662-4820-b7f2-b4b2a5af46d4 tempest-ProjectReaderTests-750734017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ddd0d2e6-28de-4e94-ba2c-c0c7145c971e tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac.876dd902-4fb0-4f84-9c7d-7747e99bd321" returned: 0 in 0.278s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:34 devstack sudo[116247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:58:34 devstack sudo[116247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ddd0d2e6-28de-4e94-ba2c-c0c7145c971e tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:34 devstack sudo[116251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac.info Aug 11 04:58:34 devstack sudo[116251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:34 devstack sudo[116240]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-90150f40-5a7f-4eba-956d-09268c54c58d tempest-ProjectReaderTests-692176530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24" returned: 0 in 0.388s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-90150f40-5a7f-4eba-956d-09268c54c58d tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:34 devstack sudo[116253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24 Aug 11 04:58:34 devstack sudo[116253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:34 devstack sudo[116247]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a0e60fb3-9662-4820-b7f2-b4b2a5af46d4 tempest-ProjectReaderTests-750734017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.291s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:34 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-a0e60fb3-9662-4820-b7f2-b4b2a5af46d4 tempest-ProjectReaderTests-750734017 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:58:34 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-a0e60fb3-9662-4820-b7f2-b4b2a5af46d4 tempest-ProjectReaderTests-750734017 None] Deleted volume successfully. Aug 11 04:58:34 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a0e60fb3-9662-4820-b7f2-b4b2a5af46d4 tempest-ProjectReaderTests-750734017 None] Lock "cinder-e80055fb-731d-4c87-ad0c-0e91cd134125-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:34 devstack sudo[116251]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ddd0d2e6-28de-4e94-ba2c-c0c7145c971e tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac.info" returned: 0 in 0.298s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:34 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-ddd0d2e6-28de-4e94-ba2c-c0c7145c971e tempest-ProjectMemberTests-792838276 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac.info is being set with open permissions: ugo+rw Aug 11 04:58:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ddd0d2e6-28de-4e94-ba2c-c0c7145c971e tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:34 devstack sudo[116258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac.info Aug 11 04:58:34 devstack sudo[116258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:34 devstack sudo[116253]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-90150f40-5a7f-4eba-956d-09268c54c58d tempest-ProjectReaderTests-692176530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-213b2d8a-10a4-430a-a0e4-68efebd4cc24" returned: 0 in 0.321s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:34 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-90150f40-5a7f-4eba-956d-09268c54c58d tempest-ProjectReaderTests-692176530 None] Lock "cinder-quobyte-213b2d8a-10a4-430a-a0e4-68efebd4cc24" released by "delete_volume" :: held 0.773s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:34 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-90150f40-5a7f-4eba-956d-09268c54c58d tempest-ProjectReaderTests-692176530 None] Created reservations ['12faf83c-9613-4589-aa1d-6b16eaa9fdd5', '43b69410-65d5-427f-b4f1-14442487aafa', '964c473c-1520-438a-8eca-a2eeec857a94', '3aa1857c-5cf8-407f-b983-773a7fcc730d'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:58:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-90150f40-5a7f-4eba-956d-09268c54c58d tempest-ProjectReaderTests-692176530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-90150f40-5a7f-4eba-956d-09268c54c58d tempest-ProjectReaderTests-692176530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-90150f40-5a7f-4eba-956d-09268c54c58d tempest-ProjectReaderTests-692176530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:58:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-90150f40-5a7f-4eba-956d-09268c54c58d tempest-ProjectReaderTests-692176530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:58:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-90150f40-5a7f-4eba-956d-09268c54c58d tempest-ProjectReaderTests-692176530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-90150f40-5a7f-4eba-956d-09268c54c58d tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:34 devstack sudo[116261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:58:34 devstack sudo[116261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:34 devstack sudo[116258]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ddd0d2e6-28de-4e94-ba2c-c0c7145c971e tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac.info" returned: 0 in 0.294s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ddd0d2e6-28de-4e94-ba2c-c0c7145c971e tempest-ProjectMemberTests-792838276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.112s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:34 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-ddd0d2e6-28de-4e94-ba2c-c0c7145c971e tempest-ProjectMemberTests-792838276 None] Create snapshot completed successfully Aug 11 04:58:35 devstack sudo[116261]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-90150f40-5a7f-4eba-956d-09268c54c58d tempest-ProjectReaderTests-692176530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.290s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:35 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-90150f40-5a7f-4eba-956d-09268c54c58d tempest-ProjectReaderTests-692176530 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:58:35 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-90150f40-5a7f-4eba-956d-09268c54c58d tempest-ProjectReaderTests-692176530 None] Deleted volume successfully. Aug 11 04:58:35 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-90150f40-5a7f-4eba-956d-09268c54c58d tempest-ProjectReaderTests-692176530 None] Lock "cinder-213b2d8a-10a4-430a-a0e4-68efebd4cc24-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:35 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ddfb51b-8de7-4370-9f98-82f6b5cee1c3 tempest-ProjectReaderTests-692176530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:58:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0ddfb51b-8de7-4370-9f98-82f6b5cee1c3 tempest-ProjectReaderTests-692176530 None] Flow 'volume_create_manager' (23ec6731-f306-4f14-aae4-0ceb00c52e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:58:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0ddfb51b-8de7-4370-9f98-82f6b5cee1c3 tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa29154d-a711-4d98-90db-3d430b761e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0ddfb51b-8de7-4370-9f98-82f6b5cee1c3 tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa29154d-a711-4d98-90db-3d430b761e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:58:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-724528588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6926d55-3e68-471b-bfeb-b0dbfebc2a90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95563f14c47841708c0521bda11769a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:58:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:58:35Z,use_quota=True,user_id='f7bf5308d1fc4270957690c1005f4a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0ddfb51b-8de7-4370-9f98-82f6b5cee1c3 tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0198914e-667a-4c0b-bb30-92cbeea3de9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0ddfb51b-8de7-4370-9f98-82f6b5cee1c3 tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0198914e-667a-4c0b-bb30-92cbeea3de9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0ddfb51b-8de7-4370-9f98-82f6b5cee1c3 tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e82e423-ea42-4e38-815f-abd60a520c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0ddfb51b-8de7-4370-9f98-82f6b5cee1c3 tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e82e423-ea42-4e38-815f-abd60a520c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6926d55-3e68-471b-bfeb-b0dbfebc2a90', 'volume_name': 'volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0ddfb51b-8de7-4370-9f98-82f6b5cee1c3 tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9b15ff5-96a0-47ed-9b69-aa5a7d0b24d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0ddfb51b-8de7-4370-9f98-82f6b5cee1c3 tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9b15ff5-96a0-47ed-9b69-aa5a7d0b24d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0ddfb51b-8de7-4370-9f98-82f6b5cee1c3 tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bae2fed9-3e5c-4e9b-b315-991915c96cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:35 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-0ddfb51b-8de7-4370-9f98-82f6b5cee1c3 tempest-ProjectReaderTests-692176530 None] Volume c6926d55-3e68-471b-bfeb-b0dbfebc2a90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90', 'volume_size': 1} Aug 11 04:58:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0ddfb51b-8de7-4370-9f98-82f6b5cee1c3 tempest-ProjectReaderTests-692176530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0ddfb51b-8de7-4370-9f98-82f6b5cee1c3 tempest-ProjectReaderTests-692176530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:35 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0ddfb51b-8de7-4370-9f98-82f6b5cee1c3 tempest-ProjectReaderTests-692176530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:58:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-724528588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6926d55-3e68-471b-bfeb-b0dbfebc2a90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95563f14c47841708c0521bda11769a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:58:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:58:35Z,use_quota=True,user_id='f7bf5308d1fc4270957690c1005f4a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:58:35 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-0ddfb51b-8de7-4370-9f98-82f6b5cee1c3 tempest-ProjectReaderTests-692176530 None] Creating volume c6926d55-3e68-471b-bfeb-b0dbfebc2a90 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:58:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0ddfb51b-8de7-4370-9f98-82f6b5cee1c3 tempest-ProjectReaderTests-692176530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0ddfb51b-8de7-4370-9f98-82f6b5cee1c3 tempest-ProjectReaderTests-692176530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:35 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0ddfb51b-8de7-4370-9f98-82f6b5cee1c3 tempest-ProjectReaderTests-692176530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:58:35 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0ddfb51b-8de7-4370-9f98-82f6b5cee1c3 tempest-ProjectReaderTests-692176530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:58:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0ddfb51b-8de7-4370-9f98-82f6b5cee1c3 tempest-ProjectReaderTests-692176530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:35 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0ddfb51b-8de7-4370-9f98-82f6b5cee1c3 tempest-ProjectReaderTests-692176530 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:58:35 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-0ddfb51b-8de7-4370-9f98-82f6b5cee1c3 tempest-ProjectReaderTests-692176530 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:58:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0ddfb51b-8de7-4370-9f98-82f6b5cee1c3 tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:35 devstack sudo[116264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90 1073741824 Aug 11 04:58:35 devstack sudo[116264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:35 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0d0cb3e0-3d68-449c-9609-5ff376a2190e tempest-ProjectMemberTests-792838276 None] Acquiring lock "cinder-876dd902-4fb0-4f84-9c7d-7747e99bd321-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:36 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0d0cb3e0-3d68-449c-9609-5ff376a2190e tempest-ProjectMemberTests-792838276 None] Lock "cinder-876dd902-4fb0-4f84-9c7d-7747e99bd321-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:36 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0d0cb3e0-3d68-449c-9609-5ff376a2190e tempest-ProjectMemberTests-792838276 None] Acquiring lock "cinder-quobyte-23000e4c-31fd-4abc-8f4e-2e58af47b4ac" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:36 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0d0cb3e0-3d68-449c-9609-5ff376a2190e tempest-ProjectMemberTests-792838276 None] Lock "cinder-quobyte-23000e4c-31fd-4abc-8f4e-2e58af47b4ac" acquired by "delete_snapshot" :: waited 0.028s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:36 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0d0cb3e0-3d68-449c-9609-5ff376a2190e tempest-ProjectMemberTests-792838276 None] Acquiring lock "cinder-quobyte-876dd902-4fb0-4f84-9c7d-7747e99bd321" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:36 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0d0cb3e0-3d68-449c-9609-5ff376a2190e tempest-ProjectMemberTests-792838276 None] Lock "cinder-quobyte-876dd902-4fb0-4f84-9c7d-7747e99bd321" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:36 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-0d0cb3e0-3d68-449c-9609-5ff376a2190e tempest-ProjectMemberTests-792838276 None] Deleting offline snapshot 876dd902-4fb0-4f84-9c7d-7747e99bd321 of volume 23000e4c-31fd-4abc-8f4e-2e58af47b4ac {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 04:58:36 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-0d0cb3e0-3d68-449c-9609-5ff376a2190e tempest-ProjectMemberTests-792838276 None] snapshot_file for this snap is: volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac.876dd902-4fb0-4f84-9c7d-7747e99bd321 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 04:58:36 devstack sudo[116264]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:36 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b0a48a-d4f0-4c17-b1fd-0e5576ee3d26]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:58:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0d0cb3e0-3d68-449c-9609-5ff376a2190e tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac.876dd902-4fb0-4f84-9c7d-7747e99bd321 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0ddfb51b-8de7-4370-9f98-82f6b5cee1c3 tempest-ProjectReaderTests-692176530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90 1073741824" returned: 0 in 0.565s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0ddfb51b-8de7-4370-9f98-82f6b5cee1c3 tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:36 devstack sudo[116272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90 Aug 11 04:58:36 devstack sudo[116272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:36 devstack sudo[116271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac.876dd902-4fb0-4f84-9c7d-7747e99bd321 Aug 11 04:58:36 devstack sudo[116271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:36 devstack sudo[116272]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0ddfb51b-8de7-4370-9f98-82f6b5cee1c3 tempest-ProjectReaderTests-692176530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90" returned: 0 in 0.268s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:36 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0ddfb51b-8de7-4370-9f98-82f6b5cee1c3 tempest-ProjectReaderTests-692176530 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:58:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0ddfb51b-8de7-4370-9f98-82f6b5cee1c3 tempest-ProjectReaderTests-692176530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:36 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0ddfb51b-8de7-4370-9f98-82f6b5cee1c3 tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bae2fed9-3e5c-4e9b-b315-991915c96cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:36 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0ddfb51b-8de7-4370-9f98-82f6b5cee1c3 tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e64a5d0c-c60f-4125-b8ca-d35237f6ccbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:36 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-0ddfb51b-8de7-4370-9f98-82f6b5cee1c3 tempest-ProjectReaderTests-692176530 None] Volume volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90 (c6926d55-3e68-471b-bfeb-b0dbfebc2a90): created successfully Aug 11 04:58:36 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0ddfb51b-8de7-4370-9f98-82f6b5cee1c3 tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e64a5d0c-c60f-4125-b8ca-d35237f6ccbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:36 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0ddfb51b-8de7-4370-9f98-82f6b5cee1c3 tempest-ProjectReaderTests-692176530 None] Flow 'volume_create_manager' (23ec6731-f306-4f14-aae4-0ceb00c52e15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:58:36 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-0ddfb51b-8de7-4370-9f98-82f6b5cee1c3 tempest-ProjectReaderTests-692176530 None] Created volume successfully. Aug 11 04:58:36 devstack sudo[116271]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0d0cb3e0-3d68-449c-9609-5ff376a2190e tempest-ProjectMemberTests-792838276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac.876dd902-4fb0-4f84-9c7d-7747e99bd321" returned: 0 in 0.405s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:36 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-0d0cb3e0-3d68-449c-9609-5ff376a2190e tempest-ProjectMemberTests-792838276 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:58:36 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ed755a-703a-48b5-997e-db9c46cb43f1]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:58:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0d0cb3e0-3d68-449c-9609-5ff376a2190e tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:36 devstack sudo[116279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac Aug 11 04:58:36 devstack sudo[116279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:36 devstack sudo[116279]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0d0cb3e0-3d68-449c-9609-5ff376a2190e tempest-ProjectMemberTests-792838276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac" returned: 0 in 0.352s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0d0cb3e0-3d68-449c-9609-5ff376a2190e tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac.876dd902-4fb0-4f84-9c7d-7747e99bd321 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:36 devstack sudo[116284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac.876dd902-4fb0-4f84-9c7d-7747e99bd321 Aug 11 04:58:36 devstack sudo[116284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:37 devstack sudo[116284]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0d0cb3e0-3d68-449c-9609-5ff376a2190e tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac.876dd902-4fb0-4f84-9c7d-7747e99bd321" returned: 0 in 0.326s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0d0cb3e0-3d68-449c-9609-5ff376a2190e tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac.876dd902-4fb0-4f84-9c7d-7747e99bd321 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:37 devstack sudo[116290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac.876dd902-4fb0-4f84-9c7d-7747e99bd321 Aug 11 04:58:37 devstack sudo[116290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:37 devstack sudo[116290]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0d0cb3e0-3d68-449c-9609-5ff376a2190e tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac.876dd902-4fb0-4f84-9c7d-7747e99bd321" returned: 0 in 0.244s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0d0cb3e0-3d68-449c-9609-5ff376a2190e tempest-ProjectMemberTests-792838276 None] Lock "cinder-quobyte-876dd902-4fb0-4f84-9c7d-7747e99bd321" released by "_delete_snapshot" :: held 1.428s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0d0cb3e0-3d68-449c-9609-5ff376a2190e tempest-ProjectMemberTests-792838276 None] Lock "cinder-quobyte-23000e4c-31fd-4abc-8f4e-2e58af47b4ac" released by "delete_snapshot" :: held 1.455s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:37 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-0d0cb3e0-3d68-449c-9609-5ff376a2190e tempest-ProjectMemberTests-792838276 None] Created reservations ['32dc602d-3be5-4af4-a46d-3b9f5c320df6', 'c3cfa0a2-e4f2-498a-8970-6903607bb65a', 'f6a5a0b5-47c6-4531-ad39-6eb1a00c4ca6', '07914128-433d-43b5-922f-27f0ef4e4f96'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:58:37 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-0d0cb3e0-3d68-449c-9609-5ff376a2190e tempest-ProjectMemberTests-792838276 None] Delete snapshot completed successfully. Aug 11 04:58:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0d0cb3e0-3d68-449c-9609-5ff376a2190e tempest-ProjectMemberTests-792838276 None] Lock "cinder-876dd902-4fb0-4f84-9c7d-7747e99bd321-delete_snapshot" released by "delete_snapshot" :: held 1.613s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5a055dbb-b011-47f3-89be-aa12b001b0ef tempest-ProjectReaderTests-692176530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5a055dbb-b011-47f3-89be-aa12b001b0ef tempest-ProjectReaderTests-692176530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:37 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-5a055dbb-b011-47f3-89be-aa12b001b0ef tempest-ProjectReaderTests-692176530 None] Creating offline snapshot 34e328f5-d309-43e6-9a1a-43576ce8a165 of volume c6926d55-3e68-471b-bfeb-b0dbfebc2a90 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 04:58:37 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea6e6cf-d4c3-4ce5-8728-91992b17519e]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:58:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5a055dbb-b011-47f3-89be-aa12b001b0ef tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:37 devstack sudo[116293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90 Aug 11 04:58:37 devstack sudo[116293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:38 devstack sudo[116293]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5a055dbb-b011-47f3-89be-aa12b001b0ef tempest-ProjectReaderTests-692176530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90" returned: 0 in 0.353s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5a055dbb-b011-47f3-89be-aa12b001b0ef tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90.34e328f5-d309-43e6-9a1a-43576ce8a165 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:38 devstack sudo[116299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90.34e328f5-d309-43e6-9a1a-43576ce8a165 1G Aug 11 04:58:38 devstack sudo[116299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:38 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4debb6a5-c3c0-4da9-8972-bf35e52eab4f tempest-ProjectMemberTests-792838276 None] Acquiring lock "cinder-23000e4c-31fd-4abc-8f4e-2e58af47b4ac-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:38 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4debb6a5-c3c0-4da9-8972-bf35e52eab4f tempest-ProjectMemberTests-792838276 None] Lock "cinder-23000e4c-31fd-4abc-8f4e-2e58af47b4ac-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:38 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4debb6a5-c3c0-4da9-8972-bf35e52eab4f tempest-ProjectMemberTests-792838276 None] Acquiring lock "cinder-quobyte-23000e4c-31fd-4abc-8f4e-2e58af47b4ac" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:38 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4debb6a5-c3c0-4da9-8972-bf35e52eab4f tempest-ProjectMemberTests-792838276 None] Lock "cinder-quobyte-23000e4c-31fd-4abc-8f4e-2e58af47b4ac" acquired by "delete_volume" :: waited 0.025s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:38 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa58b2b8-788a-44ed-9f69-ed127df9d440]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:58:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4debb6a5-c3c0-4da9-8972-bf35e52eab4f tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:38 devstack sudo[116301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac Aug 11 04:58:38 devstack sudo[116301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:38 devstack sudo[116299]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5a055dbb-b011-47f3-89be-aa12b001b0ef tempest-ProjectReaderTests-692176530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90.34e328f5-d309-43e6-9a1a-43576ce8a165 1G" returned: 0 in 0.398s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5a055dbb-b011-47f3-89be-aa12b001b0ef tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90.34e328f5-d309-43e6-9a1a-43576ce8a165 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:38 devstack sudo[116307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90.34e328f5-d309-43e6-9a1a-43576ce8a165 Aug 11 04:58:38 devstack sudo[116307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:38 devstack sudo[116301]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4debb6a5-c3c0-4da9-8972-bf35e52eab4f tempest-ProjectMemberTests-792838276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac" returned: 0 in 0.370s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4debb6a5-c3c0-4da9-8972-bf35e52eab4f tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:38 devstack sudo[116312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac Aug 11 04:58:38 devstack sudo[116312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:38 devstack sudo[116307]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5a055dbb-b011-47f3-89be-aa12b001b0ef tempest-ProjectReaderTests-692176530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90.34e328f5-d309-43e6-9a1a-43576ce8a165" returned: 0 in 0.308s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:38 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-5a055dbb-b011-47f3-89be-aa12b001b0ef tempest-ProjectReaderTests-692176530 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90.34e328f5-d309-43e6-9a1a-43576ce8a165 is being set with open permissions: ugo+rw Aug 11 04:58:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5a055dbb-b011-47f3-89be-aa12b001b0ef tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90.34e328f5-d309-43e6-9a1a-43576ce8a165 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:38 devstack sudo[116317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90.34e328f5-d309-43e6-9a1a-43576ce8a165 Aug 11 04:58:38 devstack sudo[116317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:38 devstack sudo[116312]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4debb6a5-c3c0-4da9-8972-bf35e52eab4f tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-23000e4c-31fd-4abc-8f4e-2e58af47b4ac" returned: 0 in 0.257s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:38 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4debb6a5-c3c0-4da9-8972-bf35e52eab4f tempest-ProjectMemberTests-792838276 None] Lock "cinder-quobyte-23000e4c-31fd-4abc-8f4e-2e58af47b4ac" released by "delete_volume" :: held 0.685s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:38 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-4debb6a5-c3c0-4da9-8972-bf35e52eab4f tempest-ProjectMemberTests-792838276 None] Created reservations ['ccfe6df7-f635-4b56-986d-7b59d4dd606d', 'a0822091-9f78-4a09-a88b-0221f5d83de2', '9348a2da-fecc-40cb-bdd4-07c79097963b', '5d7f3b43-4b8a-4fb1-84e7-b3a3f712f55b'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:58:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4debb6a5-c3c0-4da9-8972-bf35e52eab4f tempest-ProjectMemberTests-792838276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4debb6a5-c3c0-4da9-8972-bf35e52eab4f tempest-ProjectMemberTests-792838276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4debb6a5-c3c0-4da9-8972-bf35e52eab4f tempest-ProjectMemberTests-792838276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:58:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4debb6a5-c3c0-4da9-8972-bf35e52eab4f tempest-ProjectMemberTests-792838276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:58:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4debb6a5-c3c0-4da9-8972-bf35e52eab4f tempest-ProjectMemberTests-792838276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4debb6a5-c3c0-4da9-8972-bf35e52eab4f tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:39 devstack sudo[116317]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5a055dbb-b011-47f3-89be-aa12b001b0ef tempest-ProjectReaderTests-692176530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90.34e328f5-d309-43e6-9a1a-43576ce8a165" returned: 0 in 0.260s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:39 devstack sudo[116321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:58:39 devstack sudo[116321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5a055dbb-b011-47f3-89be-aa12b001b0ef tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:39 devstack sudo[116323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90.info Aug 11 04:58:39 devstack sudo[116323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:39 devstack sudo[116321]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4debb6a5-c3c0-4da9-8972-bf35e52eab4f tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.264s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:39 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-4debb6a5-c3c0-4da9-8972-bf35e52eab4f tempest-ProjectMemberTests-792838276 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:58:39 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-4debb6a5-c3c0-4da9-8972-bf35e52eab4f tempest-ProjectMemberTests-792838276 None] Deleted volume successfully. Aug 11 04:58:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4debb6a5-c3c0-4da9-8972-bf35e52eab4f tempest-ProjectMemberTests-792838276 None] Lock "cinder-23000e4c-31fd-4abc-8f4e-2e58af47b4ac-delete_volume" released by "delete_volume" :: held 1.164s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:39 devstack sudo[116323]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5a055dbb-b011-47f3-89be-aa12b001b0ef tempest-ProjectReaderTests-692176530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90.info" returned: 0 in 0.273s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:39 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-5a055dbb-b011-47f3-89be-aa12b001b0ef tempest-ProjectReaderTests-692176530 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90.info is being set with open permissions: ugo+rw Aug 11 04:58:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5a055dbb-b011-47f3-89be-aa12b001b0ef tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:39 devstack sudo[116327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90.info Aug 11 04:58:39 devstack sudo[116327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:39 devstack sudo[116327]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5a055dbb-b011-47f3-89be-aa12b001b0ef tempest-ProjectReaderTests-692176530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90.info" returned: 0 in 0.266s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5a055dbb-b011-47f3-89be-aa12b001b0ef tempest-ProjectReaderTests-692176530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.938s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:39 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-5a055dbb-b011-47f3-89be-aa12b001b0ef tempest-ProjectReaderTests-692176530 None] Create snapshot completed successfully Aug 11 04:58:39 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-8057a112-acbc-45f2-b0cb-6e871a3727a2 tempest-ProjectMemberTests-792838276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:58:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8057a112-acbc-45f2-b0cb-6e871a3727a2 tempest-ProjectMemberTests-792838276 None] Flow 'volume_create_manager' (127b29ec-bd55-457f-a855-6cf76b05b3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:58:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8057a112-acbc-45f2-b0cb-6e871a3727a2 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2594c94c-d1c4-4777-b94e-e5337aa73e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8057a112-acbc-45f2-b0cb-6e871a3727a2 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2594c94c-d1c4-4777-b94e-e5337aa73e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1121528387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d3ccd93-be1e-492e-9b36-947a23bf1135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac225c2b69784eb6b9ec19178ed3af8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:58:40Z,use_quota=True,user_id='4ce57473867c427a94cf64a00303ce0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8057a112-acbc-45f2-b0cb-6e871a3727a2 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f10a03c3-3ece-406d-baf7-cd26e9c9e9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8057a112-acbc-45f2-b0cb-6e871a3727a2 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f10a03c3-3ece-406d-baf7-cd26e9c9e9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8057a112-acbc-45f2-b0cb-6e871a3727a2 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b70099e6-9d5f-40d3-bc09-8399ebcc294b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8057a112-acbc-45f2-b0cb-6e871a3727a2 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b70099e6-9d5f-40d3-bc09-8399ebcc294b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d3ccd93-be1e-492e-9b36-947a23bf1135', 'volume_name': 'volume-3d3ccd93-be1e-492e-9b36-947a23bf1135', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8057a112-acbc-45f2-b0cb-6e871a3727a2 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (025992eb-d589-4fc2-b6b1-c488ecf3acf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8057a112-acbc-45f2-b0cb-6e871a3727a2 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (025992eb-d589-4fc2-b6b1-c488ecf3acf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8057a112-acbc-45f2-b0cb-6e871a3727a2 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4daacf7b-4858-48e6-bdbf-0677c88b8c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:39 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-8057a112-acbc-45f2-b0cb-6e871a3727a2 tempest-ProjectMemberTests-792838276 None] Volume 3d3ccd93-be1e-492e-9b36-947a23bf1135: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d3ccd93-be1e-492e-9b36-947a23bf1135', 'volume_size': 1} Aug 11 04:58:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8057a112-acbc-45f2-b0cb-6e871a3727a2 tempest-ProjectMemberTests-792838276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8057a112-acbc-45f2-b0cb-6e871a3727a2 tempest-ProjectMemberTests-792838276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-8057a112-acbc-45f2-b0cb-6e871a3727a2 tempest-ProjectMemberTests-792838276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1121528387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d3ccd93-be1e-492e-9b36-947a23bf1135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac225c2b69784eb6b9ec19178ed3af8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:58:40Z,use_quota=True,user_id='4ce57473867c427a94cf64a00303ce0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:58:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-8057a112-acbc-45f2-b0cb-6e871a3727a2 tempest-ProjectMemberTests-792838276 None] Creating volume 3d3ccd93-be1e-492e-9b36-947a23bf1135 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:58:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8057a112-acbc-45f2-b0cb-6e871a3727a2 tempest-ProjectMemberTests-792838276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8057a112-acbc-45f2-b0cb-6e871a3727a2 tempest-ProjectMemberTests-792838276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-8057a112-acbc-45f2-b0cb-6e871a3727a2 tempest-ProjectMemberTests-792838276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:58:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-8057a112-acbc-45f2-b0cb-6e871a3727a2 tempest-ProjectMemberTests-792838276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:58:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8057a112-acbc-45f2-b0cb-6e871a3727a2 tempest-ProjectMemberTests-792838276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-8057a112-acbc-45f2-b0cb-6e871a3727a2 tempest-ProjectMemberTests-792838276 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:58:39 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-8057a112-acbc-45f2-b0cb-6e871a3727a2 tempest-ProjectMemberTests-792838276 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:58:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8057a112-acbc-45f2-b0cb-6e871a3727a2 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d3ccd93-be1e-492e-9b36-947a23bf1135 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b803692d-1e29-46f1-ac19-b62796e70c99 tempest-ProjectReaderTests-692176530 None] Acquiring lock "cinder-34e328f5-d309-43e6-9a1a-43576ce8a165-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:39 devstack sudo[116331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d3ccd93-be1e-492e-9b36-947a23bf1135 1073741824 Aug 11 04:58:39 devstack sudo[116331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b803692d-1e29-46f1-ac19-b62796e70c99 tempest-ProjectReaderTests-692176530 None] Lock "cinder-34e328f5-d309-43e6-9a1a-43576ce8a165-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b803692d-1e29-46f1-ac19-b62796e70c99 tempest-ProjectReaderTests-692176530 None] Acquiring lock "cinder-quobyte-c6926d55-3e68-471b-bfeb-b0dbfebc2a90" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b803692d-1e29-46f1-ac19-b62796e70c99 tempest-ProjectReaderTests-692176530 None] Lock "cinder-quobyte-c6926d55-3e68-471b-bfeb-b0dbfebc2a90" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b803692d-1e29-46f1-ac19-b62796e70c99 tempest-ProjectReaderTests-692176530 None] Acquiring lock "cinder-quobyte-34e328f5-d309-43e6-9a1a-43576ce8a165" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b803692d-1e29-46f1-ac19-b62796e70c99 tempest-ProjectReaderTests-692176530 None] Lock "cinder-quobyte-34e328f5-d309-43e6-9a1a-43576ce8a165" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-b803692d-1e29-46f1-ac19-b62796e70c99 tempest-ProjectReaderTests-692176530 None] Deleting offline snapshot 34e328f5-d309-43e6-9a1a-43576ce8a165 of volume c6926d55-3e68-471b-bfeb-b0dbfebc2a90 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 04:58:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-b803692d-1e29-46f1-ac19-b62796e70c99 tempest-ProjectReaderTests-692176530 None] snapshot_file for this snap is: volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90.34e328f5-d309-43e6-9a1a-43576ce8a165 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 04:58:39 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[26000aef-b2e3-4b5c-9e02-d0964d451c12]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:58:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b803692d-1e29-46f1-ac19-b62796e70c99 tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90.34e328f5-d309-43e6-9a1a-43576ce8a165 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:40 devstack sudo[116333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90.34e328f5-d309-43e6-9a1a-43576ce8a165 Aug 11 04:58:40 devstack sudo[116333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:40 devstack sudo[116331]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8057a112-acbc-45f2-b0cb-6e871a3727a2 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d3ccd93-be1e-492e-9b36-947a23bf1135 1073741824" returned: 0 in 0.433s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8057a112-acbc-45f2-b0cb-6e871a3727a2 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d3ccd93-be1e-492e-9b36-947a23bf1135 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:40 devstack sudo[116333]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b803692d-1e29-46f1-ac19-b62796e70c99 tempest-ProjectReaderTests-692176530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90.34e328f5-d309-43e6-9a1a-43576ce8a165" returned: 0 in 0.377s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:40 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-b803692d-1e29-46f1-ac19-b62796e70c99 tempest-ProjectReaderTests-692176530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:58:40 devstack sudo[116342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d3ccd93-be1e-492e-9b36-947a23bf1135 Aug 11 04:58:40 devstack sudo[116342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:40 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[206a5503-75d2-444c-9a6c-9124a36e7264]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:58:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b803692d-1e29-46f1-ac19-b62796e70c99 tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:40 devstack sudo[116344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90 Aug 11 04:58:40 devstack sudo[116344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:40 devstack sudo[116342]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8057a112-acbc-45f2-b0cb-6e871a3727a2 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d3ccd93-be1e-492e-9b36-947a23bf1135" returned: 0 in 0.249s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:40 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-8057a112-acbc-45f2-b0cb-6e871a3727a2 tempest-ProjectMemberTests-792838276 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:58:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8057a112-acbc-45f2-b0cb-6e871a3727a2 tempest-ProjectMemberTests-792838276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8057a112-acbc-45f2-b0cb-6e871a3727a2 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4daacf7b-4858-48e6-bdbf-0677c88b8c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d3ccd93-be1e-492e-9b36-947a23bf1135', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8057a112-acbc-45f2-b0cb-6e871a3727a2 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da21cfdb-77a9-4a23-9d0d-734b0cc0c6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:40 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-8057a112-acbc-45f2-b0cb-6e871a3727a2 tempest-ProjectMemberTests-792838276 None] Volume volume-3d3ccd93-be1e-492e-9b36-947a23bf1135 (3d3ccd93-be1e-492e-9b36-947a23bf1135): created successfully Aug 11 04:58:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8057a112-acbc-45f2-b0cb-6e871a3727a2 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da21cfdb-77a9-4a23-9d0d-734b0cc0c6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8057a112-acbc-45f2-b0cb-6e871a3727a2 tempest-ProjectMemberTests-792838276 None] Flow 'volume_create_manager' (127b29ec-bd55-457f-a855-6cf76b05b3ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:58:40 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-8057a112-acbc-45f2-b0cb-6e871a3727a2 tempest-ProjectMemberTests-792838276 None] Created volume successfully. Aug 11 04:58:40 devstack sudo[116344]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b803692d-1e29-46f1-ac19-b62796e70c99 tempest-ProjectReaderTests-692176530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90" returned: 0 in 0.368s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b803692d-1e29-46f1-ac19-b62796e70c99 tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90.34e328f5-d309-43e6-9a1a-43576ce8a165 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:40 devstack sudo[116350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90.34e328f5-d309-43e6-9a1a-43576ce8a165 Aug 11 04:58:40 devstack sudo[116350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ceeef46c-e8b5-43c7-9dcc-e2ec73f6edf8 tempest-ProjectMemberTests-792838276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ceeef46c-e8b5-43c7-9dcc-e2ec73f6edf8 tempest-ProjectMemberTests-792838276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:40 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-ceeef46c-e8b5-43c7-9dcc-e2ec73f6edf8 tempest-ProjectMemberTests-792838276 None] Creating offline snapshot ff832369-94cf-4d3e-9391-22d1a9d5feb9 of volume 3d3ccd93-be1e-492e-9b36-947a23bf1135 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 04:58:40 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c643f2e-175f-4868-93b5-d4ff9c9cda93]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:58:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ceeef46c-e8b5-43c7-9dcc-e2ec73f6edf8 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d3ccd93-be1e-492e-9b36-947a23bf1135 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:41 devstack sudo[116352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d3ccd93-be1e-492e-9b36-947a23bf1135 Aug 11 04:58:41 devstack sudo[116352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:41 devstack sudo[116350]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b803692d-1e29-46f1-ac19-b62796e70c99 tempest-ProjectReaderTests-692176530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90.34e328f5-d309-43e6-9a1a-43576ce8a165" returned: 0 in 0.357s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b803692d-1e29-46f1-ac19-b62796e70c99 tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90.34e328f5-d309-43e6-9a1a-43576ce8a165 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:41 devstack sudo[116358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90.34e328f5-d309-43e6-9a1a-43576ce8a165 Aug 11 04:58:41 devstack sudo[116358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:41 devstack sudo[116352]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ceeef46c-e8b5-43c7-9dcc-e2ec73f6edf8 tempest-ProjectMemberTests-792838276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d3ccd93-be1e-492e-9b36-947a23bf1135" returned: 0 in 0.368s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ceeef46c-e8b5-43c7-9dcc-e2ec73f6edf8 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d3ccd93-be1e-492e-9b36-947a23bf1135,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d3ccd93-be1e-492e-9b36-947a23bf1135.ff832369-94cf-4d3e-9391-22d1a9d5feb9 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:41 devstack sudo[116358]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b803692d-1e29-46f1-ac19-b62796e70c99 tempest-ProjectReaderTests-692176530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90.34e328f5-d309-43e6-9a1a-43576ce8a165" returned: 0 in 0.252s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:41 devstack sudo[116364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d3ccd93-be1e-492e-9b36-947a23bf1135,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d3ccd93-be1e-492e-9b36-947a23bf1135.ff832369-94cf-4d3e-9391-22d1a9d5feb9 1G Aug 11 04:58:41 devstack sudo[116364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:41 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b803692d-1e29-46f1-ac19-b62796e70c99 tempest-ProjectReaderTests-692176530 None] Lock "cinder-quobyte-34e328f5-d309-43e6-9a1a-43576ce8a165" released by "_delete_snapshot" :: held 1.452s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:41 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b803692d-1e29-46f1-ac19-b62796e70c99 tempest-ProjectReaderTests-692176530 None] Lock "cinder-quobyte-c6926d55-3e68-471b-bfeb-b0dbfebc2a90" released by "delete_snapshot" :: held 1.472s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:41 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-b803692d-1e29-46f1-ac19-b62796e70c99 tempest-ProjectReaderTests-692176530 None] Created reservations ['8247efcc-150f-4460-a272-b3b39d0d5ce7', '4f5db972-3126-420a-83bc-6c7402eda4be', '3bb05d41-96a6-46da-b074-aa68a90511ce', '78736b3a-1321-4735-b9ac-c126f1dbb0ea'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:58:41 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-b803692d-1e29-46f1-ac19-b62796e70c99 tempest-ProjectReaderTests-692176530 None] Delete snapshot completed successfully. Aug 11 04:58:41 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b803692d-1e29-46f1-ac19-b62796e70c99 tempest-ProjectReaderTests-692176530 None] Lock "cinder-34e328f5-d309-43e6-9a1a-43576ce8a165-delete_snapshot" released by "delete_snapshot" :: held 1.607s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:41 devstack sudo[116364]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ceeef46c-e8b5-43c7-9dcc-e2ec73f6edf8 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d3ccd93-be1e-492e-9b36-947a23bf1135,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d3ccd93-be1e-492e-9b36-947a23bf1135.ff832369-94cf-4d3e-9391-22d1a9d5feb9 1G" returned: 0 in 0.407s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ceeef46c-e8b5-43c7-9dcc-e2ec73f6edf8 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d3ccd93-be1e-492e-9b36-947a23bf1135 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d3ccd93-be1e-492e-9b36-947a23bf1135.ff832369-94cf-4d3e-9391-22d1a9d5feb9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:41 devstack sudo[116369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d3ccd93-be1e-492e-9b36-947a23bf1135 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d3ccd93-be1e-492e-9b36-947a23bf1135.ff832369-94cf-4d3e-9391-22d1a9d5feb9 Aug 11 04:58:41 devstack sudo[116369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:42 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b8411b18-90ae-4987-b8b9-d6be81fbf715 tempest-ProjectReaderTests-692176530 None] Acquiring lock "cinder-c6926d55-3e68-471b-bfeb-b0dbfebc2a90-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:42 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b8411b18-90ae-4987-b8b9-d6be81fbf715 tempest-ProjectReaderTests-692176530 None] Lock "cinder-c6926d55-3e68-471b-bfeb-b0dbfebc2a90-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:42 devstack sudo[116369]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ceeef46c-e8b5-43c7-9dcc-e2ec73f6edf8 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d3ccd93-be1e-492e-9b36-947a23bf1135 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d3ccd93-be1e-492e-9b36-947a23bf1135.ff832369-94cf-4d3e-9391-22d1a9d5feb9" returned: 0 in 0.314s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:42 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-ceeef46c-e8b5-43c7-9dcc-e2ec73f6edf8 tempest-ProjectMemberTests-792838276 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d3ccd93-be1e-492e-9b36-947a23bf1135.ff832369-94cf-4d3e-9391-22d1a9d5feb9 is being set with open permissions: ugo+rw Aug 11 04:58:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ceeef46c-e8b5-43c7-9dcc-e2ec73f6edf8 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d3ccd93-be1e-492e-9b36-947a23bf1135.ff832369-94cf-4d3e-9391-22d1a9d5feb9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:42 devstack sudo[116374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d3ccd93-be1e-492e-9b36-947a23bf1135.ff832369-94cf-4d3e-9391-22d1a9d5feb9 Aug 11 04:58:42 devstack sudo[116374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:42 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b8411b18-90ae-4987-b8b9-d6be81fbf715 tempest-ProjectReaderTests-692176530 None] Acquiring lock "cinder-quobyte-c6926d55-3e68-471b-bfeb-b0dbfebc2a90" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:42 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b8411b18-90ae-4987-b8b9-d6be81fbf715 tempest-ProjectReaderTests-692176530 None] Lock "cinder-quobyte-c6926d55-3e68-471b-bfeb-b0dbfebc2a90" acquired by "delete_volume" :: waited 0.015s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:42 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c86c7da-313a-4374-a357-d28ab2183d19]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:58:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b8411b18-90ae-4987-b8b9-d6be81fbf715 tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:42 devstack sudo[116376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90 Aug 11 04:58:42 devstack sudo[116376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:42 devstack sudo[116374]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ceeef46c-e8b5-43c7-9dcc-e2ec73f6edf8 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d3ccd93-be1e-492e-9b36-947a23bf1135.ff832369-94cf-4d3e-9391-22d1a9d5feb9" returned: 0 in 0.255s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ceeef46c-e8b5-43c7-9dcc-e2ec73f6edf8 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d3ccd93-be1e-492e-9b36-947a23bf1135.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:42 devstack sudo[116381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d3ccd93-be1e-492e-9b36-947a23bf1135.info Aug 11 04:58:42 devstack sudo[116381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:42 devstack sudo[116376]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b8411b18-90ae-4987-b8b9-d6be81fbf715 tempest-ProjectReaderTests-692176530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90" returned: 0 in 0.373s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b8411b18-90ae-4987-b8b9-d6be81fbf715 tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:42 devstack sudo[116386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90 Aug 11 04:58:42 devstack sudo[116386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:42 devstack sudo[116381]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ceeef46c-e8b5-43c7-9dcc-e2ec73f6edf8 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d3ccd93-be1e-492e-9b36-947a23bf1135.info" returned: 0 in 0.255s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:42 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-ceeef46c-e8b5-43c7-9dcc-e2ec73f6edf8 tempest-ProjectMemberTests-792838276 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d3ccd93-be1e-492e-9b36-947a23bf1135.info is being set with open permissions: ugo+rw Aug 11 04:58:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ceeef46c-e8b5-43c7-9dcc-e2ec73f6edf8 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d3ccd93-be1e-492e-9b36-947a23bf1135.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:42 devstack sudo[116389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d3ccd93-be1e-492e-9b36-947a23bf1135.info Aug 11 04:58:42 devstack sudo[116389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:42 devstack sudo[116386]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b8411b18-90ae-4987-b8b9-d6be81fbf715 tempest-ProjectReaderTests-692176530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-c6926d55-3e68-471b-bfeb-b0dbfebc2a90" returned: 0 in 0.245s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:42 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b8411b18-90ae-4987-b8b9-d6be81fbf715 tempest-ProjectReaderTests-692176530 None] Lock "cinder-quobyte-c6926d55-3e68-471b-bfeb-b0dbfebc2a90" released by "delete_volume" :: held 0.682s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:42 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-b8411b18-90ae-4987-b8b9-d6be81fbf715 tempest-ProjectReaderTests-692176530 None] Created reservations ['6ef064f0-08b4-418e-b0f8-4c85a7a47340', '164ad198-c8c9-44b2-ae2c-7c1ec7e62ba6', 'a7678132-4de8-4e1c-bccc-047baa9b1688', '1eabf973-1e9b-49cc-a667-3ba875b159e6'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:58:42 devstack sudo[116389]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ceeef46c-e8b5-43c7-9dcc-e2ec73f6edf8 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d3ccd93-be1e-492e-9b36-947a23bf1135.info" returned: 0 in 0.247s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ceeef46c-e8b5-43c7-9dcc-e2ec73f6edf8 tempest-ProjectMemberTests-792838276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.925s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:42 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-ceeef46c-e8b5-43c7-9dcc-e2ec73f6edf8 tempest-ProjectMemberTests-792838276 None] Create snapshot completed successfully Aug 11 04:58:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b8411b18-90ae-4987-b8b9-d6be81fbf715 tempest-ProjectReaderTests-692176530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b8411b18-90ae-4987-b8b9-d6be81fbf715 tempest-ProjectReaderTests-692176530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:42 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b8411b18-90ae-4987-b8b9-d6be81fbf715 tempest-ProjectReaderTests-692176530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:58:42 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b8411b18-90ae-4987-b8b9-d6be81fbf715 tempest-ProjectReaderTests-692176530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:58:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b8411b18-90ae-4987-b8b9-d6be81fbf715 tempest-ProjectReaderTests-692176530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b8411b18-90ae-4987-b8b9-d6be81fbf715 tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:42 devstack sudo[116393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:58:42 devstack sudo[116393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e16dfbbc-093c-4cf3-a8a0-25adce56d882 tempest-ProjectMemberTests-792838276 None] Acquiring lock "cinder-ff832369-94cf-4d3e-9391-22d1a9d5feb9-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e16dfbbc-093c-4cf3-a8a0-25adce56d882 tempest-ProjectMemberTests-792838276 None] Lock "cinder-ff832369-94cf-4d3e-9391-22d1a9d5feb9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e16dfbbc-093c-4cf3-a8a0-25adce56d882 tempest-ProjectMemberTests-792838276 None] Acquiring lock "cinder-quobyte-3d3ccd93-be1e-492e-9b36-947a23bf1135" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e16dfbbc-093c-4cf3-a8a0-25adce56d882 tempest-ProjectMemberTests-792838276 None] Lock "cinder-quobyte-3d3ccd93-be1e-492e-9b36-947a23bf1135" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e16dfbbc-093c-4cf3-a8a0-25adce56d882 tempest-ProjectMemberTests-792838276 None] Acquiring lock "cinder-quobyte-ff832369-94cf-4d3e-9391-22d1a9d5feb9" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e16dfbbc-093c-4cf3-a8a0-25adce56d882 tempest-ProjectMemberTests-792838276 None] Lock "cinder-quobyte-ff832369-94cf-4d3e-9391-22d1a9d5feb9" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:43 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-e16dfbbc-093c-4cf3-a8a0-25adce56d882 tempest-ProjectMemberTests-792838276 None] Deleting offline snapshot ff832369-94cf-4d3e-9391-22d1a9d5feb9 of volume 3d3ccd93-be1e-492e-9b36-947a23bf1135 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 04:58:43 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-e16dfbbc-093c-4cf3-a8a0-25adce56d882 tempest-ProjectMemberTests-792838276 None] snapshot_file for this snap is: volume-3d3ccd93-be1e-492e-9b36-947a23bf1135.ff832369-94cf-4d3e-9391-22d1a9d5feb9 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 04:58:43 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e002c90-d599-48a8-8420-31eca838c1c3]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:58:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e16dfbbc-093c-4cf3-a8a0-25adce56d882 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d3ccd93-be1e-492e-9b36-947a23bf1135.ff832369-94cf-4d3e-9391-22d1a9d5feb9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:43 devstack sudo[116393]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b8411b18-90ae-4987-b8b9-d6be81fbf715 tempest-ProjectReaderTests-692176530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.287s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:43 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-b8411b18-90ae-4987-b8b9-d6be81fbf715 tempest-ProjectReaderTests-692176530 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:58:43 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-b8411b18-90ae-4987-b8b9-d6be81fbf715 tempest-ProjectReaderTests-692176530 None] Deleted volume successfully. Aug 11 04:58:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b8411b18-90ae-4987-b8b9-d6be81fbf715 tempest-ProjectReaderTests-692176530 None] Lock "cinder-c6926d55-3e68-471b-bfeb-b0dbfebc2a90-delete_volume" released by "delete_volume" :: held 1.213s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:43 devstack sudo[116396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d3ccd93-be1e-492e-9b36-947a23bf1135.ff832369-94cf-4d3e-9391-22d1a9d5feb9 Aug 11 04:58:43 devstack sudo[116396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:43 devstack sudo[116396]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e16dfbbc-093c-4cf3-a8a0-25adce56d882 tempest-ProjectMemberTests-792838276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d3ccd93-be1e-492e-9b36-947a23bf1135.ff832369-94cf-4d3e-9391-22d1a9d5feb9" returned: 0 in 0.397s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:43 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-e16dfbbc-093c-4cf3-a8a0-25adce56d882 tempest-ProjectMemberTests-792838276 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d3ccd93-be1e-492e-9b36-947a23bf1135(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:58:43 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[280333d9-f200-470c-9791-2853f5683da1]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:58:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e16dfbbc-093c-4cf3-a8a0-25adce56d882 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d3ccd93-be1e-492e-9b36-947a23bf1135 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:43 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-5309ef7c-5e51-4a5f-a6cf-a450b069620b tempest-ProjectReaderTests-692176530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:58:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5309ef7c-5e51-4a5f-a6cf-a450b069620b tempest-ProjectReaderTests-692176530 None] Flow 'volume_create_manager' (07ceccfd-9273-46c5-b71d-f0354fec5b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:58:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5309ef7c-5e51-4a5f-a6cf-a450b069620b tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c16fb73-48ec-4ff0-945b-27ddb2685b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5309ef7c-5e51-4a5f-a6cf-a450b069620b tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c16fb73-48ec-4ff0-945b-27ddb2685b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:58:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-629616150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95563f14c47841708c0521bda11769a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:58:44Z,use_quota=True,user_id='f7bf5308d1fc4270957690c1005f4a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5309ef7c-5e51-4a5f-a6cf-a450b069620b tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0aa58d9-86b2-46ef-a271-b3da5d5346fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5309ef7c-5e51-4a5f-a6cf-a450b069620b tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0aa58d9-86b2-46ef-a271-b3da5d5346fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5309ef7c-5e51-4a5f-a6cf-a450b069620b tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15c69323-5fde-4857-8116-ff92dc548384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5309ef7c-5e51-4a5f-a6cf-a450b069620b tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15c69323-5fde-4857-8116-ff92dc548384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39', 'volume_name': 'volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5309ef7c-5e51-4a5f-a6cf-a450b069620b tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (871f3ac3-f2e5-4b24-9afa-7eee7c64463d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:43 devstack sudo[116402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d3ccd93-be1e-492e-9b36-947a23bf1135 Aug 11 04:58:43 devstack sudo[116402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5309ef7c-5e51-4a5f-a6cf-a450b069620b tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (871f3ac3-f2e5-4b24-9afa-7eee7c64463d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5309ef7c-5e51-4a5f-a6cf-a450b069620b tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f35aab2-ffe8-4fbe-9b85-1942df9ad430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:43 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-5309ef7c-5e51-4a5f-a6cf-a450b069620b tempest-ProjectReaderTests-692176530 None] Volume 2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39', 'volume_size': 1} Aug 11 04:58:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5309ef7c-5e51-4a5f-a6cf-a450b069620b tempest-ProjectReaderTests-692176530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5309ef7c-5e51-4a5f-a6cf-a450b069620b tempest-ProjectReaderTests-692176530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:43 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-5309ef7c-5e51-4a5f-a6cf-a450b069620b tempest-ProjectReaderTests-692176530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:58:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-629616150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95563f14c47841708c0521bda11769a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:58:44Z,use_quota=True,user_id='f7bf5308d1fc4270957690c1005f4a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:58:43 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-5309ef7c-5e51-4a5f-a6cf-a450b069620b tempest-ProjectReaderTests-692176530 None] Creating volume 2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:58:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5309ef7c-5e51-4a5f-a6cf-a450b069620b tempest-ProjectReaderTests-692176530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5309ef7c-5e51-4a5f-a6cf-a450b069620b tempest-ProjectReaderTests-692176530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:43 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-5309ef7c-5e51-4a5f-a6cf-a450b069620b tempest-ProjectReaderTests-692176530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:58:43 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-5309ef7c-5e51-4a5f-a6cf-a450b069620b tempest-ProjectReaderTests-692176530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:58:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5309ef7c-5e51-4a5f-a6cf-a450b069620b tempest-ProjectReaderTests-692176530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:43 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-5309ef7c-5e51-4a5f-a6cf-a450b069620b tempest-ProjectReaderTests-692176530 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:58:43 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-5309ef7c-5e51-4a5f-a6cf-a450b069620b tempest-ProjectReaderTests-692176530 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:58:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5309ef7c-5e51-4a5f-a6cf-a450b069620b tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:43 devstack sudo[116404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39 1073741824 Aug 11 04:58:43 devstack sudo[116404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:44 devstack sudo[116402]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e16dfbbc-093c-4cf3-a8a0-25adce56d882 tempest-ProjectMemberTests-792838276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d3ccd93-be1e-492e-9b36-947a23bf1135" returned: 0 in 0.384s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e16dfbbc-093c-4cf3-a8a0-25adce56d882 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d3ccd93-be1e-492e-9b36-947a23bf1135.ff832369-94cf-4d3e-9391-22d1a9d5feb9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:44 devstack sudo[116411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d3ccd93-be1e-492e-9b36-947a23bf1135.ff832369-94cf-4d3e-9391-22d1a9d5feb9 Aug 11 04:58:44 devstack sudo[116411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:44 devstack sudo[116404]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5309ef7c-5e51-4a5f-a6cf-a450b069620b tempest-ProjectReaderTests-692176530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39 1073741824" returned: 0 in 0.456s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5309ef7c-5e51-4a5f-a6cf-a450b069620b tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:44 devstack sudo[116416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39 Aug 11 04:58:44 devstack sudo[116416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:44 devstack sudo[116411]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e16dfbbc-093c-4cf3-a8a0-25adce56d882 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d3ccd93-be1e-492e-9b36-947a23bf1135.ff832369-94cf-4d3e-9391-22d1a9d5feb9" returned: 0 in 0.380s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e16dfbbc-093c-4cf3-a8a0-25adce56d882 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d3ccd93-be1e-492e-9b36-947a23bf1135.ff832369-94cf-4d3e-9391-22d1a9d5feb9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:44 devstack sudo[116420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d3ccd93-be1e-492e-9b36-947a23bf1135.ff832369-94cf-4d3e-9391-22d1a9d5feb9 Aug 11 04:58:44 devstack sudo[116420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:44 devstack sudo[116416]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5309ef7c-5e51-4a5f-a6cf-a450b069620b tempest-ProjectReaderTests-692176530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39" returned: 0 in 0.260s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:44 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-5309ef7c-5e51-4a5f-a6cf-a450b069620b tempest-ProjectReaderTests-692176530 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:58:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5309ef7c-5e51-4a5f-a6cf-a450b069620b tempest-ProjectReaderTests-692176530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5309ef7c-5e51-4a5f-a6cf-a450b069620b tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f35aab2-ffe8-4fbe-9b85-1942df9ad430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5309ef7c-5e51-4a5f-a6cf-a450b069620b tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7bcf279-44c9-4a4a-b6e6-edb77379e7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:44 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-5309ef7c-5e51-4a5f-a6cf-a450b069620b tempest-ProjectReaderTests-692176530 None] Volume volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39 (2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39): created successfully Aug 11 04:58:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5309ef7c-5e51-4a5f-a6cf-a450b069620b tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7bcf279-44c9-4a4a-b6e6-edb77379e7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5309ef7c-5e51-4a5f-a6cf-a450b069620b tempest-ProjectReaderTests-692176530 None] Flow 'volume_create_manager' (07ceccfd-9273-46c5-b71d-f0354fec5b73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:58:44 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-5309ef7c-5e51-4a5f-a6cf-a450b069620b tempest-ProjectReaderTests-692176530 None] Created volume successfully. Aug 11 04:58:44 devstack sudo[116420]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e16dfbbc-093c-4cf3-a8a0-25adce56d882 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d3ccd93-be1e-492e-9b36-947a23bf1135.ff832369-94cf-4d3e-9391-22d1a9d5feb9" returned: 0 in 0.254s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:44 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e16dfbbc-093c-4cf3-a8a0-25adce56d882 tempest-ProjectMemberTests-792838276 None] Lock "cinder-quobyte-ff832369-94cf-4d3e-9391-22d1a9d5feb9" released by "_delete_snapshot" :: held 1.541s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:44 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e16dfbbc-093c-4cf3-a8a0-25adce56d882 tempest-ProjectMemberTests-792838276 None] Lock "cinder-quobyte-3d3ccd93-be1e-492e-9b36-947a23bf1135" released by "delete_snapshot" :: held 1.563s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:44 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-e16dfbbc-093c-4cf3-a8a0-25adce56d882 tempest-ProjectMemberTests-792838276 None] Created reservations ['45c31d27-b687-481d-a738-9431cadcf4e3', 'cbb43453-e541-433d-87ec-e67382bae553', 'f8428449-a565-4ecc-b5c4-b50d0de4e41a', 'e5c1ffdd-b331-4a24-9173-2ba4c0ef093b'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:58:44 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-e16dfbbc-093c-4cf3-a8a0-25adce56d882 tempest-ProjectMemberTests-792838276 None] Delete snapshot completed successfully. Aug 11 04:58:44 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e16dfbbc-093c-4cf3-a8a0-25adce56d882 tempest-ProjectMemberTests-792838276 None] Lock "cinder-ff832369-94cf-4d3e-9391-22d1a9d5feb9-delete_snapshot" released by "delete_snapshot" :: held 1.697s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:45 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ca2a4ee6-4524-4afa-b373-7ee76dac086a tempest-ProjectMemberTests-792838276 None] Acquiring lock "cinder-3d3ccd93-be1e-492e-9b36-947a23bf1135-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:45 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ca2a4ee6-4524-4afa-b373-7ee76dac086a tempest-ProjectMemberTests-792838276 None] Lock "cinder-3d3ccd93-be1e-492e-9b36-947a23bf1135-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:45 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ca2a4ee6-4524-4afa-b373-7ee76dac086a tempest-ProjectMemberTests-792838276 None] Acquiring lock "cinder-quobyte-3d3ccd93-be1e-492e-9b36-947a23bf1135" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:45 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ca2a4ee6-4524-4afa-b373-7ee76dac086a tempest-ProjectMemberTests-792838276 None] Lock "cinder-quobyte-3d3ccd93-be1e-492e-9b36-947a23bf1135" acquired by "delete_volume" :: waited 0.014s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:45 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cddeaa5-e8ce-4824-9029-d20cb11a5987]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:58:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ca2a4ee6-4524-4afa-b373-7ee76dac086a tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d3ccd93-be1e-492e-9b36-947a23bf1135 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:45 devstack sudo[116424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d3ccd93-be1e-492e-9b36-947a23bf1135 Aug 11 04:58:45 devstack sudo[116424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:45 devstack sudo[116424]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ca2a4ee6-4524-4afa-b373-7ee76dac086a tempest-ProjectMemberTests-792838276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d3ccd93-be1e-492e-9b36-947a23bf1135" returned: 0 in 0.353s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ca2a4ee6-4524-4afa-b373-7ee76dac086a tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d3ccd93-be1e-492e-9b36-947a23bf1135 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:45 devstack sudo[116429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d3ccd93-be1e-492e-9b36-947a23bf1135 Aug 11 04:58:45 devstack sudo[116429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f84414ef-da48-460a-b5e6-f95a27a23230 tempest-ProjectReaderTests-692176530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f84414ef-da48-460a-b5e6-f95a27a23230 tempest-ProjectReaderTests-692176530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:45 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-f84414ef-da48-460a-b5e6-f95a27a23230 tempest-ProjectReaderTests-692176530 None] Creating offline snapshot 0eb96013-7daa-4e65-bc25-6d0fce6d19bd of volume 2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 04:58:45 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88c8219-eb1f-446b-9977-3ffedf2cf321]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:58:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f84414ef-da48-460a-b5e6-f95a27a23230 tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:45 devstack sudo[116429]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ca2a4ee6-4524-4afa-b373-7ee76dac086a tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-3d3ccd93-be1e-492e-9b36-947a23bf1135" returned: 0 in 0.257s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:45 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ca2a4ee6-4524-4afa-b373-7ee76dac086a tempest-ProjectMemberTests-792838276 None] Lock "cinder-quobyte-3d3ccd93-be1e-492e-9b36-947a23bf1135" released by "delete_volume" :: held 0.666s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:46 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-ca2a4ee6-4524-4afa-b373-7ee76dac086a tempest-ProjectMemberTests-792838276 None] Created reservations ['3c577dfb-0bdb-410b-ba40-e0c0d5197ebb', '6cbfc303-3bfd-48a1-b763-1998966a0fdc', '0d8dbf31-5666-407b-a863-3076fc994436', '2bb220ec-32e0-4a21-b0c0-2b198cc9e923'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:58:46 devstack sudo[116432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39 Aug 11 04:58:46 devstack sudo[116432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ca2a4ee6-4524-4afa-b373-7ee76dac086a tempest-ProjectMemberTests-792838276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ca2a4ee6-4524-4afa-b373-7ee76dac086a tempest-ProjectMemberTests-792838276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:46 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ca2a4ee6-4524-4afa-b373-7ee76dac086a tempest-ProjectMemberTests-792838276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:58:46 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ca2a4ee6-4524-4afa-b373-7ee76dac086a tempest-ProjectMemberTests-792838276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:58:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ca2a4ee6-4524-4afa-b373-7ee76dac086a tempest-ProjectMemberTests-792838276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ca2a4ee6-4524-4afa-b373-7ee76dac086a tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:46 devstack sudo[116434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:58:46 devstack sudo[116434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:46 devstack sudo[116432]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f84414ef-da48-460a-b5e6-f95a27a23230 tempest-ProjectReaderTests-692176530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39" returned: 0 in 0.370s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f84414ef-da48-460a-b5e6-f95a27a23230 tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39.0eb96013-7daa-4e65-bc25-6d0fce6d19bd 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:46 devstack sudo[116434]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ca2a4ee6-4524-4afa-b373-7ee76dac086a tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.260s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:46 devstack sudo[116440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39.0eb96013-7daa-4e65-bc25-6d0fce6d19bd 1G Aug 11 04:58:46 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-ca2a4ee6-4524-4afa-b373-7ee76dac086a tempest-ProjectMemberTests-792838276 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:58:46 devstack sudo[116440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:46 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-ca2a4ee6-4524-4afa-b373-7ee76dac086a tempest-ProjectMemberTests-792838276 None] Deleted volume successfully. Aug 11 04:58:46 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ca2a4ee6-4524-4afa-b373-7ee76dac086a tempest-ProjectMemberTests-792838276 None] Lock "cinder-3d3ccd93-be1e-492e-9b36-947a23bf1135-delete_volume" released by "delete_volume" :: held 1.135s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:46 devstack sudo[116440]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f84414ef-da48-460a-b5e6-f95a27a23230 tempest-ProjectReaderTests-692176530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39.0eb96013-7daa-4e65-bc25-6d0fce6d19bd 1G" returned: 0 in 0.464s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f84414ef-da48-460a-b5e6-f95a27a23230 tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39.0eb96013-7daa-4e65-bc25-6d0fce6d19bd {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:46 devstack sudo[116446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39.0eb96013-7daa-4e65-bc25-6d0fce6d19bd Aug 11 04:58:46 devstack sudo[116446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:46 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-95f08ef7-546a-4ec0-a9f0-e1a04fa807a2 tempest-ProjectMemberTests-792838276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:58:46 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-95f08ef7-546a-4ec0-a9f0-e1a04fa807a2 tempest-ProjectMemberTests-792838276 None] Flow 'volume_create_manager' (1dd3c833-d296-4f21-9cc6-a7c126b5f623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:58:46 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-95f08ef7-546a-4ec0-a9f0-e1a04fa807a2 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79497409-638f-446b-9b9c-78e6c35e2a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:46 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-95f08ef7-546a-4ec0-a9f0-e1a04fa807a2 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79497409-638f-446b-9b9c-78e6c35e2a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2115754841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1dfd0ca-5069-48d2-9505-d64b85469c0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac225c2b69784eb6b9ec19178ed3af8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:58:47Z,use_quota=True,user_id='4ce57473867c427a94cf64a00303ce0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:46 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-95f08ef7-546a-4ec0-a9f0-e1a04fa807a2 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (299e7f43-8a6a-4774-bc68-5a7df690fdac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:46 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-95f08ef7-546a-4ec0-a9f0-e1a04fa807a2 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (299e7f43-8a6a-4774-bc68-5a7df690fdac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:46 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-95f08ef7-546a-4ec0-a9f0-e1a04fa807a2 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b86b44f-16bb-4f98-8d34-93c7037cb5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:46 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-95f08ef7-546a-4ec0-a9f0-e1a04fa807a2 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b86b44f-16bb-4f98-8d34-93c7037cb5b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1dfd0ca-5069-48d2-9505-d64b85469c0b', 'volume_name': 'volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:46 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-95f08ef7-546a-4ec0-a9f0-e1a04fa807a2 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3beff33-cae9-41e8-8f59-c354f32f6735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:46 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-95f08ef7-546a-4ec0-a9f0-e1a04fa807a2 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3beff33-cae9-41e8-8f59-c354f32f6735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:46 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-95f08ef7-546a-4ec0-a9f0-e1a04fa807a2 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84eccad9-cbaf-459a-8c4e-bcae8884db89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:46 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-95f08ef7-546a-4ec0-a9f0-e1a04fa807a2 tempest-ProjectMemberTests-792838276 None] Volume b1dfd0ca-5069-48d2-9505-d64b85469c0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b', 'volume_size': 1} Aug 11 04:58:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-95f08ef7-546a-4ec0-a9f0-e1a04fa807a2 tempest-ProjectMemberTests-792838276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:47 devstack sudo[116446]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f84414ef-da48-460a-b5e6-f95a27a23230 tempest-ProjectReaderTests-692176530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39.0eb96013-7daa-4e65-bc25-6d0fce6d19bd" returned: 0 in 0.296s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:47 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-f84414ef-da48-460a-b5e6-f95a27a23230 tempest-ProjectReaderTests-692176530 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39.0eb96013-7daa-4e65-bc25-6d0fce6d19bd is being set with open permissions: ugo+rw Aug 11 04:58:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f84414ef-da48-460a-b5e6-f95a27a23230 tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39.0eb96013-7daa-4e65-bc25-6d0fce6d19bd {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:47 devstack sudo[116451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39.0eb96013-7daa-4e65-bc25-6d0fce6d19bd Aug 11 04:58:47 devstack sudo[116451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:47 devstack sudo[116451]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f84414ef-da48-460a-b5e6-f95a27a23230 tempest-ProjectReaderTests-692176530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39.0eb96013-7daa-4e65-bc25-6d0fce6d19bd" returned: 0 in 0.234s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f84414ef-da48-460a-b5e6-f95a27a23230 tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:47 devstack sudo[116454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39.info Aug 11 04:58:47 devstack sudo[116454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:47 devstack sudo[116454]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f84414ef-da48-460a-b5e6-f95a27a23230 tempest-ProjectReaderTests-692176530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39.info" returned: 0 in 0.243s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:47 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-f84414ef-da48-460a-b5e6-f95a27a23230 tempest-ProjectReaderTests-692176530 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39.info is being set with open permissions: ugo+rw Aug 11 04:58:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f84414ef-da48-460a-b5e6-f95a27a23230 tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:47 devstack sudo[116457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39.info Aug 11 04:58:47 devstack sudo[116457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:47 devstack sudo[116457]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f84414ef-da48-460a-b5e6-f95a27a23230 tempest-ProjectReaderTests-692176530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39.info" returned: 0 in 0.244s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f84414ef-da48-460a-b5e6-f95a27a23230 tempest-ProjectReaderTests-692176530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.931s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-95f08ef7-546a-4ec0-a9f0-e1a04fa807a2 tempest-ProjectMemberTests-792838276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.926s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:47 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-95f08ef7-546a-4ec0-a9f0-e1a04fa807a2 tempest-ProjectMemberTests-792838276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2115754841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1dfd0ca-5069-48d2-9505-d64b85469c0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac225c2b69784eb6b9ec19178ed3af8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:58:47Z,use_quota=True,user_id='4ce57473867c427a94cf64a00303ce0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:58:47 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-95f08ef7-546a-4ec0-a9f0-e1a04fa807a2 tempest-ProjectMemberTests-792838276 None] Creating volume b1dfd0ca-5069-48d2-9505-d64b85469c0b {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:58:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-95f08ef7-546a-4ec0-a9f0-e1a04fa807a2 tempest-ProjectMemberTests-792838276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-95f08ef7-546a-4ec0-a9f0-e1a04fa807a2 tempest-ProjectMemberTests-792838276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:47 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-95f08ef7-546a-4ec0-a9f0-e1a04fa807a2 tempest-ProjectMemberTests-792838276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:58:47 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-95f08ef7-546a-4ec0-a9f0-e1a04fa807a2 tempest-ProjectMemberTests-792838276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:58:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-95f08ef7-546a-4ec0-a9f0-e1a04fa807a2 tempest-ProjectMemberTests-792838276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:47 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-95f08ef7-546a-4ec0-a9f0-e1a04fa807a2 tempest-ProjectMemberTests-792838276 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:58:47 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-95f08ef7-546a-4ec0-a9f0-e1a04fa807a2 tempest-ProjectMemberTests-792838276 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:58:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-95f08ef7-546a-4ec0-a9f0-e1a04fa807a2 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:47 devstack sudo[116460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b 1073741824 Aug 11 04:58:47 devstack sudo[116460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:47 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-f84414ef-da48-460a-b5e6-f95a27a23230 tempest-ProjectReaderTests-692176530 None] Create snapshot completed successfully Aug 11 04:58:48 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-59808f73-00ea-43dd-baac-54e6d202b3ba tempest-ProjectReaderTests-692176530 None] Acquiring lock "cinder-0eb96013-7daa-4e65-bc25-6d0fce6d19bd-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:48 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-59808f73-00ea-43dd-baac-54e6d202b3ba tempest-ProjectReaderTests-692176530 None] Lock "cinder-0eb96013-7daa-4e65-bc25-6d0fce6d19bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:48 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-59808f73-00ea-43dd-baac-54e6d202b3ba tempest-ProjectReaderTests-692176530 None] Acquiring lock "cinder-quobyte-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:48 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-59808f73-00ea-43dd-baac-54e6d202b3ba tempest-ProjectReaderTests-692176530 None] Lock "cinder-quobyte-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:48 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-59808f73-00ea-43dd-baac-54e6d202b3ba tempest-ProjectReaderTests-692176530 None] Acquiring lock "cinder-quobyte-0eb96013-7daa-4e65-bc25-6d0fce6d19bd" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:48 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-59808f73-00ea-43dd-baac-54e6d202b3ba tempest-ProjectReaderTests-692176530 None] Lock "cinder-quobyte-0eb96013-7daa-4e65-bc25-6d0fce6d19bd" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:48 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-59808f73-00ea-43dd-baac-54e6d202b3ba tempest-ProjectReaderTests-692176530 None] Deleting offline snapshot 0eb96013-7daa-4e65-bc25-6d0fce6d19bd of volume 2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 04:58:48 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-59808f73-00ea-43dd-baac-54e6d202b3ba tempest-ProjectReaderTests-692176530 None] snapshot_file for this snap is: volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39.0eb96013-7daa-4e65-bc25-6d0fce6d19bd {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 04:58:48 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[808c9b53-eb32-4e78-8dbc-d0b4aed372ec]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:58:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-59808f73-00ea-43dd-baac-54e6d202b3ba tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39.0eb96013-7daa-4e65-bc25-6d0fce6d19bd {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:48 devstack sudo[116465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39.0eb96013-7daa-4e65-bc25-6d0fce6d19bd Aug 11 04:58:48 devstack sudo[116465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:48 devstack sudo[116460]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-95f08ef7-546a-4ec0-a9f0-e1a04fa807a2 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b 1073741824" returned: 0 in 0.470s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-95f08ef7-546a-4ec0-a9f0-e1a04fa807a2 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:48 devstack sudo[116468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b Aug 11 04:58:48 devstack sudo[116468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:48 devstack sudo[116465]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-59808f73-00ea-43dd-baac-54e6d202b3ba tempest-ProjectReaderTests-692176530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39.0eb96013-7daa-4e65-bc25-6d0fce6d19bd" returned: 0 in 0.382s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:48 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-59808f73-00ea-43dd-baac-54e6d202b3ba tempest-ProjectReaderTests-692176530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:58:48 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[88af7760-2794-46ac-956e-4cacedcff01b]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:58:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-59808f73-00ea-43dd-baac-54e6d202b3ba tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:48 devstack sudo[116468]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-95f08ef7-546a-4ec0-a9f0-e1a04fa807a2 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b" returned: 0 in 0.262s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:48 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-95f08ef7-546a-4ec0-a9f0-e1a04fa807a2 tempest-ProjectMemberTests-792838276 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:58:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-95f08ef7-546a-4ec0-a9f0-e1a04fa807a2 tempest-ProjectMemberTests-792838276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:48 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-95f08ef7-546a-4ec0-a9f0-e1a04fa807a2 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84eccad9-cbaf-459a-8c4e-bcae8884db89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:48 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-95f08ef7-546a-4ec0-a9f0-e1a04fa807a2 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (243b8006-0e9c-4af5-bf07-9e1f226915b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:48 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-95f08ef7-546a-4ec0-a9f0-e1a04fa807a2 tempest-ProjectMemberTests-792838276 None] Volume volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b (b1dfd0ca-5069-48d2-9505-d64b85469c0b): created successfully Aug 11 04:58:48 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-95f08ef7-546a-4ec0-a9f0-e1a04fa807a2 tempest-ProjectMemberTests-792838276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (243b8006-0e9c-4af5-bf07-9e1f226915b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:48 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-95f08ef7-546a-4ec0-a9f0-e1a04fa807a2 tempest-ProjectMemberTests-792838276 None] Flow 'volume_create_manager' (1dd3c833-d296-4f21-9cc6-a7c126b5f623) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:58:48 devstack sudo[116473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39 Aug 11 04:58:48 devstack sudo[116473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:48 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-95f08ef7-546a-4ec0-a9f0-e1a04fa807a2 tempest-ProjectMemberTests-792838276 None] Created volume successfully. Aug 11 04:58:48 devstack sudo[116473]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-59808f73-00ea-43dd-baac-54e6d202b3ba tempest-ProjectReaderTests-692176530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39" returned: 0 in 0.373s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-59808f73-00ea-43dd-baac-54e6d202b3ba tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39.0eb96013-7daa-4e65-bc25-6d0fce6d19bd {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:48 devstack sudo[116479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39.0eb96013-7daa-4e65-bc25-6d0fce6d19bd Aug 11 04:58:48 devstack sudo[116479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2d8c987f-e83f-477e-8109-ab3cad3d6603 tempest-ProjectMemberTests-792838276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2d8c987f-e83f-477e-8109-ab3cad3d6603 tempest-ProjectMemberTests-792838276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:49 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-2d8c987f-e83f-477e-8109-ab3cad3d6603 tempest-ProjectMemberTests-792838276 None] Creating offline snapshot 53db4c9e-aa7a-46a3-90c8-72ec6e3bbf54 of volume b1dfd0ca-5069-48d2-9505-d64b85469c0b {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 04:58:49 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef4c3c1-33df-49fc-96bc-7e5ca144aca3]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:58:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2d8c987f-e83f-477e-8109-ab3cad3d6603 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:49 devstack sudo[116481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b Aug 11 04:58:49 devstack sudo[116481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:49 devstack sudo[116479]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-59808f73-00ea-43dd-baac-54e6d202b3ba tempest-ProjectReaderTests-692176530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39.0eb96013-7daa-4e65-bc25-6d0fce6d19bd" returned: 0 in 0.355s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-59808f73-00ea-43dd-baac-54e6d202b3ba tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39.0eb96013-7daa-4e65-bc25-6d0fce6d19bd {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:49 devstack sudo[116486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39.0eb96013-7daa-4e65-bc25-6d0fce6d19bd Aug 11 04:58:49 devstack sudo[116486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:49 devstack sudo[116481]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2d8c987f-e83f-477e-8109-ab3cad3d6603 tempest-ProjectMemberTests-792838276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b" returned: 0 in 0.368s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2d8c987f-e83f-477e-8109-ab3cad3d6603 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b.53db4c9e-aa7a-46a3-90c8-72ec6e3bbf54 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:49 devstack sudo[116486]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-59808f73-00ea-43dd-baac-54e6d202b3ba tempest-ProjectReaderTests-692176530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39.0eb96013-7daa-4e65-bc25-6d0fce6d19bd" returned: 0 in 0.256s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:49 devstack sudo[116492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b.53db4c9e-aa7a-46a3-90c8-72ec6e3bbf54 1G Aug 11 04:58:49 devstack sudo[116492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:49 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-59808f73-00ea-43dd-baac-54e6d202b3ba tempest-ProjectReaderTests-692176530 None] Lock "cinder-quobyte-0eb96013-7daa-4e65-bc25-6d0fce6d19bd" released by "_delete_snapshot" :: held 1.473s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:49 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-59808f73-00ea-43dd-baac-54e6d202b3ba tempest-ProjectReaderTests-692176530 None] Lock "cinder-quobyte-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39" released by "delete_snapshot" :: held 1.497s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:49 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-59808f73-00ea-43dd-baac-54e6d202b3ba tempest-ProjectReaderTests-692176530 None] Created reservations ['9b67ca83-63ac-4112-9010-28a522ede564', 'dcaf2654-539a-4ef0-b52e-9c215ea19958', 'b85e1ee8-d655-433b-af96-d437eb6c8ca0', '7193d066-25fd-4b3e-8c1f-25181546f7bc'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:58:49 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-59808f73-00ea-43dd-baac-54e6d202b3ba tempest-ProjectReaderTests-692176530 None] Delete snapshot completed successfully. Aug 11 04:58:49 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-59808f73-00ea-43dd-baac-54e6d202b3ba tempest-ProjectReaderTests-692176530 None] Lock "cinder-0eb96013-7daa-4e65-bc25-6d0fce6d19bd-delete_snapshot" released by "delete_snapshot" :: held 1.626s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:49 devstack sudo[116492]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2d8c987f-e83f-477e-8109-ab3cad3d6603 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b.53db4c9e-aa7a-46a3-90c8-72ec6e3bbf54 1G" returned: 0 in 0.404s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2d8c987f-e83f-477e-8109-ab3cad3d6603 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b.53db4c9e-aa7a-46a3-90c8-72ec6e3bbf54 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:49 devstack sudo[116498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b.53db4c9e-aa7a-46a3-90c8-72ec6e3bbf54 Aug 11 04:58:49 devstack sudo[116498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:50 devstack sudo[116498]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2d8c987f-e83f-477e-8109-ab3cad3d6603 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b.53db4c9e-aa7a-46a3-90c8-72ec6e3bbf54" returned: 0 in 0.291s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:50 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-2d8c987f-e83f-477e-8109-ab3cad3d6603 tempest-ProjectMemberTests-792838276 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b.53db4c9e-aa7a-46a3-90c8-72ec6e3bbf54 is being set with open permissions: ugo+rw Aug 11 04:58:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2d8c987f-e83f-477e-8109-ab3cad3d6603 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b.53db4c9e-aa7a-46a3-90c8-72ec6e3bbf54 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:50 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-25cb8e47-e493-4878-9469-37465cc26171 tempest-ProjectReaderTests-692176530 None] Acquiring lock "cinder-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:50 devstack sudo[116504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b.53db4c9e-aa7a-46a3-90c8-72ec6e3bbf54 Aug 11 04:58:50 devstack sudo[116504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:50 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-25cb8e47-e493-4878-9469-37465cc26171 tempest-ProjectReaderTests-692176530 None] Lock "cinder-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:50 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-25cb8e47-e493-4878-9469-37465cc26171 tempest-ProjectReaderTests-692176530 None] Acquiring lock "cinder-quobyte-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:50 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-25cb8e47-e493-4878-9469-37465cc26171 tempest-ProjectReaderTests-692176530 None] Lock "cinder-quobyte-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39" acquired by "delete_volume" :: waited 0.017s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:50 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[0920558f-834e-4761-9383-5b0952b0ae4c]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:58:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-25cb8e47-e493-4878-9469-37465cc26171 tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:50 devstack sudo[116506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39 Aug 11 04:58:50 devstack sudo[116506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:50 devstack sudo[116504]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2d8c987f-e83f-477e-8109-ab3cad3d6603 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b.53db4c9e-aa7a-46a3-90c8-72ec6e3bbf54" returned: 0 in 0.273s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2d8c987f-e83f-477e-8109-ab3cad3d6603 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:50 devstack sudo[116509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b.info Aug 11 04:58:50 devstack sudo[116509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:50 devstack sudo[116506]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-25cb8e47-e493-4878-9469-37465cc26171 tempest-ProjectReaderTests-692176530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39" returned: 0 in 0.361s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-25cb8e47-e493-4878-9469-37465cc26171 tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:50 devstack sudo[116514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39 Aug 11 04:58:50 devstack sudo[116514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:50 devstack sudo[116509]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2d8c987f-e83f-477e-8109-ab3cad3d6603 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b.info" returned: 0 in 0.260s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:50 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-2d8c987f-e83f-477e-8109-ab3cad3d6603 tempest-ProjectMemberTests-792838276 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b.info is being set with open permissions: ugo+rw Aug 11 04:58:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2d8c987f-e83f-477e-8109-ab3cad3d6603 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:50 devstack sudo[116517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b.info Aug 11 04:58:50 devstack sudo[116517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:50 devstack sudo[116514]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-25cb8e47-e493-4878-9469-37465cc26171 tempest-ProjectReaderTests-692176530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39" returned: 0 in 0.241s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:50 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-25cb8e47-e493-4878-9469-37465cc26171 tempest-ProjectReaderTests-692176530 None] Lock "cinder-quobyte-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39" released by "delete_volume" :: held 0.660s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:51 devstack sudo[116517]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:51 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-25cb8e47-e493-4878-9469-37465cc26171 tempest-ProjectReaderTests-692176530 None] Created reservations ['f959c2a0-84a5-4aab-a41b-e529cd051407', 'b10ca6a7-28ba-41bc-bd40-ddbb651a6924', '82a64e14-51a8-4511-86b2-3543c3c76bc1', 'f1580e26-ab18-426e-b42f-d690f618c673'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:58:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2d8c987f-e83f-477e-8109-ab3cad3d6603 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b.info" returned: 0 in 0.256s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2d8c987f-e83f-477e-8109-ab3cad3d6603 tempest-ProjectMemberTests-792838276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.984s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:51 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-2d8c987f-e83f-477e-8109-ab3cad3d6603 tempest-ProjectMemberTests-792838276 None] Create snapshot completed successfully Aug 11 04:58:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-25cb8e47-e493-4878-9469-37465cc26171 tempest-ProjectReaderTests-692176530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-25cb8e47-e493-4878-9469-37465cc26171 tempest-ProjectReaderTests-692176530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:51 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-25cb8e47-e493-4878-9469-37465cc26171 tempest-ProjectReaderTests-692176530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:58:51 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-25cb8e47-e493-4878-9469-37465cc26171 tempest-ProjectReaderTests-692176530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:58:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-25cb8e47-e493-4878-9469-37465cc26171 tempest-ProjectReaderTests-692176530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-25cb8e47-e493-4878-9469-37465cc26171 tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:51 devstack sudo[116521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:58:51 devstack sudo[116521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:51 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-cde0b564-ed1f-42a9-a87a-d316a0064481 tempest-ProjectMemberTests-792838276 None] Acquiring lock "cinder-53db4c9e-aa7a-46a3-90c8-72ec6e3bbf54-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:51 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-cde0b564-ed1f-42a9-a87a-d316a0064481 tempest-ProjectMemberTests-792838276 None] Lock "cinder-53db4c9e-aa7a-46a3-90c8-72ec6e3bbf54-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:51 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-cde0b564-ed1f-42a9-a87a-d316a0064481 tempest-ProjectMemberTests-792838276 None] Acquiring lock "cinder-quobyte-b1dfd0ca-5069-48d2-9505-d64b85469c0b" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:51 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-cde0b564-ed1f-42a9-a87a-d316a0064481 tempest-ProjectMemberTests-792838276 None] Lock "cinder-quobyte-b1dfd0ca-5069-48d2-9505-d64b85469c0b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:51 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-cde0b564-ed1f-42a9-a87a-d316a0064481 tempest-ProjectMemberTests-792838276 None] Acquiring lock "cinder-quobyte-53db4c9e-aa7a-46a3-90c8-72ec6e3bbf54" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:51 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-cde0b564-ed1f-42a9-a87a-d316a0064481 tempest-ProjectMemberTests-792838276 None] Lock "cinder-quobyte-53db4c9e-aa7a-46a3-90c8-72ec6e3bbf54" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:51 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-cde0b564-ed1f-42a9-a87a-d316a0064481 tempest-ProjectMemberTests-792838276 None] Deleting offline snapshot 53db4c9e-aa7a-46a3-90c8-72ec6e3bbf54 of volume b1dfd0ca-5069-48d2-9505-d64b85469c0b {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 04:58:51 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-cde0b564-ed1f-42a9-a87a-d316a0064481 tempest-ProjectMemberTests-792838276 None] snapshot_file for this snap is: volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b.53db4c9e-aa7a-46a3-90c8-72ec6e3bbf54 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 04:58:51 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[454a4da8-5c03-4da9-8390-f7bf735f38d7]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:58:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cde0b564-ed1f-42a9-a87a-d316a0064481 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b.53db4c9e-aa7a-46a3-90c8-72ec6e3bbf54 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:51 devstack sudo[116521]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-25cb8e47-e493-4878-9469-37465cc26171 tempest-ProjectReaderTests-692176530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.281s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:51 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-25cb8e47-e493-4878-9469-37465cc26171 tempest-ProjectReaderTests-692176530 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:58:51 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-25cb8e47-e493-4878-9469-37465cc26171 tempest-ProjectReaderTests-692176530 None] Deleted volume successfully. Aug 11 04:58:51 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-25cb8e47-e493-4878-9469-37465cc26171 tempest-ProjectReaderTests-692176530 None] Lock "cinder-2e83ac6d-0a19-4fd4-a6f9-ceeea5248d39-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:51 devstack sudo[116524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b.53db4c9e-aa7a-46a3-90c8-72ec6e3bbf54 Aug 11 04:58:51 devstack sudo[116524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:51 devstack sudo[116524]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cde0b564-ed1f-42a9-a87a-d316a0064481 tempest-ProjectMemberTests-792838276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b.53db4c9e-aa7a-46a3-90c8-72ec6e3bbf54" returned: 0 in 0.402s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:51 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-cde0b564-ed1f-42a9-a87a-d316a0064481 tempest-ProjectMemberTests-792838276 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:58:51 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[e318781c-0adf-4293-a221-5aa0ff1109f5]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:58:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cde0b564-ed1f-42a9-a87a-d316a0064481 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:51 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-de674c87-bd70-4cf0-9e7a-406ccb7c144f tempest-ProjectReaderTests-692176530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:58:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-de674c87-bd70-4cf0-9e7a-406ccb7c144f tempest-ProjectReaderTests-692176530 None] Flow 'volume_create_manager' (8617d95b-8fa3-4ddb-bca0-ad57e5a419ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:58:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-de674c87-bd70-4cf0-9e7a-406ccb7c144f tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (173bb97c-3322-4c4b-8516-35dc200b4792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-de674c87-bd70-4cf0-9e7a-406ccb7c144f tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (173bb97c-3322-4c4b-8516-35dc200b4792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:58:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1067743597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eba9389d-4451-4eac-90d5-a28e44b704b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95563f14c47841708c0521bda11769a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:58:52Z,use_quota=True,user_id='f7bf5308d1fc4270957690c1005f4a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-de674c87-bd70-4cf0-9e7a-406ccb7c144f tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae3f65a6-809e-4f6d-ab80-b0f71f408eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-de674c87-bd70-4cf0-9e7a-406ccb7c144f tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae3f65a6-809e-4f6d-ab80-b0f71f408eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-de674c87-bd70-4cf0-9e7a-406ccb7c144f tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c0376df-fd55-461c-971f-1ef0063134d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-de674c87-bd70-4cf0-9e7a-406ccb7c144f tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c0376df-fd55-461c-971f-1ef0063134d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eba9389d-4451-4eac-90d5-a28e44b704b7', 'volume_name': 'volume-eba9389d-4451-4eac-90d5-a28e44b704b7', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:51 devstack sudo[116529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b Aug 11 04:58:51 devstack sudo[116529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-de674c87-bd70-4cf0-9e7a-406ccb7c144f tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c1a1e35-7ec6-4986-86d6-e5a9eda1488a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-de674c87-bd70-4cf0-9e7a-406ccb7c144f tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c1a1e35-7ec6-4986-86d6-e5a9eda1488a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-de674c87-bd70-4cf0-9e7a-406ccb7c144f tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f58e64f2-faf9-4bb8-88db-f330f3c4c643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:51 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-de674c87-bd70-4cf0-9e7a-406ccb7c144f tempest-ProjectReaderTests-692176530 None] Volume eba9389d-4451-4eac-90d5-a28e44b704b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eba9389d-4451-4eac-90d5-a28e44b704b7', 'volume_size': 1} Aug 11 04:58:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-de674c87-bd70-4cf0-9e7a-406ccb7c144f tempest-ProjectReaderTests-692176530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-de674c87-bd70-4cf0-9e7a-406ccb7c144f tempest-ProjectReaderTests-692176530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:51 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-de674c87-bd70-4cf0-9e7a-406ccb7c144f tempest-ProjectReaderTests-692176530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:58:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1067743597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eba9389d-4451-4eac-90d5-a28e44b704b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95563f14c47841708c0521bda11769a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:58:52Z,use_quota=True,user_id='f7bf5308d1fc4270957690c1005f4a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:58:51 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-de674c87-bd70-4cf0-9e7a-406ccb7c144f tempest-ProjectReaderTests-692176530 None] Creating volume eba9389d-4451-4eac-90d5-a28e44b704b7 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:58:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-de674c87-bd70-4cf0-9e7a-406ccb7c144f tempest-ProjectReaderTests-692176530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-de674c87-bd70-4cf0-9e7a-406ccb7c144f tempest-ProjectReaderTests-692176530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:51 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-de674c87-bd70-4cf0-9e7a-406ccb7c144f tempest-ProjectReaderTests-692176530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:58:51 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-de674c87-bd70-4cf0-9e7a-406ccb7c144f tempest-ProjectReaderTests-692176530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:58:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-de674c87-bd70-4cf0-9e7a-406ccb7c144f tempest-ProjectReaderTests-692176530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:51 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-de674c87-bd70-4cf0-9e7a-406ccb7c144f tempest-ProjectReaderTests-692176530 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:58:51 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-de674c87-bd70-4cf0-9e7a-406ccb7c144f tempest-ProjectReaderTests-692176530 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:58:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-de674c87-bd70-4cf0-9e7a-406ccb7c144f tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-eba9389d-4451-4eac-90d5-a28e44b704b7 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:52 devstack sudo[116531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-eba9389d-4451-4eac-90d5-a28e44b704b7 1073741824 Aug 11 04:58:52 devstack sudo[116531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:52 devstack sudo[116529]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cde0b564-ed1f-42a9-a87a-d316a0064481 tempest-ProjectMemberTests-792838276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b" returned: 0 in 0.378s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cde0b564-ed1f-42a9-a87a-d316a0064481 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b.53db4c9e-aa7a-46a3-90c8-72ec6e3bbf54 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:52 devstack sudo[116539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b.53db4c9e-aa7a-46a3-90c8-72ec6e3bbf54 Aug 11 04:58:52 devstack sudo[116539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:52 devstack sudo[116531]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-de674c87-bd70-4cf0-9e7a-406ccb7c144f tempest-ProjectReaderTests-692176530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-eba9389d-4451-4eac-90d5-a28e44b704b7 1073741824" returned: 0 in 0.441s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-de674c87-bd70-4cf0-9e7a-406ccb7c144f tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-eba9389d-4451-4eac-90d5-a28e44b704b7 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:52 devstack sudo[116543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-eba9389d-4451-4eac-90d5-a28e44b704b7 Aug 11 04:58:52 devstack sudo[116543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:52 devstack sudo[116539]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cde0b564-ed1f-42a9-a87a-d316a0064481 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b.53db4c9e-aa7a-46a3-90c8-72ec6e3bbf54" returned: 0 in 0.361s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cde0b564-ed1f-42a9-a87a-d316a0064481 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b.53db4c9e-aa7a-46a3-90c8-72ec6e3bbf54 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:52 devstack sudo[116547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b.53db4c9e-aa7a-46a3-90c8-72ec6e3bbf54 Aug 11 04:58:52 devstack sudo[116547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:52 devstack sudo[116543]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-de674c87-bd70-4cf0-9e7a-406ccb7c144f tempest-ProjectReaderTests-692176530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-eba9389d-4451-4eac-90d5-a28e44b704b7" returned: 0 in 0.263s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-de674c87-bd70-4cf0-9e7a-406ccb7c144f tempest-ProjectReaderTests-692176530 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:58:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-de674c87-bd70-4cf0-9e7a-406ccb7c144f tempest-ProjectReaderTests-692176530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-de674c87-bd70-4cf0-9e7a-406ccb7c144f tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f58e64f2-faf9-4bb8-88db-f330f3c4c643) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eba9389d-4451-4eac-90d5-a28e44b704b7', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-de674c87-bd70-4cf0-9e7a-406ccb7c144f tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dcba64c-0920-441e-981d-1c3311e77820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:58:52 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-de674c87-bd70-4cf0-9e7a-406ccb7c144f tempest-ProjectReaderTests-692176530 None] Volume volume-eba9389d-4451-4eac-90d5-a28e44b704b7 (eba9389d-4451-4eac-90d5-a28e44b704b7): created successfully Aug 11 04:58:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-de674c87-bd70-4cf0-9e7a-406ccb7c144f tempest-ProjectReaderTests-692176530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dcba64c-0920-441e-981d-1c3311e77820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:58:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-de674c87-bd70-4cf0-9e7a-406ccb7c144f tempest-ProjectReaderTests-692176530 None] Flow 'volume_create_manager' (8617d95b-8fa3-4ddb-bca0-ad57e5a419ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:58:52 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-de674c87-bd70-4cf0-9e7a-406ccb7c144f tempest-ProjectReaderTests-692176530 None] Created volume successfully. Aug 11 04:58:52 devstack sudo[116547]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cde0b564-ed1f-42a9-a87a-d316a0064481 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b.53db4c9e-aa7a-46a3-90c8-72ec6e3bbf54" returned: 0 in 0.312s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:52 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-cde0b564-ed1f-42a9-a87a-d316a0064481 tempest-ProjectMemberTests-792838276 None] Lock "cinder-quobyte-53db4c9e-aa7a-46a3-90c8-72ec6e3bbf54" released by "_delete_snapshot" :: held 1.561s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:52 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-cde0b564-ed1f-42a9-a87a-d316a0064481 tempest-ProjectMemberTests-792838276 None] Lock "cinder-quobyte-b1dfd0ca-5069-48d2-9505-d64b85469c0b" released by "delete_snapshot" :: held 1.592s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:53 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-cde0b564-ed1f-42a9-a87a-d316a0064481 tempest-ProjectMemberTests-792838276 None] Created reservations ['6588f390-c87e-4196-83bc-acddb5d8c881', 'a1545546-2867-45af-b5e3-7e6b1e2ef7b2', 'a779e043-244f-4c75-804f-39404c5b8d0a', 'c092af05-84d3-4e82-883a-a06dedc5d66d'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:58:53 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-cde0b564-ed1f-42a9-a87a-d316a0064481 tempest-ProjectMemberTests-792838276 None] Delete snapshot completed successfully. Aug 11 04:58:53 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-cde0b564-ed1f-42a9-a87a-d316a0064481 tempest-ProjectMemberTests-792838276 None] Lock "cinder-53db4c9e-aa7a-46a3-90c8-72ec6e3bbf54-delete_snapshot" released by "delete_snapshot" :: held 1.744s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8adb77cb-3ed1-444e-ab8b-7e94a4868d20 tempest-ProjectReaderTests-692176530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8adb77cb-3ed1-444e-ab8b-7e94a4868d20 tempest-ProjectReaderTests-692176530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:53 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-8adb77cb-3ed1-444e-ab8b-7e94a4868d20 tempest-ProjectReaderTests-692176530 None] Creating offline snapshot 3f7cdda2-9d02-49d5-acf8-860ae74d2c02 of volume eba9389d-4451-4eac-90d5-a28e44b704b7 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 04:58:53 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3840ac-158d-4fde-9bec-d9944aa8cebb]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:58:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8adb77cb-3ed1-444e-ab8b-7e94a4868d20 tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-eba9389d-4451-4eac-90d5-a28e44b704b7 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:53 devstack sudo[116551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-eba9389d-4451-4eac-90d5-a28e44b704b7 Aug 11 04:58:53 devstack sudo[116551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:53 devstack sudo[116551]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8adb77cb-3ed1-444e-ab8b-7e94a4868d20 tempest-ProjectReaderTests-692176530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-eba9389d-4451-4eac-90d5-a28e44b704b7" returned: 0 in 0.366s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8adb77cb-3ed1-444e-ab8b-7e94a4868d20 tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-eba9389d-4451-4eac-90d5-a28e44b704b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-eba9389d-4451-4eac-90d5-a28e44b704b7.3f7cdda2-9d02-49d5-acf8-860ae74d2c02 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:53 devstack sudo[116557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-eba9389d-4451-4eac-90d5-a28e44b704b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-eba9389d-4451-4eac-90d5-a28e44b704b7.3f7cdda2-9d02-49d5-acf8-860ae74d2c02 1G Aug 11 04:58:53 devstack sudo[116557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:53 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-68717bd3-585e-471d-87a6-bfc46c5a6d15 tempest-ProjectMemberTests-792838276 None] Acquiring lock "cinder-b1dfd0ca-5069-48d2-9505-d64b85469c0b-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:53 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-68717bd3-585e-471d-87a6-bfc46c5a6d15 tempest-ProjectMemberTests-792838276 None] Lock "cinder-b1dfd0ca-5069-48d2-9505-d64b85469c0b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:53 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-68717bd3-585e-471d-87a6-bfc46c5a6d15 tempest-ProjectMemberTests-792838276 None] Acquiring lock "cinder-quobyte-b1dfd0ca-5069-48d2-9505-d64b85469c0b" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:53 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-68717bd3-585e-471d-87a6-bfc46c5a6d15 tempest-ProjectMemberTests-792838276 None] Lock "cinder-quobyte-b1dfd0ca-5069-48d2-9505-d64b85469c0b" acquired by "delete_volume" :: waited 0.017s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:53 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7e1187-6be8-4232-abe4-4f6e9da6d856]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:58:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-68717bd3-585e-471d-87a6-bfc46c5a6d15 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:53 devstack sudo[116557]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8adb77cb-3ed1-444e-ab8b-7e94a4868d20 tempest-ProjectReaderTests-692176530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-eba9389d-4451-4eac-90d5-a28e44b704b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-eba9389d-4451-4eac-90d5-a28e44b704b7.3f7cdda2-9d02-49d5-acf8-860ae74d2c02 1G" returned: 0 in 0.437s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8adb77cb-3ed1-444e-ab8b-7e94a4868d20 tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eba9389d-4451-4eac-90d5-a28e44b704b7 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-eba9389d-4451-4eac-90d5-a28e44b704b7.3f7cdda2-9d02-49d5-acf8-860ae74d2c02 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:53 devstack sudo[116564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eba9389d-4451-4eac-90d5-a28e44b704b7 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-eba9389d-4451-4eac-90d5-a28e44b704b7.3f7cdda2-9d02-49d5-acf8-860ae74d2c02 Aug 11 04:58:53 devstack sudo[116564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:53 devstack sudo[116563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b Aug 11 04:58:53 devstack sudo[116563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:54 devstack sudo[116563]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-68717bd3-585e-471d-87a6-bfc46c5a6d15 tempest-ProjectMemberTests-792838276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b" returned: 0 in 0.365s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-68717bd3-585e-471d-87a6-bfc46c5a6d15 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:54 devstack sudo[116564]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:54 devstack sudo[116573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b Aug 11 04:58:54 devstack sudo[116573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8adb77cb-3ed1-444e-ab8b-7e94a4868d20 tempest-ProjectReaderTests-692176530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eba9389d-4451-4eac-90d5-a28e44b704b7 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-eba9389d-4451-4eac-90d5-a28e44b704b7.3f7cdda2-9d02-49d5-acf8-860ae74d2c02" returned: 0 in 0.306s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:54 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-8adb77cb-3ed1-444e-ab8b-7e94a4868d20 tempest-ProjectReaderTests-692176530 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-eba9389d-4451-4eac-90d5-a28e44b704b7.3f7cdda2-9d02-49d5-acf8-860ae74d2c02 is being set with open permissions: ugo+rw Aug 11 04:58:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8adb77cb-3ed1-444e-ab8b-7e94a4868d20 tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-eba9389d-4451-4eac-90d5-a28e44b704b7.3f7cdda2-9d02-49d5-acf8-860ae74d2c02 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:54 devstack sudo[116575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-eba9389d-4451-4eac-90d5-a28e44b704b7.3f7cdda2-9d02-49d5-acf8-860ae74d2c02 Aug 11 04:58:54 devstack sudo[116575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:54 devstack sudo[116573]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-68717bd3-585e-471d-87a6-bfc46c5a6d15 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b1dfd0ca-5069-48d2-9505-d64b85469c0b" returned: 0 in 0.245s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:54 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-68717bd3-585e-471d-87a6-bfc46c5a6d15 tempest-ProjectMemberTests-792838276 None] Lock "cinder-quobyte-b1dfd0ca-5069-48d2-9505-d64b85469c0b" released by "delete_volume" :: held 0.665s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:54 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=188,cinder:INSERT=84,cinder:UPDATE=256,cinder:DELETE=22 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:58:54 devstack sudo[116575]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8adb77cb-3ed1-444e-ab8b-7e94a4868d20 tempest-ProjectReaderTests-692176530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-eba9389d-4451-4eac-90d5-a28e44b704b7.3f7cdda2-9d02-49d5-acf8-860ae74d2c02" returned: 0 in 0.249s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8adb77cb-3ed1-444e-ab8b-7e94a4868d20 tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-eba9389d-4451-4eac-90d5-a28e44b704b7.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:54 devstack sudo[116579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-eba9389d-4451-4eac-90d5-a28e44b704b7.info Aug 11 04:58:54 devstack sudo[116579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:54 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-68717bd3-585e-471d-87a6-bfc46c5a6d15 tempest-ProjectMemberTests-792838276 None] Created reservations ['7c9f9799-98d5-4a2a-9cb0-3a0586e70610', '7eda7706-a20a-47be-8a71-c4badedbb93c', '13477dd1-d9e9-498e-8ec9-b9876bc55373', '6f44163d-d68d-4d1e-9007-b52a2aaebb1b'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:58:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-68717bd3-585e-471d-87a6-bfc46c5a6d15 tempest-ProjectMemberTests-792838276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-68717bd3-585e-471d-87a6-bfc46c5a6d15 tempest-ProjectMemberTests-792838276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:54 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-68717bd3-585e-471d-87a6-bfc46c5a6d15 tempest-ProjectMemberTests-792838276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:58:54 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-68717bd3-585e-471d-87a6-bfc46c5a6d15 tempest-ProjectMemberTests-792838276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:58:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-68717bd3-585e-471d-87a6-bfc46c5a6d15 tempest-ProjectMemberTests-792838276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-68717bd3-585e-471d-87a6-bfc46c5a6d15 tempest-ProjectMemberTests-792838276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:54 devstack sudo[116581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:58:54 devstack sudo[116581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:54 devstack sudo[116579]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8adb77cb-3ed1-444e-ab8b-7e94a4868d20 tempest-ProjectReaderTests-692176530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-eba9389d-4451-4eac-90d5-a28e44b704b7.info" returned: 0 in 0.261s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:54 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-8adb77cb-3ed1-444e-ab8b-7e94a4868d20 tempest-ProjectReaderTests-692176530 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-eba9389d-4451-4eac-90d5-a28e44b704b7.info is being set with open permissions: ugo+rw Aug 11 04:58:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8adb77cb-3ed1-444e-ab8b-7e94a4868d20 tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-eba9389d-4451-4eac-90d5-a28e44b704b7.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:54 devstack sudo[116584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-eba9389d-4451-4eac-90d5-a28e44b704b7.info Aug 11 04:58:54 devstack sudo[116584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:54 devstack sudo[116581]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-68717bd3-585e-471d-87a6-bfc46c5a6d15 tempest-ProjectMemberTests-792838276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.258s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:54 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-68717bd3-585e-471d-87a6-bfc46c5a6d15 tempest-ProjectMemberTests-792838276 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:58:54 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-68717bd3-585e-471d-87a6-bfc46c5a6d15 tempest-ProjectMemberTests-792838276 None] Deleted volume successfully. Aug 11 04:58:54 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-68717bd3-585e-471d-87a6-bfc46c5a6d15 tempest-ProjectMemberTests-792838276 None] Lock "cinder-b1dfd0ca-5069-48d2-9505-d64b85469c0b-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:55 devstack sudo[116584]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8adb77cb-3ed1-444e-ab8b-7e94a4868d20 tempest-ProjectReaderTests-692176530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-eba9389d-4451-4eac-90d5-a28e44b704b7.info" returned: 0 in 0.264s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8adb77cb-3ed1-444e-ab8b-7e94a4868d20 tempest-ProjectReaderTests-692176530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.974s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:55 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-8adb77cb-3ed1-444e-ab8b-7e94a4868d20 tempest-ProjectReaderTests-692176530 None] Create snapshot completed successfully Aug 11 04:58:55 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7f13aee0-046a-4d82-830c-44f70697cb07 tempest-ProjectReaderTests-692176530 None] Acquiring lock "cinder-3f7cdda2-9d02-49d5-acf8-860ae74d2c02-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:55 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7f13aee0-046a-4d82-830c-44f70697cb07 tempest-ProjectReaderTests-692176530 None] Lock "cinder-3f7cdda2-9d02-49d5-acf8-860ae74d2c02-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:55 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7f13aee0-046a-4d82-830c-44f70697cb07 tempest-ProjectReaderTests-692176530 None] Acquiring lock "cinder-quobyte-eba9389d-4451-4eac-90d5-a28e44b704b7" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:55 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7f13aee0-046a-4d82-830c-44f70697cb07 tempest-ProjectReaderTests-692176530 None] Lock "cinder-quobyte-eba9389d-4451-4eac-90d5-a28e44b704b7" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:55 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7f13aee0-046a-4d82-830c-44f70697cb07 tempest-ProjectReaderTests-692176530 None] Acquiring lock "cinder-quobyte-3f7cdda2-9d02-49d5-acf8-860ae74d2c02" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:55 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7f13aee0-046a-4d82-830c-44f70697cb07 tempest-ProjectReaderTests-692176530 None] Lock "cinder-quobyte-3f7cdda2-9d02-49d5-acf8-860ae74d2c02" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:55 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-7f13aee0-046a-4d82-830c-44f70697cb07 tempest-ProjectReaderTests-692176530 None] Deleting offline snapshot 3f7cdda2-9d02-49d5-acf8-860ae74d2c02 of volume eba9389d-4451-4eac-90d5-a28e44b704b7 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 04:58:55 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-7f13aee0-046a-4d82-830c-44f70697cb07 tempest-ProjectReaderTests-692176530 None] snapshot_file for this snap is: volume-eba9389d-4451-4eac-90d5-a28e44b704b7.3f7cdda2-9d02-49d5-acf8-860ae74d2c02 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 04:58:55 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a71ae9-f227-45d2-8aec-e6e4f3e1bcc8]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:58:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7f13aee0-046a-4d82-830c-44f70697cb07 tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-eba9389d-4451-4eac-90d5-a28e44b704b7.3f7cdda2-9d02-49d5-acf8-860ae74d2c02 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:55 devstack sudo[116588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-eba9389d-4451-4eac-90d5-a28e44b704b7.3f7cdda2-9d02-49d5-acf8-860ae74d2c02 Aug 11 04:58:55 devstack sudo[116588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:55 devstack sudo[116588]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7f13aee0-046a-4d82-830c-44f70697cb07 tempest-ProjectReaderTests-692176530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-eba9389d-4451-4eac-90d5-a28e44b704b7.3f7cdda2-9d02-49d5-acf8-860ae74d2c02" returned: 0 in 0.367s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:55 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-7f13aee0-046a-4d82-830c-44f70697cb07 tempest-ProjectReaderTests-692176530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eba9389d-4451-4eac-90d5-a28e44b704b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:58:55 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[d589c316-9baf-4b9f-8d6d-ffd2ec22d287]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:58:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7f13aee0-046a-4d82-830c-44f70697cb07 tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-eba9389d-4451-4eac-90d5-a28e44b704b7 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:55 devstack sudo[116593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-eba9389d-4451-4eac-90d5-a28e44b704b7 Aug 11 04:58:55 devstack sudo[116593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:56 devstack sudo[116593]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7f13aee0-046a-4d82-830c-44f70697cb07 tempest-ProjectReaderTests-692176530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-eba9389d-4451-4eac-90d5-a28e44b704b7" returned: 0 in 0.432s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7f13aee0-046a-4d82-830c-44f70697cb07 tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-eba9389d-4451-4eac-90d5-a28e44b704b7.3f7cdda2-9d02-49d5-acf8-860ae74d2c02 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:56 devstack sudo[116599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-eba9389d-4451-4eac-90d5-a28e44b704b7.3f7cdda2-9d02-49d5-acf8-860ae74d2c02 Aug 11 04:58:56 devstack sudo[116599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:56 devstack sudo[116599]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7f13aee0-046a-4d82-830c-44f70697cb07 tempest-ProjectReaderTests-692176530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-eba9389d-4451-4eac-90d5-a28e44b704b7.3f7cdda2-9d02-49d5-acf8-860ae74d2c02" returned: 0 in 0.382s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7f13aee0-046a-4d82-830c-44f70697cb07 tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-eba9389d-4451-4eac-90d5-a28e44b704b7.3f7cdda2-9d02-49d5-acf8-860ae74d2c02 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:56 devstack sudo[116604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-eba9389d-4451-4eac-90d5-a28e44b704b7.3f7cdda2-9d02-49d5-acf8-860ae74d2c02 Aug 11 04:58:56 devstack sudo[116604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:56 devstack sudo[116604]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7f13aee0-046a-4d82-830c-44f70697cb07 tempest-ProjectReaderTests-692176530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-eba9389d-4451-4eac-90d5-a28e44b704b7.3f7cdda2-9d02-49d5-acf8-860ae74d2c02" returned: 0 in 0.259s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:56 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7f13aee0-046a-4d82-830c-44f70697cb07 tempest-ProjectReaderTests-692176530 None] Lock "cinder-quobyte-3f7cdda2-9d02-49d5-acf8-860ae74d2c02" released by "_delete_snapshot" :: held 1.555s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:56 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7f13aee0-046a-4d82-830c-44f70697cb07 tempest-ProjectReaderTests-692176530 None] Lock "cinder-quobyte-eba9389d-4451-4eac-90d5-a28e44b704b7" released by "delete_snapshot" :: held 1.580s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:56 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-7f13aee0-046a-4d82-830c-44f70697cb07 tempest-ProjectReaderTests-692176530 None] Created reservations ['c0b2839e-8039-45f4-a528-136f7427301e', '19af45a8-2c74-47d4-8dfc-54e5c566c59f', 'fd3035fe-9963-47b3-985d-528951e80daf', '58c9e19a-b59e-448b-abf2-01e850a30197'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:58:56 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-7f13aee0-046a-4d82-830c-44f70697cb07 tempest-ProjectReaderTests-692176530 None] Delete snapshot completed successfully. Aug 11 04:58:56 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7f13aee0-046a-4d82-830c-44f70697cb07 tempest-ProjectReaderTests-692176530 None] Lock "cinder-3f7cdda2-9d02-49d5-acf8-860ae74d2c02-delete_snapshot" released by "delete_snapshot" :: held 1.732s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:57 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fa8a9329-c619-4d8e-8cfb-939b4ecf3562 tempest-ProjectReaderTests-692176530 None] Acquiring lock "cinder-eba9389d-4451-4eac-90d5-a28e44b704b7-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:57 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fa8a9329-c619-4d8e-8cfb-939b4ecf3562 tempest-ProjectReaderTests-692176530 None] Lock "cinder-eba9389d-4451-4eac-90d5-a28e44b704b7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:57 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fa8a9329-c619-4d8e-8cfb-939b4ecf3562 tempest-ProjectReaderTests-692176530 None] Acquiring lock "cinder-quobyte-eba9389d-4451-4eac-90d5-a28e44b704b7" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:58:57 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fa8a9329-c619-4d8e-8cfb-939b4ecf3562 tempest-ProjectReaderTests-692176530 None] Lock "cinder-quobyte-eba9389d-4451-4eac-90d5-a28e44b704b7" acquired by "delete_volume" :: waited 0.014s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:58:57 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[24cd0703-59a9-448d-afc4-55ea6494fd8c]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:58:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fa8a9329-c619-4d8e-8cfb-939b4ecf3562 tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-eba9389d-4451-4eac-90d5-a28e44b704b7 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:57 devstack sudo[116607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-eba9389d-4451-4eac-90d5-a28e44b704b7 Aug 11 04:58:57 devstack sudo[116607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:57 devstack sudo[116607]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fa8a9329-c619-4d8e-8cfb-939b4ecf3562 tempest-ProjectReaderTests-692176530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-eba9389d-4451-4eac-90d5-a28e44b704b7" returned: 0 in 0.402s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fa8a9329-c619-4d8e-8cfb-939b4ecf3562 tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-eba9389d-4451-4eac-90d5-a28e44b704b7 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:57 devstack sudo[116612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-eba9389d-4451-4eac-90d5-a28e44b704b7 Aug 11 04:58:57 devstack sudo[116612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:58 devstack sudo[116612]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fa8a9329-c619-4d8e-8cfb-939b4ecf3562 tempest-ProjectReaderTests-692176530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-eba9389d-4451-4eac-90d5-a28e44b704b7" returned: 0 in 0.265s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:58 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fa8a9329-c619-4d8e-8cfb-939b4ecf3562 tempest-ProjectReaderTests-692176530 None] Lock "cinder-quobyte-eba9389d-4451-4eac-90d5-a28e44b704b7" released by "delete_volume" :: held 0.737s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:58 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-fa8a9329-c619-4d8e-8cfb-939b4ecf3562 tempest-ProjectReaderTests-692176530 None] Created reservations ['f463a74b-9200-43fd-ae21-b9e7ac331a3d', '7ea6a8db-f1ef-4418-8cca-2f42335eaa86', '96ba81df-21fd-44fd-9c91-d6a99bd6537b', '141e6dac-3801-4df9-b95f-96236e872194'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:58:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fa8a9329-c619-4d8e-8cfb-939b4ecf3562 tempest-ProjectReaderTests-692176530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fa8a9329-c619-4d8e-8cfb-939b4ecf3562 tempest-ProjectReaderTests-692176530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-fa8a9329-c619-4d8e-8cfb-939b4ecf3562 tempest-ProjectReaderTests-692176530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:58:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-fa8a9329-c619-4d8e-8cfb-939b4ecf3562 tempest-ProjectReaderTests-692176530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:58:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fa8a9329-c619-4d8e-8cfb-939b4ecf3562 tempest-ProjectReaderTests-692176530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fa8a9329-c619-4d8e-8cfb-939b4ecf3562 tempest-ProjectReaderTests-692176530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:58 devstack sudo[116615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:58:58 devstack sudo[116615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:58 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 04:58:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:58:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:58:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:58:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:58:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:58:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:58:58 devstack sudo[116617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:58:58 devstack sudo[116617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:58:58 devstack sudo[116615]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fa8a9329-c619-4d8e-8cfb-939b4ecf3562 tempest-ProjectReaderTests-692176530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.356s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:58 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-fa8a9329-c619-4d8e-8cfb-939b4ecf3562 tempest-ProjectReaderTests-692176530 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:58:58 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-fa8a9329-c619-4d8e-8cfb-939b4ecf3562 tempest-ProjectReaderTests-692176530 None] Deleted volume successfully. Aug 11 04:58:58 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fa8a9329-c619-4d8e-8cfb-939b4ecf3562 tempest-ProjectReaderTests-692176530 None] Lock "cinder-eba9389d-4451-4eac-90d5-a28e44b704b7-delete_volume" released by "delete_volume" :: held 1.332s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:58:58 devstack sudo[116617]: pam_unix(sudo:session): session closed for user root Aug 11 04:58:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.402s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:58:58 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:58:58 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] Running periodic task VolumeManager._thread_info {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 04:58:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] thread count: 28 {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 11 04:58:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4fc379da-aa98-49b4-8066-ed22b74684d8 None None] thread info: [<_MainThread(MainThread, started 133315846115456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 11 04:59:08 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:INSERT=6,cinder:UPDATE=21,cinder:DELETE=1,cinder:SELECT=11 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:59:08 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:UPDATE=268,cinder:SELECT=212,cinder:INSERT=65,cinder:DELETE=22 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:59:16 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-0aa5f483-070b-4083-ae2b-de8a444e9ca0 tempest-SnapshotDependencyTests-100115998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:59:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0aa5f483-070b-4083-ae2b-de8a444e9ca0 tempest-SnapshotDependencyTests-100115998 None] Flow 'volume_create_manager' (d7f0e860-8f5e-4ea2-8145-aca5cb5c834e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:59:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0aa5f483-070b-4083-ae2b-de8a444e9ca0 tempest-SnapshotDependencyTests-100115998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4ac997b-1322-4949-a246-3c6da2cf3f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:59:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0aa5f483-070b-4083-ae2b-de8a444e9ca0 tempest-SnapshotDependencyTests-100115998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4ac997b-1322-4949-a246-3c6da2cf3f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:59:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-343947004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4aaca3e-6204-4bad-9577-a1646e8cd573,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ab69cb071914b9badc6a0387c7eaa59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:59:17Z,use_quota=True,user_id='c84a370cb74e4beebf8602790eecc524',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:59:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0aa5f483-070b-4083-ae2b-de8a444e9ca0 tempest-SnapshotDependencyTests-100115998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21536f71-80a1-4b5a-a992-7517961d5092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:59:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0aa5f483-070b-4083-ae2b-de8a444e9ca0 tempest-SnapshotDependencyTests-100115998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21536f71-80a1-4b5a-a992-7517961d5092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:59:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0aa5f483-070b-4083-ae2b-de8a444e9ca0 tempest-SnapshotDependencyTests-100115998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7e45eed-6310-444a-90e6-96fa96e6f374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:59:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0aa5f483-070b-4083-ae2b-de8a444e9ca0 tempest-SnapshotDependencyTests-100115998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7e45eed-6310-444a-90e6-96fa96e6f374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4aaca3e-6204-4bad-9577-a1646e8cd573', 'volume_name': 'volume-b4aaca3e-6204-4bad-9577-a1646e8cd573', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:59:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0aa5f483-070b-4083-ae2b-de8a444e9ca0 tempest-SnapshotDependencyTests-100115998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9e89b58-a6ef-4d68-8c04-0d97c28308d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:59:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0aa5f483-070b-4083-ae2b-de8a444e9ca0 tempest-SnapshotDependencyTests-100115998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9e89b58-a6ef-4d68-8c04-0d97c28308d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:59:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0aa5f483-070b-4083-ae2b-de8a444e9ca0 tempest-SnapshotDependencyTests-100115998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8de9955f-68cf-4931-80a0-3fb6faf58a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:59:16 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-0aa5f483-070b-4083-ae2b-de8a444e9ca0 tempest-SnapshotDependencyTests-100115998 None] Volume b4aaca3e-6204-4bad-9577-a1646e8cd573: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4aaca3e-6204-4bad-9577-a1646e8cd573', 'volume_size': 1} Aug 11 04:59:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0aa5f483-070b-4083-ae2b-de8a444e9ca0 tempest-SnapshotDependencyTests-100115998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:59:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0aa5f483-070b-4083-ae2b-de8a444e9ca0 tempest-SnapshotDependencyTests-100115998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:59:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0aa5f483-070b-4083-ae2b-de8a444e9ca0 tempest-SnapshotDependencyTests-100115998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:59:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-343947004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4aaca3e-6204-4bad-9577-a1646e8cd573,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ab69cb071914b9badc6a0387c7eaa59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:59:17Z,use_quota=True,user_id='c84a370cb74e4beebf8602790eecc524',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 04:59:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-0aa5f483-070b-4083-ae2b-de8a444e9ca0 tempest-SnapshotDependencyTests-100115998 None] Creating volume b4aaca3e-6204-4bad-9577-a1646e8cd573 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 04:59:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0aa5f483-070b-4083-ae2b-de8a444e9ca0 tempest-SnapshotDependencyTests-100115998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:59:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0aa5f483-070b-4083-ae2b-de8a444e9ca0 tempest-SnapshotDependencyTests-100115998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:59:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0aa5f483-070b-4083-ae2b-de8a444e9ca0 tempest-SnapshotDependencyTests-100115998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:59:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0aa5f483-070b-4083-ae2b-de8a444e9ca0 tempest-SnapshotDependencyTests-100115998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:59:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0aa5f483-070b-4083-ae2b-de8a444e9ca0 tempest-SnapshotDependencyTests-100115998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:59:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0aa5f483-070b-4083-ae2b-de8a444e9ca0 tempest-SnapshotDependencyTests-100115998 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:59:16 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-0aa5f483-070b-4083-ae2b-de8a444e9ca0 tempest-SnapshotDependencyTests-100115998 None] casted to osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd Aug 11 04:59:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0aa5f483-070b-4083-ae2b-de8a444e9ca0 tempest-SnapshotDependencyTests-100115998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:59:16 devstack sudo[116625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573 1073741824 Aug 11 04:59:16 devstack sudo[116625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:59:17 devstack sudo[116625]: pam_unix(sudo:session): session closed for user root Aug 11 04:59:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0aa5f483-070b-4083-ae2b-de8a444e9ca0 tempest-SnapshotDependencyTests-100115998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573 1073741824" returned: 0 in 0.439s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:59:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0aa5f483-070b-4083-ae2b-de8a444e9ca0 tempest-SnapshotDependencyTests-100115998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:59:17 devstack sudo[116631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573 Aug 11 04:59:17 devstack sudo[116631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:59:17 devstack sudo[116631]: pam_unix(sudo:session): session closed for user root Aug 11 04:59:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0aa5f483-070b-4083-ae2b-de8a444e9ca0 tempest-SnapshotDependencyTests-100115998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573" returned: 0 in 0.237s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:59:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0aa5f483-070b-4083-ae2b-de8a444e9ca0 tempest-SnapshotDependencyTests-100115998 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 04:59:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0aa5f483-070b-4083-ae2b-de8a444e9ca0 tempest-SnapshotDependencyTests-100115998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:59:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0aa5f483-070b-4083-ae2b-de8a444e9ca0 tempest-SnapshotDependencyTests-100115998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8de9955f-68cf-4931-80a0-3fb6faf58a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4aaca3e-6204-4bad-9577-a1646e8cd573', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:59:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0aa5f483-070b-4083-ae2b-de8a444e9ca0 tempest-SnapshotDependencyTests-100115998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19470c2f-9387-44fa-a51e-83ef116cc936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:59:17 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-0aa5f483-070b-4083-ae2b-de8a444e9ca0 tempest-SnapshotDependencyTests-100115998 None] Volume volume-b4aaca3e-6204-4bad-9577-a1646e8cd573 (b4aaca3e-6204-4bad-9577-a1646e8cd573): created successfully Aug 11 04:59:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0aa5f483-070b-4083-ae2b-de8a444e9ca0 tempest-SnapshotDependencyTests-100115998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19470c2f-9387-44fa-a51e-83ef116cc936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:59:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0aa5f483-070b-4083-ae2b-de8a444e9ca0 tempest-SnapshotDependencyTests-100115998 None] Flow 'volume_create_manager' (d7f0e860-8f5e-4ea2-8145-aca5cb5c834e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:59:17 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-0aa5f483-070b-4083-ae2b-de8a444e9ca0 tempest-SnapshotDependencyTests-100115998 None] Created volume successfully. Aug 11 04:59:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0db210b5-7466-4b75-a57d-8e4549249696 tempest-SnapshotDependencyTests-100115998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:59:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0db210b5-7466-4b75-a57d-8e4549249696 tempest-SnapshotDependencyTests-100115998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:59:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-0db210b5-7466-4b75-a57d-8e4549249696 tempest-SnapshotDependencyTests-100115998 None] Creating offline snapshot db7c94d8-059e-4417-8d26-3a9e7a78dca9 of volume b4aaca3e-6204-4bad-9577-a1646e8cd573 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 04:59:17 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[534b65d3-5965-452b-870d-b119846b67de]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:59:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0db210b5-7466-4b75-a57d-8e4549249696 tempest-SnapshotDependencyTests-100115998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:59:18 devstack sudo[116634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573 Aug 11 04:59:18 devstack sudo[116634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:59:18 devstack sudo[116634]: pam_unix(sudo:session): session closed for user root Aug 11 04:59:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0db210b5-7466-4b75-a57d-8e4549249696 tempest-SnapshotDependencyTests-100115998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573" returned: 0 in 0.358s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:59:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0db210b5-7466-4b75-a57d-8e4549249696 tempest-SnapshotDependencyTests-100115998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573.db7c94d8-059e-4417-8d26-3a9e7a78dca9 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:59:18 devstack sudo[116639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573.db7c94d8-059e-4417-8d26-3a9e7a78dca9 1G Aug 11 04:59:18 devstack sudo[116639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:59:18 devstack sudo[116639]: pam_unix(sudo:session): session closed for user root Aug 11 04:59:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0db210b5-7466-4b75-a57d-8e4549249696 tempest-SnapshotDependencyTests-100115998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573.db7c94d8-059e-4417-8d26-3a9e7a78dca9 1G" returned: 0 in 0.411s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:59:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0db210b5-7466-4b75-a57d-8e4549249696 tempest-SnapshotDependencyTests-100115998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4aaca3e-6204-4bad-9577-a1646e8cd573 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573.db7c94d8-059e-4417-8d26-3a9e7a78dca9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:59:18 devstack sudo[116644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4aaca3e-6204-4bad-9577-a1646e8cd573 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573.db7c94d8-059e-4417-8d26-3a9e7a78dca9 Aug 11 04:59:18 devstack sudo[116644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:59:19 devstack sudo[116644]: pam_unix(sudo:session): session closed for user root Aug 11 04:59:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0db210b5-7466-4b75-a57d-8e4549249696 tempest-SnapshotDependencyTests-100115998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4aaca3e-6204-4bad-9577-a1646e8cd573 -F qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573.db7c94d8-059e-4417-8d26-3a9e7a78dca9" returned: 0 in 0.323s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:59:19 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-0db210b5-7466-4b75-a57d-8e4549249696 tempest-SnapshotDependencyTests-100115998 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573.db7c94d8-059e-4417-8d26-3a9e7a78dca9 is being set with open permissions: ugo+rw Aug 11 04:59:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0db210b5-7466-4b75-a57d-8e4549249696 tempest-SnapshotDependencyTests-100115998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573.db7c94d8-059e-4417-8d26-3a9e7a78dca9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:59:19 devstack sudo[116649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573.db7c94d8-059e-4417-8d26-3a9e7a78dca9 Aug 11 04:59:19 devstack sudo[116649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:59:19 devstack sudo[116649]: pam_unix(sudo:session): session closed for user root Aug 11 04:59:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0db210b5-7466-4b75-a57d-8e4549249696 tempest-SnapshotDependencyTests-100115998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573.db7c94d8-059e-4417-8d26-3a9e7a78dca9" returned: 0 in 0.276s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:59:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0db210b5-7466-4b75-a57d-8e4549249696 tempest-SnapshotDependencyTests-100115998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:59:19 devstack sudo[116652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573.info Aug 11 04:59:19 devstack sudo[116652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:59:19 devstack sudo[116652]: pam_unix(sudo:session): session closed for user root Aug 11 04:59:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0db210b5-7466-4b75-a57d-8e4549249696 tempest-SnapshotDependencyTests-100115998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573.info" returned: 0 in 0.249s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:59:19 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-0db210b5-7466-4b75-a57d-8e4549249696 tempest-SnapshotDependencyTests-100115998 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573.info is being set with open permissions: ugo+rw Aug 11 04:59:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0db210b5-7466-4b75-a57d-8e4549249696 tempest-SnapshotDependencyTests-100115998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:59:19 devstack sudo[116655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573.info Aug 11 04:59:19 devstack sudo[116655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:59:19 devstack sudo[116655]: pam_unix(sudo:session): session closed for user root Aug 11 04:59:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0db210b5-7466-4b75-a57d-8e4549249696 tempest-SnapshotDependencyTests-100115998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573.info" returned: 0 in 0.260s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:59:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0db210b5-7466-4b75-a57d-8e4549249696 tempest-SnapshotDependencyTests-100115998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.964s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:59:19 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-0db210b5-7466-4b75-a57d-8e4549249696 tempest-SnapshotDependencyTests-100115998 None] Create snapshot completed successfully Aug 11 04:59:20 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-87aaa233-1c8f-427a-9ece-49a19426cf54 tempest-SnapshotDependencyTests-100115998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 04:59:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87aaa233-1c8f-427a-9ece-49a19426cf54 tempest-SnapshotDependencyTests-100115998 None] Flow 'volume_create_manager' (09602de4-e28c-420f-854e-6f163fde5ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:59:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87aaa233-1c8f-427a-9ece-49a19426cf54 tempest-SnapshotDependencyTests-100115998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bc1d803-7184-4ee6-8259-9df2494861e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:59:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87aaa233-1c8f-427a-9ece-49a19426cf54 tempest-SnapshotDependencyTests-100115998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bc1d803-7184-4ee6-8259-9df2494861e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T02:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a652927d-bd29-4219-bfb0-9a1dc2e9560e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ab69cb071914b9badc6a0387c7eaa59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T02:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=db7c94d8-059e-4417-8d26-3a9e7a78dca9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T02:59:21Z,use_quota=True,user_id='c84a370cb74e4beebf8602790eecc524',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea50e5ab-df42-438b-b697-81a1f1cdb006),volume_type_id=ea50e5ab-df42-438b-b697-81a1f1cdb006)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:59:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87aaa233-1c8f-427a-9ece-49a19426cf54 tempest-SnapshotDependencyTests-100115998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1712b498-d2fd-44d6-b0ed-55895e340581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:59:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87aaa233-1c8f-427a-9ece-49a19426cf54 tempest-SnapshotDependencyTests-100115998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1712b498-d2fd-44d6-b0ed-55895e340581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:59:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87aaa233-1c8f-427a-9ece-49a19426cf54 tempest-SnapshotDependencyTests-100115998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0afce099-422c-41cb-9e65-6ec445b00521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:59:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87aaa233-1c8f-427a-9ece-49a19426cf54 tempest-SnapshotDependencyTests-100115998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0afce099-422c-41cb-9e65-6ec445b00521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a652927d-bd29-4219-bfb0-9a1dc2e9560e', 'volume_name': 'volume-a652927d-bd29-4219-bfb0-9a1dc2e9560e', 'volume_size': 1, 'snapshot_id': 'db7c94d8-059e-4417-8d26-3a9e7a78dca9'}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:59:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87aaa233-1c8f-427a-9ece-49a19426cf54 tempest-SnapshotDependencyTests-100115998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b93a7584-9a15-4a6e-9e7c-59708be5f8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:59:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87aaa233-1c8f-427a-9ece-49a19426cf54 tempest-SnapshotDependencyTests-100115998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b93a7584-9a15-4a6e-9e7c-59708be5f8ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:59:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87aaa233-1c8f-427a-9ece-49a19426cf54 tempest-SnapshotDependencyTests-100115998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71108058-092d-428c-985e-6bed4c63a28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:59:20 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-87aaa233-1c8f-427a-9ece-49a19426cf54 tempest-SnapshotDependencyTests-100115998 None] Volume a652927d-bd29-4219-bfb0-9a1dc2e9560e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a652927d-bd29-4219-bfb0-9a1dc2e9560e', 'volume_size': 1, 'snapshot_id': 'db7c94d8-059e-4417-8d26-3a9e7a78dca9'} Aug 11 04:59:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87aaa233-1c8f-427a-9ece-49a19426cf54 tempest-SnapshotDependencyTests-100115998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:59:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87aaa233-1c8f-427a-9ece-49a19426cf54 tempest-SnapshotDependencyTests-100115998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:59:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-87aaa233-1c8f-427a-9ece-49a19426cf54 tempest-SnapshotDependencyTests-100115998 None] Acquiring lock "cinder-quobyte-db7c94d8-059e-4417-8d26-3a9e7a78dca9-a652927d-bd29-4219-bfb0-9a1dc2e9560e" by "_create_volume_from_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:59:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-87aaa233-1c8f-427a-9ece-49a19426cf54 tempest-SnapshotDependencyTests-100115998 None] Lock "cinder-quobyte-db7c94d8-059e-4417-8d26-3a9e7a78dca9-a652927d-bd29-4219-bfb0-9a1dc2e9560e" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:59:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87aaa233-1c8f-427a-9ece-49a19426cf54 tempest-SnapshotDependencyTests-100115998 None] Creating volume a652927d-bd29-4219-bfb0-9a1dc2e9560e from snapshot db7c94d8-059e-4417-8d26-3a9e7a78dca9 {{(pid=94472) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 11 04:59:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87aaa233-1c8f-427a-9ece-49a19426cf54 tempest-SnapshotDependencyTests-100115998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:59:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87aaa233-1c8f-427a-9ece-49a19426cf54 tempest-SnapshotDependencyTests-100115998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:59:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87aaa233-1c8f-427a-9ece-49a19426cf54 tempest-SnapshotDependencyTests-100115998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:59:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87aaa233-1c8f-427a-9ece-49a19426cf54 tempest-SnapshotDependencyTests-100115998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:59:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87aaa233-1c8f-427a-9ece-49a19426cf54 tempest-SnapshotDependencyTests-100115998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:59:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87aaa233-1c8f-427a-9ece-49a19426cf54 tempest-SnapshotDependencyTests-100115998 None] Selected osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 04:59:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-87aaa233-1c8f-427a-9ece-49a19426cf54 tempest-SnapshotDependencyTests-100115998 None] Acquiring lock "cinder-quobyte-a652927d-bd29-4219-bfb0-9a1dc2e9560e" by "_copy_volume_from_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:59:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-87aaa233-1c8f-427a-9ece-49a19426cf54 tempest-SnapshotDependencyTests-100115998 None] Lock "cinder-quobyte-a652927d-bd29-4219-bfb0-9a1dc2e9560e" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:59:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87aaa233-1c8f-427a-9ece-49a19426cf54 tempest-SnapshotDependencyTests-100115998 None] snapshot: db7c94d8-059e-4417-8d26-3a9e7a78dca9, volume: a652927d-bd29-4219-bfb0-9a1dc2e9560e, {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 11 04:59:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87aaa233-1c8f-427a-9ece-49a19426cf54 tempest-SnapshotDependencyTests-100115998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:59:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87aaa233-1c8f-427a-9ece-49a19426cf54 tempest-SnapshotDependencyTests-100115998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:59:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87aaa233-1c8f-427a-9ece-49a19426cf54 tempest-SnapshotDependencyTests-100115998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:59:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87aaa233-1c8f-427a-9ece-49a19426cf54 tempest-SnapshotDependencyTests-100115998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:59:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87aaa233-1c8f-427a-9ece-49a19426cf54 tempest-SnapshotDependencyTests-100115998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:59:20 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e27102f-c22b-4acd-afee-581ae83c223e]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:59:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87aaa233-1c8f-427a-9ece-49a19426cf54 tempest-SnapshotDependencyTests-100115998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573.db7c94d8-059e-4417-8d26-3a9e7a78dca9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:59:20 devstack sudo[116658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573.db7c94d8-059e-4417-8d26-3a9e7a78dca9 Aug 11 04:59:20 devstack sudo[116658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:59:21 devstack sudo[116658]: pam_unix(sudo:session): session closed for user root Aug 11 04:59:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87aaa233-1c8f-427a-9ece-49a19426cf54 tempest-SnapshotDependencyTests-100115998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573.db7c94d8-059e-4417-8d26-3a9e7a78dca9" returned: 0 in 0.360s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:59:21 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-87aaa233-1c8f-427a-9ece-49a19426cf54 tempest-SnapshotDependencyTests-100115998 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4aaca3e-6204-4bad-9577-a1646e8cd573(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:59:21 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c6c5e6-5e6a-4180-b797-603d099453a8]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:59:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87aaa233-1c8f-427a-9ece-49a19426cf54 tempest-SnapshotDependencyTests-100115998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:59:21 devstack sudo[116663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573 Aug 11 04:59:21 devstack sudo[116663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:59:21 devstack sudo[116663]: pam_unix(sudo:session): session closed for user root Aug 11 04:59:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87aaa233-1c8f-427a-9ece-49a19426cf54 tempest-SnapshotDependencyTests-100115998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573" returned: 0 in 0.363s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:59:21 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87aaa233-1c8f-427a-9ece-49a19426cf54 tempest-SnapshotDependencyTests-100115998 None] will copy from snapshot at /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573 {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 11 04:59:21 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87aaa233-1c8f-427a-9ece-49a19426cf54 tempest-SnapshotDependencyTests-100115998 None] Creating direct copy from snapshot {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 11 04:59:21 devstack cinder-volume[94472]: DEBUG cinder.utils [None req-87aaa233-1c8f-427a-9ece-49a19426cf54 tempest-SnapshotDependencyTests-100115998 None] Path /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a652927d-bd29-4219-bfb0-9a1dc2e9560e not found in is_blk_device check {{(pid=94472) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 11 04:59:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87aaa233-1c8f-427a-9ece-49a19426cf54 tempest-SnapshotDependencyTests-100115998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a652927d-bd29-4219-bfb0-9a1dc2e9560e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:59:21 devstack sudo[116678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a652927d-bd29-4219-bfb0-9a1dc2e9560e Aug 11 04:59:21 devstack sudo[116678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:59:25 devstack sudo[116678]: pam_unix(sudo:session): session closed for user root Aug 11 04:59:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87aaa233-1c8f-427a-9ece-49a19426cf54 tempest-SnapshotDependencyTests-100115998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a652927d-bd29-4219-bfb0-9a1dc2e9560e" returned: 0 in 4.147s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:59:25 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-87aaa233-1c8f-427a-9ece-49a19426cf54 tempest-SnapshotDependencyTests-100115998 None] Image conversion details: src /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573, size 1024.00 MB, duration 4.15 sec, destination /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a652927d-bd29-4219-bfb0-9a1dc2e9560e {{(pid=94472) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 11 04:59:25 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-87aaa233-1c8f-427a-9ece-49a19426cf54 tempest-SnapshotDependencyTests-100115998 None] Converted 1024.00 MB image at 246.88 MB/s Aug 11 04:59:25 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-87aaa233-1c8f-427a-9ece-49a19426cf54 tempest-SnapshotDependencyTests-100115998 None] /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a652927d-bd29-4219-bfb0-9a1dc2e9560e is being set with open permissions: ugo+rw Aug 11 04:59:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87aaa233-1c8f-427a-9ece-49a19426cf54 tempest-SnapshotDependencyTests-100115998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a652927d-bd29-4219-bfb0-9a1dc2e9560e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:59:25 devstack sudo[116724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a652927d-bd29-4219-bfb0-9a1dc2e9560e Aug 11 04:59:25 devstack sudo[116724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:59:25 devstack sudo[116724]: pam_unix(sudo:session): session closed for user root Aug 11 04:59:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87aaa233-1c8f-427a-9ece-49a19426cf54 tempest-SnapshotDependencyTests-100115998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a652927d-bd29-4219-bfb0-9a1dc2e9560e" returned: 0 in 0.245s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:59:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-87aaa233-1c8f-427a-9ece-49a19426cf54 tempest-SnapshotDependencyTests-100115998 None] Lock "cinder-quobyte-a652927d-bd29-4219-bfb0-9a1dc2e9560e" released by "_copy_volume_from_snapshot" :: held 5.194s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:59:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-87aaa233-1c8f-427a-9ece-49a19426cf54 tempest-SnapshotDependencyTests-100115998 None] Lock "cinder-quobyte-db7c94d8-059e-4417-8d26-3a9e7a78dca9-a652927d-bd29-4219-bfb0-9a1dc2e9560e" released by "_create_volume_from_snapshot" :: held 5.259s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:59:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87aaa233-1c8f-427a-9ece-49a19426cf54 tempest-SnapshotDependencyTests-100115998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.278s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:59:25 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87aaa233-1c8f-427a-9ece-49a19426cf54 tempest-SnapshotDependencyTests-100115998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71108058-092d-428c-985e-6bed4c63a28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a652927d-bd29-4219-bfb0-9a1dc2e9560e', 'volume_size': 1, 'snapshot_id': 'db7c94d8-059e-4417-8d26-3a9e7a78dca9'}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:59:25 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87aaa233-1c8f-427a-9ece-49a19426cf54 tempest-SnapshotDependencyTests-100115998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b040ec5-f357-430f-b142-d934be7ccf75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 04:59:25 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-87aaa233-1c8f-427a-9ece-49a19426cf54 tempest-SnapshotDependencyTests-100115998 None] Volume volume-a652927d-bd29-4219-bfb0-9a1dc2e9560e (a652927d-bd29-4219-bfb0-9a1dc2e9560e): created successfully Aug 11 04:59:25 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87aaa233-1c8f-427a-9ece-49a19426cf54 tempest-SnapshotDependencyTests-100115998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b040ec5-f357-430f-b142-d934be7ccf75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 04:59:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87aaa233-1c8f-427a-9ece-49a19426cf54 tempest-SnapshotDependencyTests-100115998 None] Flow 'volume_create_manager' (09602de4-e28c-420f-854e-6f163fde5ec8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 04:59:26 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-87aaa233-1c8f-427a-9ece-49a19426cf54 tempest-SnapshotDependencyTests-100115998 None] Created volume successfully. Aug 11 04:59:27 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9d6084aa-417e-45c3-baae-53b8bfe63a80 tempest-SnapshotDependencyTests-100115998 None] Acquiring lock "cinder-db7c94d8-059e-4417-8d26-3a9e7a78dca9-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:59:27 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9d6084aa-417e-45c3-baae-53b8bfe63a80 tempest-SnapshotDependencyTests-100115998 None] Lock "cinder-db7c94d8-059e-4417-8d26-3a9e7a78dca9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:59:27 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9d6084aa-417e-45c3-baae-53b8bfe63a80 tempest-SnapshotDependencyTests-100115998 None] Acquiring lock "cinder-quobyte-b4aaca3e-6204-4bad-9577-a1646e8cd573" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:59:27 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9d6084aa-417e-45c3-baae-53b8bfe63a80 tempest-SnapshotDependencyTests-100115998 None] Lock "cinder-quobyte-b4aaca3e-6204-4bad-9577-a1646e8cd573" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:59:27 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9d6084aa-417e-45c3-baae-53b8bfe63a80 tempest-SnapshotDependencyTests-100115998 None] Acquiring lock "cinder-quobyte-db7c94d8-059e-4417-8d26-3a9e7a78dca9" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:59:27 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9d6084aa-417e-45c3-baae-53b8bfe63a80 tempest-SnapshotDependencyTests-100115998 None] Lock "cinder-quobyte-db7c94d8-059e-4417-8d26-3a9e7a78dca9" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:59:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-9d6084aa-417e-45c3-baae-53b8bfe63a80 tempest-SnapshotDependencyTests-100115998 None] Deleting offline snapshot db7c94d8-059e-4417-8d26-3a9e7a78dca9 of volume b4aaca3e-6204-4bad-9577-a1646e8cd573 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 04:59:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-9d6084aa-417e-45c3-baae-53b8bfe63a80 tempest-SnapshotDependencyTests-100115998 None] snapshot_file for this snap is: volume-b4aaca3e-6204-4bad-9577-a1646e8cd573.db7c94d8-059e-4417-8d26-3a9e7a78dca9 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 04:59:27 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee9856d-5795-4623-a3f7-c148fa7e641a]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:59:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9d6084aa-417e-45c3-baae-53b8bfe63a80 tempest-SnapshotDependencyTests-100115998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573.db7c94d8-059e-4417-8d26-3a9e7a78dca9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:59:27 devstack sudo[116727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573.db7c94d8-059e-4417-8d26-3a9e7a78dca9 Aug 11 04:59:27 devstack sudo[116727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:59:27 devstack sudo[116727]: pam_unix(sudo:session): session closed for user root Aug 11 04:59:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9d6084aa-417e-45c3-baae-53b8bfe63a80 tempest-SnapshotDependencyTests-100115998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573.db7c94d8-059e-4417-8d26-3a9e7a78dca9" returned: 0 in 0.340s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:59:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-9d6084aa-417e-45c3-baae-53b8bfe63a80 tempest-SnapshotDependencyTests-100115998 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4aaca3e-6204-4bad-9577-a1646e8cd573(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 04:59:27 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17c767f-b79a-4bb4-b51c-5629100c5b51]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:59:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9d6084aa-417e-45c3-baae-53b8bfe63a80 tempest-SnapshotDependencyTests-100115998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:59:27 devstack sudo[116732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573 Aug 11 04:59:27 devstack sudo[116732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:59:28 devstack sudo[116732]: pam_unix(sudo:session): session closed for user root Aug 11 04:59:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9d6084aa-417e-45c3-baae-53b8bfe63a80 tempest-SnapshotDependencyTests-100115998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573" returned: 0 in 0.537s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:59:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9d6084aa-417e-45c3-baae-53b8bfe63a80 tempest-SnapshotDependencyTests-100115998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573.db7c94d8-059e-4417-8d26-3a9e7a78dca9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:59:28 devstack sudo[116737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573.db7c94d8-059e-4417-8d26-3a9e7a78dca9 Aug 11 04:59:28 devstack sudo[116737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:59:28 devstack sudo[116737]: pam_unix(sudo:session): session closed for user root Aug 11 04:59:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9d6084aa-417e-45c3-baae-53b8bfe63a80 tempest-SnapshotDependencyTests-100115998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573.db7c94d8-059e-4417-8d26-3a9e7a78dca9" returned: 0 in 0.320s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:59:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9d6084aa-417e-45c3-baae-53b8bfe63a80 tempest-SnapshotDependencyTests-100115998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573.db7c94d8-059e-4417-8d26-3a9e7a78dca9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:59:28 devstack sudo[116742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573.db7c94d8-059e-4417-8d26-3a9e7a78dca9 Aug 11 04:59:28 devstack sudo[116742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:59:28 devstack sudo[116742]: pam_unix(sudo:session): session closed for user root Aug 11 04:59:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9d6084aa-417e-45c3-baae-53b8bfe63a80 tempest-SnapshotDependencyTests-100115998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573.db7c94d8-059e-4417-8d26-3a9e7a78dca9" returned: 0 in 0.271s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:59:28 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9d6084aa-417e-45c3-baae-53b8bfe63a80 tempest-SnapshotDependencyTests-100115998 None] Lock "cinder-quobyte-db7c94d8-059e-4417-8d26-3a9e7a78dca9" released by "_delete_snapshot" :: held 1.563s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:59:28 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9d6084aa-417e-45c3-baae-53b8bfe63a80 tempest-SnapshotDependencyTests-100115998 None] Lock "cinder-quobyte-b4aaca3e-6204-4bad-9577-a1646e8cd573" released by "delete_snapshot" :: held 1.585s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:59:28 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-9d6084aa-417e-45c3-baae-53b8bfe63a80 tempest-SnapshotDependencyTests-100115998 None] Created reservations ['551e0cea-354a-43a1-850a-13b67911b7f0', 'f8013b90-8545-48b9-af17-b857cefe052d', '79f53cb2-d198-4d92-85e8-d0a921f8fe78', 'd4c6d62f-1dc8-4dd9-8cd9-dbe21975244b'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:59:28 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-9d6084aa-417e-45c3-baae-53b8bfe63a80 tempest-SnapshotDependencyTests-100115998 None] Delete snapshot completed successfully. Aug 11 04:59:28 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9d6084aa-417e-45c3-baae-53b8bfe63a80 tempest-SnapshotDependencyTests-100115998 None] Lock "cinder-db7c94d8-059e-4417-8d26-3a9e7a78dca9-delete_snapshot" released by "delete_snapshot" :: held 1.713s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:59:29 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7e1e7cbf-9209-4ed2-ba0c-bedd37db525f tempest-SnapshotDependencyTests-100115998 None] Acquiring lock "cinder-b4aaca3e-6204-4bad-9577-a1646e8cd573-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:59:29 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7e1e7cbf-9209-4ed2-ba0c-bedd37db525f tempest-SnapshotDependencyTests-100115998 None] Lock "cinder-b4aaca3e-6204-4bad-9577-a1646e8cd573-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:59:29 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7e1e7cbf-9209-4ed2-ba0c-bedd37db525f tempest-SnapshotDependencyTests-100115998 None] Acquiring lock "cinder-quobyte-b4aaca3e-6204-4bad-9577-a1646e8cd573" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:59:29 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7e1e7cbf-9209-4ed2-ba0c-bedd37db525f tempest-SnapshotDependencyTests-100115998 None] Lock "cinder-quobyte-b4aaca3e-6204-4bad-9577-a1646e8cd573" acquired by "delete_volume" :: waited 0.013s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:59:29 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[2624725e-1be0-4672-8caa-828a7b1afbd5]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:59:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7e1e7cbf-9209-4ed2-ba0c-bedd37db525f tempest-SnapshotDependencyTests-100115998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:59:29 devstack sudo[116745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573 Aug 11 04:59:29 devstack sudo[116745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:59:29 devstack sudo[116745]: pam_unix(sudo:session): session closed for user root Aug 11 04:59:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7e1e7cbf-9209-4ed2-ba0c-bedd37db525f tempest-SnapshotDependencyTests-100115998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573" returned: 0 in 0.361s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:59:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7e1e7cbf-9209-4ed2-ba0c-bedd37db525f tempest-SnapshotDependencyTests-100115998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:59:29 devstack sudo[116750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573 Aug 11 04:59:29 devstack sudo[116750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:59:29 devstack sudo[116750]: pam_unix(sudo:session): session closed for user root Aug 11 04:59:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7e1e7cbf-9209-4ed2-ba0c-bedd37db525f tempest-SnapshotDependencyTests-100115998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-b4aaca3e-6204-4bad-9577-a1646e8cd573" returned: 0 in 0.241s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:59:29 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7e1e7cbf-9209-4ed2-ba0c-bedd37db525f tempest-SnapshotDependencyTests-100115998 None] Lock "cinder-quobyte-b4aaca3e-6204-4bad-9577-a1646e8cd573" released by "delete_volume" :: held 0.656s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:59:30 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-7e1e7cbf-9209-4ed2-ba0c-bedd37db525f tempest-SnapshotDependencyTests-100115998 None] Created reservations ['ba5f0fb0-cbe7-4a7a-ad46-74359f48d6a6', 'ee2e4c17-71ba-4f77-bc8a-e051e81b833a', '2ebaa029-c3df-4e71-b2a0-366f15237ea6', 'f20d6314-3c48-4dc5-a64d-6f4ebe8c775c'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:59:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7e1e7cbf-9209-4ed2-ba0c-bedd37db525f tempest-SnapshotDependencyTests-100115998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:59:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7e1e7cbf-9209-4ed2-ba0c-bedd37db525f tempest-SnapshotDependencyTests-100115998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:59:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7e1e7cbf-9209-4ed2-ba0c-bedd37db525f tempest-SnapshotDependencyTests-100115998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:59:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7e1e7cbf-9209-4ed2-ba0c-bedd37db525f tempest-SnapshotDependencyTests-100115998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:59:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7e1e7cbf-9209-4ed2-ba0c-bedd37db525f tempest-SnapshotDependencyTests-100115998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:59:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7e1e7cbf-9209-4ed2-ba0c-bedd37db525f tempest-SnapshotDependencyTests-100115998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:59:30 devstack sudo[116753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:59:30 devstack sudo[116753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:59:30 devstack sudo[116753]: pam_unix(sudo:session): session closed for user root Aug 11 04:59:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7e1e7cbf-9209-4ed2-ba0c-bedd37db525f tempest-SnapshotDependencyTests-100115998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.233s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:59:30 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-7e1e7cbf-9209-4ed2-ba0c-bedd37db525f tempest-SnapshotDependencyTests-100115998 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:59:30 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-7e1e7cbf-9209-4ed2-ba0c-bedd37db525f tempest-SnapshotDependencyTests-100115998 None] Deleted volume successfully. Aug 11 04:59:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7e1e7cbf-9209-4ed2-ba0c-bedd37db525f tempest-SnapshotDependencyTests-100115998 None] Lock "cinder-b4aaca3e-6204-4bad-9577-a1646e8cd573-delete_volume" released by "delete_volume" :: held 1.075s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:59:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b69b888e-d3eb-402e-aff8-fe239eb44830 tempest-SnapshotDependencyTests-100115998 None] Acquiring lock "cinder-a652927d-bd29-4219-bfb0-9a1dc2e9560e-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:59:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b69b888e-d3eb-402e-aff8-fe239eb44830 tempest-SnapshotDependencyTests-100115998 None] Lock "cinder-a652927d-bd29-4219-bfb0-9a1dc2e9560e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:59:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b69b888e-d3eb-402e-aff8-fe239eb44830 tempest-SnapshotDependencyTests-100115998 None] Acquiring lock "cinder-quobyte-a652927d-bd29-4219-bfb0-9a1dc2e9560e" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 04:59:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b69b888e-d3eb-402e-aff8-fe239eb44830 tempest-SnapshotDependencyTests-100115998 None] Lock "cinder-quobyte-a652927d-bd29-4219-bfb0-9a1dc2e9560e" acquired by "delete_volume" :: waited 0.015s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 04:59:30 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87fe931-2b25-4af3-b482-73f6204eba78]: (4, 'qcow2') {{(pid=95794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 04:59:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b69b888e-d3eb-402e-aff8-fe239eb44830 tempest-SnapshotDependencyTests-100115998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a652927d-bd29-4219-bfb0-9a1dc2e9560e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:59:30 devstack sudo[116756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a652927d-bd29-4219-bfb0-9a1dc2e9560e Aug 11 04:59:30 devstack sudo[116756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:59:30 devstack sudo[116756]: pam_unix(sudo:session): session closed for user root Aug 11 04:59:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b69b888e-d3eb-402e-aff8-fe239eb44830 tempest-SnapshotDependencyTests-100115998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a652927d-bd29-4219-bfb0-9a1dc2e9560e" returned: 0 in 0.355s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:59:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b69b888e-d3eb-402e-aff8-fe239eb44830 tempest-SnapshotDependencyTests-100115998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a652927d-bd29-4219-bfb0-9a1dc2e9560e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:59:30 devstack sudo[116761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a652927d-bd29-4219-bfb0-9a1dc2e9560e Aug 11 04:59:30 devstack sudo[116761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:59:31 devstack sudo[116761]: pam_unix(sudo:session): session closed for user root Aug 11 04:59:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b69b888e-d3eb-402e-aff8-fe239eb44830 tempest-SnapshotDependencyTests-100115998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333/volume-a652927d-bd29-4219-bfb0-9a1dc2e9560e" returned: 0 in 0.237s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:59:31 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b69b888e-d3eb-402e-aff8-fe239eb44830 tempest-SnapshotDependencyTests-100115998 None] Lock "cinder-quobyte-a652927d-bd29-4219-bfb0-9a1dc2e9560e" released by "delete_volume" :: held 0.632s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:59:31 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-b69b888e-d3eb-402e-aff8-fe239eb44830 tempest-SnapshotDependencyTests-100115998 None] Created reservations ['3bb0e2ab-9306-4358-8737-e73b5ecd830d', '1bdb7d7f-3fd3-4a48-a5f8-1a447fa26fff', '6f8eb686-0d83-4ec7-bb69-ccb1cfd6e692', '0a89a9b8-2647-4649-baeb-ee45c130f7d0'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 04:59:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b69b888e-d3eb-402e-aff8-fe239eb44830 tempest-SnapshotDependencyTests-100115998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 04:59:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b69b888e-d3eb-402e-aff8-fe239eb44830 tempest-SnapshotDependencyTests-100115998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 04:59:31 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b69b888e-d3eb-402e-aff8-fe239eb44830 tempest-SnapshotDependencyTests-100115998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 04:59:31 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b69b888e-d3eb-402e-aff8-fe239eb44830 tempest-SnapshotDependencyTests-100115998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85dc7fcd-cb36-473c-9066-7c2b210b92dd'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 04:59:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b69b888e-d3eb-402e-aff8-fe239eb44830 tempest-SnapshotDependencyTests-100115998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 04:59:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b69b888e-d3eb-402e-aff8-fe239eb44830 tempest-SnapshotDependencyTests-100115998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 04:59:31 devstack sudo[116764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333 Aug 11 04:59:31 devstack sudo[116764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 04:59:31 devstack sudo[116764]: pam_unix(sudo:session): session closed for user root Aug 11 04:59:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b69b888e-d3eb-402e-aff8-fe239eb44830 tempest-SnapshotDependencyTests-100115998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/596df44d1e183342d63c2d1b00486333" returned: 0 in 0.240s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 04:59:31 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-b69b888e-d3eb-402e-aff8-fe239eb44830 tempest-SnapshotDependencyTests-100115998 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 04:59:31 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-b69b888e-d3eb-402e-aff8-fe239eb44830 tempest-SnapshotDependencyTests-100115998 None] Deleted volume successfully. Aug 11 04:59:31 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b69b888e-d3eb-402e-aff8-fe239eb44830 tempest-SnapshotDependencyTests-100115998 None] Lock "cinder-a652927d-bd29-4219-bfb0-9a1dc2e9560e-delete_volume" released by "delete_volume" :: held 1.058s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 04:59:41 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=29,cinder:UPDATE=29,cinder:DELETE=3,cinder:INSERT=5 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 04:59:41 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:UPDATE=29,cinder:SELECT=20,cinder:INSERT=10,cinder:DELETE=2 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}